AWS Data engineer
Live Connections
Chennai, Tamil Nadu, India
Exp : 6yrs to 8yrs
AWS Data engineer
Job Description:
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data solutions on AWS. The ideal candidate will have strong expertise in PySpark, Python, and AWS data services, with the ability to work independently and deliver high-quality data engineering solutions.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Python.
- Build and deploy AWS-based data solutions using services such as S3, Lambda, SNS, and Step Functions.
- Process, transform, and optimize large-scale datasets for analytics and reporting.
- Develop efficient and reliable ETL/ELT workflows.
- Monitor and troubleshoot data pipelines to ensure performance and reliability.
- Work independently as an individual contributor to deliver data engineering initiatives.
- Follow best practices for data quality, governance, and metadata management.
Required Skills:
- PySpark
- Python (NumPy, Pandas, etc.)
- AWS Services (S3, Lambda, SNS, Step Functions)
- Data Pipeline Development & ETL
- SQL