Senior Data Engineer (Senior Associate – Data Engineering)

Role :Senior Data Engineer (Senior Associate – Data Engineering)

Experience : 9+ Years

Location : Delhi NCR

Immediate Joiners Only.

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in PySpark and Apache Spark who can independently support job validation, optimize data pipelines, and guide client teams on effective data validation techniques.

🔹 Key Responsibilities

• Design, develop, and support large-scale batch and real-time data pipelines.
• Build and optimize ETL/ELT pipelines using PySpark, Apache Spark, and AWS services.
• Perform job validation, troubleshoot issues, and ensure data quality and accuracy.
• Guide client teams on data validation strategies and best practices.
• Develop and optimize data transformation workflows and data models.
• Integrate third-party vendor data through APIs.
• Collaborate with cross-functional teams to deliver scalable data engineering solutions.
• Contribute to infrastructure optimization, automation, and CI/CD initiatives.🔹 Required Skills

✅ Strong hands-on experience with PySpark and Apache Spark✅ 7+ years of experience building ETL pipelines for large datasets✅ 3+ years of experience with AWS services such as S3, Glue, Aurora, and Databricks✅ Strong SQL and Python programming skills✅ Experience in data modeling, database design, and legacy data migration✅ Good understanding of data quality, job validation, and pipeline optimization

🔹 Good to Have

• API development and Redis or other in-memory database experience
• AWS Lambda, IAM, Step Functions, and CloudWatch
• Infrastructure as Code (IaC), automation tools, and CI/CD pipelines
• Relevant AWS certifications