Senior Data Engineer

Newdream Data Systems
Tiruchirappalli, Tamil Nadu, India

Job SummaryWe are seeking a highly skilled Senior Data Engineer with strong expertise in SQL, ETL development, Azure Data Factory (ADF), Azure Databricks, and modern cloud data platforms.

The ideal candidate will have extensive experience designing, developing, and optimizing enterprise data pipelines, integrating data from multiple source systems, and delivering scalable data solutions. Experience in the Insurance domain (Property & Casualty) is highly preferred.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and SQL.
  • Build and optimize complex SQL queries, stored procedures, views, and database objects.
  • Integrate data from multiple sources, including SQL Server, APIs, flat files, and cloud platforms.
  • Develop data transformation, validation, reconciliation, and exception-handling processes.
  • Design and implement data warehouse solutions using Azure SQL, Synapse Analytics, and Microsoft Fabric.
  • Develop and optimize PySpark and Python-based data processing solutions.
  • Implement data quality checks, monitoring, logging, and performance optimization.
  • Collaborate with Business Analysts, Data Architects, QA teams, and business stakeholders.
  • Support production data pipelines, troubleshoot failures, and resolve performance issues.
  • Implement CI/CD pipelines using Azure DevOps and Git.
  • Mentor junior engineers and conduct technical design and code reviews.Required Technical Skills
  • SQL: Advanced T-SQL, query optimization, stored procedures, indexing, and performance tuning.
  • ETL Tools: Azure Data Factory (ADF), SSIS, and data integration frameworks.
  • Cloud Platforms: Microsoft Azure, ADLS Gen2, Azure SQL, and Azure Synapse Analytics.
  • Programming: Python and SQL.
  • Data Warehousing: Dimensional modeling, star/snowflake schemas, and incremental data loading.
  • DevOps: Azure DevOps, Git, CI/CD, and deployment automation.
  • Data Quality: Validation, reconciliation, error handling, and automated monitoring.Preferred Qualifications
  • Experience with Microsoft Fabric, and Power BI.
  • Familiarity with REST APIs, JSON, XML, and event-driven data integration.
  • Microsoft Azure Data Engineer certification or equivalent experience.
  • Strong analytical, troubleshooting, communication, and leadership skills.Education & Experience
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Minimum 8 years of experience in data engineering, ETL development, or data warehousing.
  • At least 3 years of hands-on experience with Azure cloud data technologies.
  • Proven experience delivering enterprise-scale data integration solutions.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior Data Engineer job at Newdream Data Systems?

Use the apply link on this page: you apply directly with Newdream Data Systems on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Newdream Data Systems want for this Senior Data Engineer role?

The job description asks for SQL, ETL development, Azure Data Factory (ADF), Azure Databricks, cloud data platforms, Advanced T-SQL, query optimization and stored procedures. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Newdream Data Systems?

Apply to the Newdream Data Systems roles that match your experience, and tailor your resume to each job description: for this role that means showing SQL, ETL development, Azure Data Factory (ADF). A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior Data Engineer job remote or onsite?

This is based in Tiruchirappalli, Tamil Nadu.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Newdream Data Systems, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →