Azure Data Engineer

Azure Data Engineer

Job Description :

We are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks, PySpark, and Azure Data Platform services to design, develop, and optimize scalable data solutions.

Key Responsibilities :

• Design and build scalable data pipelines using Azure Databricks and PySpark.
• Develop and maintain ETL/ELT workflows for batch and real-time data processing.
• Work with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure SQL services.
• Optimize data processing performance and ensure data quality and reliability.
• Collaborate with business stakeholders, data analysts, and architects to deliver data solutions.
• Implement data governance, security, and best practices in cloud data platforms.

Required Skills :

• Strong hands-on experience with Azure Databricks and PySpark.
• Experience with Azure Data Factory (ADF) and ADLS Gen2.
• Proficiency in SQL and data modeling concepts.
• Good understanding of ETL, data warehousing, and big data processing.
• Experience with Git, CI/CD, and Agile methodologies.

Preferred Skills :

• Experience with Delta Lake, Spark Optimization, and Data Lake architecture.
• Knowledge of Azure Synapse Analytics.
• Azure Certification would be an added advantage.