Data Engineer
Scoutit
New Delhi, Delhi, India
We're looking for Data Engineers!
Responsibilities:
- Design and build scalable data pipelines using Azure Databricks and PySpark.
- Develop and maintain ETL/ELT workflows for batch and real-time data processing.
- Work with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure SQL services.
- Optimize data processing performance and ensure data quality and reliability.
- Collaborate with business stakeholders, data analysts, and architects to deliver data solutions.
- Implement data governance, security, and best practices in cloud data platforms.
Qualifications:
- Familiarity with Azure Databricks and PySpark.
- Familiarity with Azure Data Factory (ADF) and ADLS Gen2.
- Proficiency in SQL and data modeling concepts.
- Good understanding of ETL, data warehousing, and big data processing.
- Familiarity with Git, CI/CD, and Agile methodologies.
(Note: Relevant applicants will receive an email requesting additional information as part of the next stage. The application process will be completed directly on the team's designated platform, and all subsequent communication and decisions regarding the opportunity are managed by the respective hiring team.)