Senior Data Engineer
NovintiX
Greater Chennai Area
We are looking for a skilled Data Engineer with 6+Years of experience in Python, PySpark, AWS, Azure Databricks, SQL, and Power BI to develop scalable data pipelines, process large datasets, and build interactive dashboards.
Key Responsibilities:
- Develop and maintain ETL/ELT pipelines using Python and PySpark.
- Build and optimize data processing workflows in Azure Databricks.
- Write complex SQL queries and perform data transformations.
- Implement data ingestion, cleansing, validation, and quality checks.
- Work with Azure Data Lake Storage and Delta Lake.
- Develop interactive Power BI dashboards and reports using DAX and Power Query.
- Optimize data pipelines, Spark jobs, and Power BI reports.
- Collaborate with stakeholders to deliver reliable data solutions.
Required Skills
- Strong knowledge of Python, PySpark, and SQL.
- Hands-on experience with Aws, Azure Databricks.
- Experience in ETL/ELT and data warehousing concepts.
- Proficiency in Power BI, DAX, and Power Query.
- Knowledge of Azure Data Lake Storage, Delta Lake, and Git.