Senior Databricks Developer

Senior Databricks Developer – 5+ Years ExperienceExperience: 5+ Years

Client: US-Based Client

Position: Senior Databricks Developer / Data Engineer

Job DescriptionWe are seeking an experienced Senior Databricks Developer to join our team and work on challenging data engineering and cloud analytics projects for a US-based client.

The ideal candidate will have strong hands-on experience with Azure Databricks, PySpark, Python, SQL, and Azure Data Factory (ADF), along with expertise in designing and implementing scalable data pipelines and modern data platforms.

Key Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable data processing solutions using Python, SQL, and Apache Spark.
• Develop and maintain data pipelines using Azure Data Factory.
• Implement Delta Lake architecture and Medallion Architecture (Bronze, Silver, Gold).
• Optimize Databricks jobs, queries, and workflows for performance and cost efficiency.
• Integrate data from multiple sources into Azure Data Lake Storage (ADLS).
• Implement data quality checks, validation, monitoring, and error handling.
• Collaborate with US-based technical and business teams to deliver reliable data solutions.
• Support production deployments, troubleshooting, and performance improvements.Required Skills
• 5+ years of experience in Data Engineering or ETL development.
• Strong hands-on experience with Azure Databricks and PySpark.
• Advanced SQL and Python programming skills.
• Experience with Azure Data Factory, ADLS Gen2, and Delta Lake.
• Good understanding of data warehousing, dimensional modeling, and ETL/ELT concepts.
• Experience with Git, CI/CD pipelines, and Azure DevOps.
• Strong debugging, problem-solving, and communication skills.Preferred Qualifications
• Experience with Databricks Unity Catalog and Delta Live Tables/Lakeflow.
• Knowledge of Microsoft Fabric, Azure Synapse Analytics, or Power BI.
• Experience with large-scale data migrations and performance optimization.
• Databricks or Microsoft Azure certifications.
• Prior experience working with US-based clients.Why Join Us?This is an excellent opportunity to work on modern cloud data platforms, solve complex engineering challenges, collaborate with experienced professionals, and contribute to impactful projects for a US-based client.

Interested candidates can share their updated resumes or reach out directly to discuss this opportunity