Senior Databricks Data Engineer

Judge India Solutions
Pune District, Maharashtra, India

Job Location: Pimpri-Chinchwad, Pune

Position: Senior Databricks Data Engineer

Rel. Experience: 10+ Years

Work mode-Hybrid (3 days WFO/week)

We are seeking a Senior Databricks Data Engineer to provide technical leadership for a large-scale enterprise BI modernization initiative. This is not a lift-and-shift migration effort. The role will lead the systematic transformation of a complex Microsoft BI ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture.

The Senior Engineer will establish architectural standards, define repeatable migration frameworks, , and guide the modernization of thousands of legacy data assets into reusable, high-performance Spark-based solutions. This individual combines deep hands-on data engineering expertise with architectural thinking, mentorship capability, and strong cross-functional collaboration skills.

Key Responsibilities

  • Lead the architecture and implementation of enterprise-scale data pipelines on Databricks.
  • Serve as technical lead for the migration of a ~20TB Microsoft SQL Server data warehouse to the Databricks Lakehouse Platform.
  • Design and implement reusable Spark-based pipeline frameworks to replace thousands of SSIS workflows.
  • Deconstruct SSAS cube logic and redesign it into Lakehouse-native semantic models.
  • Replace legacy SSRS reporting ecosystems with modern, governed analytics layers.
  • Rebuild dimensional models within Delta Lake using scalable Lakehouse design patterns.
  • Define data modeling standards, ingestion frameworks, CI/CD processes, and operational best practices.
  • Implement and enforce Medallion architecture standards (Bronze/Silver/Gold) with performance optimization and governance controls.
  • Optimize Spark workloads for scalability, reliability, and cost efficiency.
  • Implement governance, lineage, security, and monitoring using Unity Catalog and related platform tooling.
  • Mentor engineers, conduct architectural reviews, establish and maintain engineering standards.
  • Partner with BI, analytics, and AI/ML teams to enable advanced analytics and downstream use cases.
  • Influence platform roadmap and architectural decisions.

Required Qualifications

  • Bachelor’s or master’s degree in computer science, engineering, or related field.
  • 8 – 12 years of data engineering experience.
  • 5+ years of hands-on experience building and operating production workloads on Databricks.
  • Deep expertise in SQL, PySpark, and distributed data processing.
  • Demonstrated leadership in structured enterprise BI modernization programs.
  • Proven experience replacing SSIS-based ETL with scalable Spark-based frameworks.
  • Strong understanding of SSAS cube architecture and semantic layer modernization.
  • Experience designing and operating high-volume, enterprise-grade analytical data platforms.
  • Strong knowledge of Delta Lake, Lakehouse and Medallion architectures, data versioning, and Workflows/Jobs orchestration.
  • Experience implementing CI/CD, testing frameworks, and operational reliability for data platforms.
  • AWS-based Databricks experience strongly preferred.

Preferred Skills

  • Experience designing semantic layers and BI integrations (Power BI preferred).
  • Exposure to Databricks AI/ML capabilities (MLflow, feature engineering, feature stores).
  • Experience establishing enterprise migration patterns across distributed teams.
  • Prior technical leadership experience in global or multi-team environments.
  • Strong stakeholder engagement and communication skills.
  • Databricks certification is a plus.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior Databricks Data Engineer job at Judge India Solutions?

Use the apply link on this page: you apply directly with Judge India Solutions on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Judge India Solutions want for this Senior Databricks Data Engineer role?

The job description asks for Bachelor’s or master’s degree in computer science, engineering, or related field., 8 – 12 years of data engineering experience., 5+ years of hands-on experience building and operating production workloads on Databricks., Deep expertise in SQL, PySpark, and distributed data processing., Demonstrated leadership in structured enterprise BI modernization programs., Proven experience replacing SSIS-based ETL with scalable Spark-based frameworks., Strong understanding of SSAS cube architecture and semantic layer modernization. and Experience designing and operating high-volume, enterprise-grade analytical data platforms.. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Judge India Solutions?

Apply to the Judge India Solutions roles that match your experience, and tailor your resume to each job description: for this role that means showing Bachelor’s or master’s degree in computer science, engineering, or related field., 8 – 12 years of data engineering experience., 5+ years of hands-on experience building and operating production workloads on Databricks.. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior Databricks Data Engineer job remote or onsite?

This is based in Pune District, Maharashtra.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Judge India Solutions, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →