Lead Data Engineer

Statsby Solutions
Pune City, Maharashtra, India

Statsby Solutions

  • India (remote or hybrid)
  • Contract

Statsby Solutions is an AI and Data company built exclusively for the pharmaceutical and clinical research industry. We help the teams behind medicine move faster and deliver with greater confidence.

Are you ready to lead the way in building data platforms that actually scale? We’re looking for an experienced Lead Data Engineer with strong Databricks expertise to design, develop, and maintain high-performance data pipelines and processing solutions.

What You'll Own:

  • Design, develop, and maintain scalable data pipelines using Databricks.
  • Develop data processing solutions using PySpark and Python.
  • Work with Apache Spark for large-scale data processing.
  • Build and optimize ETL/ELT pipelines.
  • Work with Delta Lake for data storage and processing.
  • Develop and manage workflows using Databricks Workflows.
  • Perform data transformation, cleansing, and validation.
  • Optimize Spark jobs and improve pipeline performance.
  • Collaborate with data engineers, analysts, and other technical teams.
  • Troubleshoot data pipeline issues and ensure data quality.

What You Bring:

  • 8-10 years of experience in Data Engineering.
  • Strong hands-on experience with Databricks.
  • Solid command of PySpark, Python, Apache Spark, and SQL
  • Experience with Delta Lake and data lake architecture.
  • Proven experience in building ETL/ELT pipelines.
  • Working Knowledge of Azure, AWS, or GCP.
  • Experience with Git and CI/CD is an added advantage.

Good to Have:

  • Experience with Azure Databricks.
  • Knowledge of Azure Data Factory, ADLS, or similar cloud data services.
  • Experience with DBT, Snowflake, or other modern data platforms.
  • Databricks certification is a plus.

Why Join Us:

  • Get an opportunity to work on real-world Data Engineering and AI projects.
  • Exposure to modern data technologies and cloud platforms.
  • Collaborative and learning-focused work environment.
  • Opportunity to work with a growing technology team.

Score my resume against this job, free →

Questions about this job

How do I apply for the Lead Data Engineer job at Statsby Solutions?

Use the apply link on this page: you apply directly with Statsby Solutions on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Statsby Solutions want for this Lead Data Engineer role?

The job description asks for Databricks, PySpark, Python, Apache Spark, SQL and Delta Lake. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Statsby Solutions?

Apply to the Statsby Solutions roles that match your experience, and tailor your resume to each job description: for this role that means showing Databricks, PySpark, Python. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Lead Data Engineer job remote or onsite?

This is based in Pune City, Maharashtra.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Statsby Solutions, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →