Senior Data Engineer

Zemoso Technologies
Bangalore Urban, Karnataka, India

Senior Data Engineer – Job Description

Location - Bangalore

Role Overview

We are looking for a Senior Data Engineer who provides technical leadership and hands-on ownership for complex, high-impact data engineering solutions across client engagements.

This role sits between Data Engineer and Principal Engineer, extending senior execution into cross-project design decisions, standards, and accelerators, while still delivering critical components end-to-end.

The Principal Data Engineer reduces ambiguity, drives technical direction, and raises engineering quality across teams.

Key Responsibilities

Technical Leadership & Solution Design

  • Lead design for complex data subsystems (ingestion, transformation, curation, serving).
  • • Drive key design choices such as batch vs streaming, lakehouse vs warehouse, orchestration approach, and partitioning strategy.
  • • Define and enforce standards for pipeline design, coding practices, documentation, and production readiness.

Hands-on Data Engineering Ownership

  • Design, build, and optimize ETL / ELT pipelines using Python, SQL, and distributed processing frameworks (Spark / Databricks).
  • • Own complex integrations across multiple source systems (APIs, files, CDC/event streams).
  • • Optimize pipelines for performance, reliability, and cost efficiency.

Orchestration, Reliability & Operations

  • Architect and implement orchestration patterns (Airflow or equivalent), including retries, backfills, SLAs, and dependency management.
  • • Establish monitoring, alerting, and data quality checks.
  • • Lead triage and resolution of high-severity data pipeline issues.

Platform Enablement (Applied, Not Architectural-Heavy)

  • Implement CI/CD practices for data pipelines.
  • • Build reusable components and templates (ingestion patterns, validation utilities, standard DAGs) to accelerate delivery.
  • • Partner with Architects to align solutions with modern cloud data platform patterns where needed.

Mentoring & Collaboration

  • Mentor Senior and mid-level engineers through design and code reviews.
  • • Clearly communicate design decisions and trade-offs to engineers, product teams, and clients/stakeholder.

Design & Architecture Articulation

  • Produce and maintain design docs and Architecture Decision Records (ADRs) including trade-offs, risks, and rollout plans.
  • • Communicate design intent and responsibilities across teams clearly.

Must-Have Skills

  • Strong proficiency in Python and SQL.
  • • Deep hands-on experience with Spark / PySpark / Databricks.
  • • Solid experience designing production-grade ETL / ELT pipelines and orchestration workflows.
  • • Strong understanding of data modeling, data warehouses, and data lakes.
  • • Practical experience with cloud platforms (AWS / Azure / GCP).
  • • Proven ability to lead technical decisions, mentor engineers, and deliver under ambiguity.

Nice-to-Have Skills

  • Experience with streaming or event-driven data pipelines (Kafka, Kinesis, Pub/Sub).
  • • Exposure to data observability, governance, or catalog tools.
  • • Familiarity with containers, IaC, or platform enablement practices.
  • • Relevant cloud or data engineering certifications.

What Success Looks Like in This Role

  • You deliver the hardest and most ambiguous parts of client data platforms.
  • • You reduce ambiguity by turning requirements into clear designs and execution plans.
  • • Your pipelines are reliable, observable, cost-aware, and production-ready.
  • • You uplift the DE practice through standards, reusable components, and mentorship.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior Data Engineer job at Zemoso Technologies?

Use the apply link on this page: you apply directly with Zemoso Technologies on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Zemoso Technologies want for this Senior Data Engineer role?

The job description asks for Python, SQL, Spark, PySpark, Databricks, ETL, ELT and data modeling. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Zemoso Technologies?

Apply to the Zemoso Technologies roles that match your experience, and tailor your resume to each job description: for this role that means showing Python, SQL, Spark. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior Data Engineer job remote or onsite?

This is based in Bangalore Urban, Karnataka.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Zemoso Technologies, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →