Senior Data Engineer
About the Role
Are you a builder who enjoys bridging the gap between complex business logic and
high-performance data pipelines? We are looking for a versatile Data Engineer to join our team.
In this role, you will be a strategic partner to our business teams. You'll take ambiguous,
high-level business requirements and architect them into robust, scalable big data solutions.
We operate at massive scale, processing petabytes of data daily through distributed computing
frameworks like Apache Spark, Apache Flink, and Apache Hive, with data persisted in
Apache Iceberg format. Our real-time pipelines leverage Google Cloud Platform (GCP)
services such as Pub/Sub, BigQuery, Bigtable, GCS, and BigLake to support low-latency,
high-throughput data processing needs
What You’ll Do
● Architect & Build: Design and maintain large-scale, distributed data processing
pipelines using Spark and Flink.
● Bridge the Gap: Act as a technical translator, working closely with business
stakeholders to understand their needs and convert them into technical blueprints.
● Standardize Data: Develop and implement Common Data Models (CDM) to ensure
consistency and interoperability across our data ecosystem.
● Optimize ETL: Own the end-to-end ETL/ELT lifecycle, ensuring high data quality,
reliability, and low latency.
● Code in Scala: Write clean, performant, and maintainable code in Scala to handle
complex stream and batch processing.
What You Bring
● Experience: 5+ years of experience in big data engineering, with a passion for handling
"Flipkart-scale" data.
● The Data Mindset: Deep understanding of ETL patterns and experience designing
Common Data Models (CDM).
● The Big Data Toolkit: Hands on experience in Big data tech stack like Spark, Flink,
Kafka, Iceberg, Bigquery etc
● The Analytical Edge: Ability to deconstruct complex business logic and represent it
through structured data architecture.
● Communication Skills: You are comfortable presenting technical concepts to
non-technical audiences and vice-versa.
● Problem Solver: A track record of optimizing performance for large-scale data systems.