Senior Data Engineer – AI-Driven Data Engineering

We are looking for a Senior Data Engineer who understands both traditional Data Engineering and the growing role of AI in software development.

We want someone who understands how data pipelines work but also knows how to use AI tools to write code, automate repetitive tasks, improve testing, and make the development process faster and more efficient.

You will work closely with a small team, contribute ideas, identify opportunities for automation, and help improve the platform as the product evolves.

What You'll Do

• Build, understand, and troubleshoot ETL/ELT data pipelines.
• Use AI coding tools to generate, review, debug, and improve SQL, Python, and pipeline code.
• Work with an existing platform that automates data pipeline code generation.
• Handle data from different sources and formats, transforming it into reliable, consistent datasets.
• Work with Snowflake, SQL, Python, and Apache Airflow.
• Write and maintain automated tests to ensure pipeline reliability and data quality.
• Understand data lineage, dependencies, transformations, and change management.
• Identify repetitive engineering tasks and find ways to automate them using AI and code-generation tools.
• Review AI-generated code critically, validate its output, and ensure it is reliable and production-ready.
• Take ownership of your work, proactively suggest improvements, and help shape the product.

Required Skills

• Strong hands-on experience in Data Engineering.
• Excellent SQL skills and a solid understanding of data warehouse concepts.
• Experience with Snowflake or a similar cloud data warehouse.
• Strong Python programming skills.
• Good understanding of ETL/ELT pipelines and data transformations.
• Experience with Apache Airflow; Astronomer experience is a plus.
• Experience with automated testing and debugging data workflows.
• Practical experience using AI coding tools such as ChatGPT, Claude, GitHub Copilot, or Cursor to generate or improve code.
• Ability to understand, validate, and troubleshoot AI-generated code rather than relying on it blindly.
• Familiarity with VS Code and modern development workflows.

What We're Looking For:

We want someone who is excited about how AI is changing the way software and data engineering are done.

You should be comfortable experimenting with new tools, using AI to accelerate repetitive work, and applying your Data Engineering knowledge to make sure the resulting code is correct.

You will join a small team where initiative, technical judgment, and ownership matter. Your ideas and feedback will directly contribute to improving the platform and how it is built.

3:30 PM – 12:30 AM IST, with a preference for 4:30 PM – 1:30 AM IST, to provide overlap with the US-based team.

AI experience is important for this role. We are looking for someone who combines strong Data Engineering fundamentals with a practical, forward-looking approach to AI-assisted software development.