Data Engineer

About the Company

Hashedin by Deloitte© HASHEDIN BY DELOITTE 2025 | Page 1

ABOUT HASHEDIN We are software engineers who solve business problems with a Product Mindset for leading global organizations. By combining engineering talent with business insight, we build software and products that can create new enterprise value. The secret to our success is a fast-paced learning environment, an extreme ownership spirit, and a fun culture. WHY SHOULD YOU JOIN US? With the agility of a start-up and the opportunities of an enterprise, every day at HashedIn, your work will make an impact that matters. So, if you are a problem solver looking to thrive in a dynamic fun culture of inclusion, collaboration, and high performance – HashedIn is the place to be! From learning to leadership, this is your chance to take your software engineering career to the next level. So, what impact will you make? Visit us @ https://hashedin.com

About the Role

POSITION Data Engineering

LOCATION Bangalore/Hyderabad/Pune/Coimbatore

EXPERIENCE 5 to 8 Years

JOB TITLE: Data Engineering

OVERVIEW OF THE ROLE: As a Tech Lead – Data Engineering, you will lead the design of, and stay hands-on in building and optimizing, secure, scalable data pipelines and lakehouse/warehouse platforms on Databricks or Snowflake that power business-critical analytics, data science, and AI applications. You will play a central role in setting technical direction and in implementing and automating batch and, where required, streaming data workflows using modern cloud technologies (AWS, GCP, or Azure). You will guide a team of data engineers, set engineering standards, and own technical delivery and quality. Working within cross-functional teams and with client stakeholders, you will deliver well-engineered, high-quality code and data models, enable AI-ready data for RAG, LLM, and ML use cases, build and deploy AI agents using Agent Bricks and Snowflake Cortex, and drive best practices for data reliability, lineage, quality, governance, cost efficiency, and security.

Responsibilities

• Key Responsibilities:

Technical leadership and delivery

• Lead architecture and technical design for data pipelines and platforms on Databricks or Snowflake, owning design reviews and documenting key decisions and trade-offs.
• Lead a small team of data engineers: guide day-to-day work, allocate tasks, and uphold engineering standards through code and design reviews.
• Own technical delivery: estimate, plan, and break down work, flag and mitigate technical risks, and ensure on-time, high-quality releases in an Agile setup.
• Partner with client and business stakeholders to translate requirements into technical solutions, and communicate designs, trade-offs, and status clearly.

Pipeline design and development

• Design, build, and optimize scalable batch and streaming data pipelines and ETL/ELT workflows on Databricks or Snowflake, using Spark (PySpark/Scala), SQL, and orchestration tools such as Airflow, Prefect, or Databricks Workflows.
• Architect efficient solutions for high-volume, batch and, where required, real-time streaming and event-driven data processing, leveraging best-in-class patterns and frameworks.
• Architect and implement Medallion (Bronze/Silver/Gold) and lakehouse/warehouse architectures using Delta Lake, Delta Live Tables/Lakeflow, Snowpipe, Streams, Tasks, and Dynamic Tables to support analytics, data science, AI, and BI workloads.
• Write performant, production-grade SQL for complex data aggregation, transformation, and analytics tasks, and lead data modeling, schema design, and partitioning/clustering strategies for the team’s solutions.

Quality, governance, and security

• Establish and own data quality and consistency through validation, cleansing, anomaly detection, and reconciliation, using frameworks such as Great Expectations or Deequ.
• Implement, document, and extend data governance, lineage, and cataloging using Unity Catalog, Snowflake governance features, or tools such as Purview, Glue, Atlan, Alation, IDMC, etc.
• Apply and enforce data security, privacy, and compliance controls (access control, PII masking, retention policies, GDPR/CCPA) across the data platform.

Operations and optimization

• Define and automate deployment and operations of pipelines using CI/CD, containerization, and infrastructure-as-code (Databricks Asset Bundles, Terraform), with monitoring and observability in place.
• Drive platform performance and cost optimization through cluster and warehouse sizing, file and partition tuning, query profiling, and resource monitoring.

AI enablement and collaboration

• Build governed, AI-ready data pipelines that support RAG, LLM, and ML use cases using Databricks Mosaic AI or Snowflake Cortex, including preparing and chunking unstructured data.
• Design, build, and deploy AI agents using Agent Bricks on Databricks or Cortex Agents (with Cortex Search and Cortex Analyst) on Snowflake, including evaluation, monitoring, and governed access to enterprise data.
• Partner with Data Scientists, Analysts, Product Owners, and DevOps engineers to ingest, structure, and expose structured, semi-structured, and unstructured data for diverse use cases.

Ownership and engineering excellence

• Take ownership of the end-to-end pipeline lifecycle across the team’s deliverables (design, development, code review, testing, deployment, monitoring, and troubleshooting), and build and drive adoption of reusable modules and frameworks that improve maintainability.
• Mentor and coach engineers, lead technical discussions, and stay current with emerging data and AI technologies, driving their adoption where valuable.

Professional Attributes:

• Strong analytical and problem-solving skills, with attention to detail and a commitment to code quality, testing, and documentation.
• Clear communicator who can explain technical designs, trade-offs, and issues to engineers and business stakeholders, including client leadership, and translate business requirements into data solutions.
• Self-starter and fast learner with an extreme ownership mindset, who thrives in dynamic, fast-paced, collaborative environments.
• Curious about emerging data and AI technologies (Databricks, Snowflake, GenAI, AI agents).
• Passion for mentoring