Data Engineer – Databricks & dbt
Job Title: Data Engineer – Databricks & dbt
Experience: 5+ Years
Location: Remote – India
Employment Type: Contract
Job Summary
We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks and dbt to support the development and modernization of enterprise data assets on the OneData platform. The ideal candidate will be responsible for building scalable, reusable, and well-governed data pipelines and models following established data engineering standards.
Key Responsibilities
- Design, develop, and optimize data pipelines and transformations using Databricks and dbt.
- Build and maintain data models across Bronze, Silver, and Gold layers using Medallion architecture.
- Develop reusable dbt models, macros, and data transformation frameworks.
- Implement automated testing, documentation, version control, and deployment practices.
- Optimize SQL queries, Spark processing, and Databricks workloads for performance and cost efficiency.
- Manage data dependencies, orchestration, lineage, and data quality.
- Collaborate with data product teams, solution architects, and engineering leads.
Required Technical Skills
Databricks
- Strong experience with Databricks, Delta Lake, Apache Spark, PySpark, and SQL.
- Knowledge of Unity Catalog and Databricks Workflows/Jobs.
- Experience with Medallion architecture and data modeling.
- Performance tuning and optimization.
dbt (Data Build Tool)
- Hands-on experience with dbt Core and/or dbt Cloud.
- dbt Models, Sources, Seeds, and Snapshots.
- Materializations: Table, View, Incremental, and Ephemeral.
- Macros and Jinja templating.
- Data testing, documentation, DAGs, and lineage management.
- Package management and reusable frameworks.
Engineering Practices
- Advanced SQL and dimensional data modeling.
- Python and/or PySpark for data processing.
- Git, CI/CD, testing, and deployment practices.
Good to Have
- AWS fundamentals, especially Amazon S3.
- Databricks performance and cost optimization.
- Experience with enterprise-scale data platforms.
Skills: pyspark,dbt,sql,apache spark,python,data modeling,unity catalog,delta lake,data engineering,databricks