Data Architect - Databricks (FMCG, Retail or Shipping industry)

Job Title: Data Architect / Senior Data Architect – Databricks

Location: Bengaluru, Karnataka

Work Mode: Hybrid – 2–3 days per week in office

Employment Type: Full-time, Permanent

Experience: 10+ years overall, including at least 7 years in Data Engineering, Data Platforms, or Analytics

Notice Period: Immediate joiners or candidates available within 30 days preferred

Preferred candidate: FMCG, Retail, or Shipping industry

About the Opportunity

We are hiring experienced Data Architects / Senior Data Architects for a leading Data & AI consulting organisation. The role involves designing and delivering enterprise Databricks solutions, leading technical implementations, and helping global customers solve complex data and AI challenges.

Key Responsibilities

• Design and lead enterprise-scale Data & AI solutions on the Databricks Lakehouse Platform.
• Define end-to-end architecture aligned with business requirements and technical objectives.
• Architect scalable, secure, high-performance data platforms on AWS, Azure, and/or GCP.
• Lead enterprise Databricks implementations from discovery and solution design through production deployment and support.
• Develop and optimise data pipelines using Apache Spark, Databricks, and Delta Lake.
• Build scalable ETL/ELT frameworks using modern data engineering practices.
• Analyse Spark execution plans and optimise distributed workloads for performance, reliability, scalability, and cost.
• Collaborate with platform engineering teams on CI/CD pipelines, deployment automation, Infrastructure as Code, and DevOps practices.
• Support enterprise MLOps implementation and integration with AI workflows.
• Lead architecture workshops, technical discovery sessions, and presentations to senior stakeholders.
• Establish architecture standards, reusable solution accelerators, coding practices, and governance frameworks.
• Ensure data security, compliance, quality, and operational excellence.
• Mentor engineering teams and provide technical guidance throughout delivery.

Required Skills and Experience

• 10+ years of consulting and technology experience, including at least 7 years in Data Engineering, Data Platforms, or Analytics.
• Proven delivery of at least 6–8 enterprise Databricks implementations in production environments.
• Mandatory hands-on experience delivering enterprise data solutions.
• Strong expertise in Databricks, Apache Spark, Delta Lake, and ETL/ELT architecture.
• Experience designing and deploying large-scale distributed data platforms.
• Strong understanding of Spark architecture, execution plans, runtime optimisation, and production troubleshooting.
• Experience with cloud-native data architecture on AWS, Azure, and/or GCP.
• Strong customer-facing consulting, solution architecture, and stakeholder management skills.
• Experience working with global enterprise customers across multiple industries.
• Excellent communication, presentation, problem-solving, and workshop facilitation skills.

Education and Preferred Certifications

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline.
• Master’s degree preferred.
• Databricks Data Engineer Professional certification preferred.
• Additional AWS, Azure, or GCP certifications are highly desirable.