Databricks Engineer – AI Agents & Generative AI

Job Title: Databricks Engineer – AI Agents & Generative AI

Location: India (Remote)

Primary Skills: Databricks, Python, SQL, PySpark, Generative AI, LLMs, AI Agents, RAG, Mosaic AI, Vector Search, MLflow, REST APIs

Job Description

We are a technology consulting and digital transformation firm delivering enterprise-grade data and AI solutions. We are looking for a Databricks Developer with hands-on experience in data engineering, Generative AI, and AI agent development to build scalable, production-ready AI applications using the Databricks platform.

The ideal candidate should have strong Python and SQL skills, experience with Databricks, and practical knowledge of building LLM-powered applications, RAG solutions, and AI agents.

Responsibilities

• Develop and maintain data pipelines using Databricks, Python, SQL, and PySpark.
• Build AI agents and Generative AI applications using LLMs, RAG, and relevant AI frameworks.
• Work with Databricks Mosaic AI, Vector Search, MLflow, and Model Serving.
• Integrate AI applications with enterprise data sources, APIs, and external systems.
• Optimize data processing and AI application performance.
• Collaborate with cross-functional teams on solution design, development, testing, and deployment.
• Follow best practices for code quality, security, documentation, and CI/CD.

Required Qualifications

• 5+ years of experience in Databricks development, data engineering, or related software engineering roles.
• Strong hands-on experience with Python, SQL, Apache Spark, and PySpark.
• Practical experience building AI agents or Generative AI applications using LLMs.
• Understanding of RAG, embeddings, vector search, and prompt engineering.
• Experience with data pipelines, REST APIs, Git, and CI/CD practices.
• Strong problem-solving, communication, and collaboration skills.

Preferred Qualifications

• Experience with Databricks Mosaic AI and AI agent frameworks.
• Familiarity with LangChain, LangGraph, MLflow, and Unity Catalog.
• Experience deploying and monitoring AI applications in production.
• Databricks certifications or experience with Azure, AWS, or Google Cloud.