AI / LLM Engineer

Infosys
Pune Division, Maharashtra, India

Minimum 10+ years of experience in software engineering, AI/ML engineering, applied ML, data science engineering or related roles.

  • Strong hands-on Python programming experience and practical exposure to LLM-based application development.
  • Experience with RAG, vector databases, embeddings, prompt engineering, evaluation frameworks and AI service integration.
  • Experience with frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI or equivalent tools.
  • Working knowledge of REST APIs, microservices, SQL, structured data concepts, Git workflows, testing and software engineering practices.
  • Understanding of document extraction, semantic search, NLP, retrieval quality, hallucination risk, prompt safety and AI evaluation methods.
  • Ability to build production-oriented AI components rather than isolated proof-of-concept demos. Design and implement LLM-powered workflows for summarization, narrative generation, classification, extraction, contextual reasoning, explanation and reviewer-assist use cases.
  • Build retrieval-augmented generation pipelines including document ingestion, chunking, embedding generation, metadata tagging, vector indexing, retrieval tuning and grounded response generation.
  • Develop reusable prompt templates, prompt versions, context builders, response schemas, evaluation routines and AI orchestration services.
  • Integrate with enterprise AI services such as Azure OpenAI, Azure AI Foundry, OpenAI APIs, Google Gemini, Anthropic, Hugging Face or equivalent approved platforms.
  • Implement AI run logging, prompt/model metadata capture, evidence citations, output traceability, reviewer feedback capture and human-in-the-loop controls.
  • Build AI evaluation routines for answer quality, retrieval quality, hallucination checks, regression testing, consistency and groundedness.
  • Collaborate with backend and DevOps teams to containerize AI services, deploy them securely, monitor usage, track costs and troubleshoot production issues.
  • Support responsible AI practices such as prompt injection checks, data leakage prevention, policy-based guardrails and AI output validation. Experience with Azure OpenAI, Azure AI Foundry, Azure AI Search, Azure Document Intelligence, Google AI Studio/Gemini, AWS Bedrock or Vertex AI.
  • Exposure to RAG evaluation tools such as RAGAS, DeepEval, Promptfoo, LangSmith or equivalent frameworks.
  • Experience with AI governance, prompt/model registry, AI audit logs, explainability, groundedness checks and human review workflows.

Score my resume against this job, free →

Questions about this job

How do I apply for the AI / LLM Engineer job at Infosys?

Use the apply link on this page: you apply directly with Infosys on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Infosys want for this AI / LLM Engineer role?

The job description asks for Python, LLM-based application development, RAG, vector databases, embeddings, prompt engineering, evaluation frameworks and AI service integration. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Infosys?

Apply to the Infosys roles that match your experience, and tailor your resume to each job description: for this role that means showing Python, LLM-based application development, RAG. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this AI / LLM Engineer job remote or onsite?

This is based in Pune Division, Maharashtra.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Infosys, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →