Senior LLM and Agentic AI Engineer - Assistant Vice President

Citi
Chennai, Tamil Nadu, India

About The Role

We are looking for a hands-on Senior AI Engineer to design, build, and scale next-generation AI-powered digital experiences. You will work on cutting-edge Generative AI, Agentic AI, Conversational AI, and Machine Learning solutions that enhance customer engagement, automate workflows, and deliver personalized experiences at scale.

This role is ideal for engineers passionate about building production-grade AI systems using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, and modern cloud-native architectures.

What You’ll Do

Generative AI & Agentic AI

  • Design and deploy enterprise-grade GenAI applications using GPT, Claude, Gemini, or equivalent LLMs.
  • Build Agentic AI solutions using frameworks such as LangChain, LangGraph, CrewAI, or similar.
  • Develop multi-agent systems to automate customer journeys and business workflows.
  • Implement advanced prompt engineering, evaluation frameworks, and guardrails to improve AI response quality.

RAG & Knowledge Systems

  • Design and optimize Retrieval-Augmented Generation (RAG) architectures.
  • Integrate vector databases and enterprise knowledge repositories.
  • Improve retrieval accuracy, response relevance, and grounding of AI-generated content.

Software Engineering

  • Build scalable backend services and APIs using Java and/or Python.
  • Develop cloud-native microservices and integrate AI capabilities into customer-facing applications.
  • Collaborate with architects, product managers, and business stakeholders to deliver high-impact solutions.

AI Operations & Governance

  • Monitor model performance, latency, and operational costs.
  • Implement AI governance, observability, and responsible AI practices.
  • Optimize LLM usage and inference costs in production environments.

Required Skills

Must Have

  • 8-11 years of software engineering experience.
  • 2+ years of hands-on experience building GenAI or LLM-powered applications.
  • Strong experience with:
  • GPT, Claude, Gemini, or similar LLMs
  • LangChain, LangGraph, CrewAI, or AI Agent frameworks
  • Retrieval-Augmented Generation (RAG)
  • Vector databases
  • Prompt Engineering
  • Strong programming skills in Java and/or Python.
  • Experience building REST APIs and microservices.
  • Familiarity with cloud platforms and modern software development practices.

Nice to Have

  • MLOps experience (deployment, monitoring, model lifecycle management).
  • Experience with recommendation engines or conversational AI platforms.
  • Knowledge of financial services, wealth management, or digital banking.
  • Experience with React, Angular, or modern frontend frameworks.

What Success Looks Like

  • Build scalable AI-powered digital experiences used by millions of customers.
  • Deliver production-ready Agentic AI and GenAI solutions.
  • Improve customer engagement, automation, and operational efficiency through AI innovation.
  • Drive adoption of emerging AI technologies across the organization.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Digital Software Engineering

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior LLM and Agentic AI Engineer - Assistant Vice President job at Citi?

Use the apply link on this page: you apply directly with Citi on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Citi want for this Senior LLM and Agentic AI Engineer - Assistant Vice President role?

The job description asks for software engineering, GenAI, LLM-powered applications, GPT, Claude, Gemini, LangChain and LangGraph. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Citi?

Apply to the Citi roles that match your experience, and tailor your resume to each job description: for this role that means showing software engineering, GenAI, LLM-powered applications. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior LLM and Agentic AI Engineer - Assistant Vice President job remote or onsite?

This is based in Chennai, Tamil Nadu.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Citi, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →