Senior AI Engineer

Pepper
Mumbai, Maharashtra, India

Company: Pepper Content Location: Mumbai (In-office) Employment Type: Full-time Seniority: Senior Experience: 6-10 years

About the Role

This is a strategic builder role for an engineer who wants to own outcomes, not tickets. You will design, build, and ship agentic AI systems end to end, moving fast, putting things in front of users, and scaling what works. You sit at the intersection of product and engineering, and you treat both as your job. This is an in-office role based in Mumbai.

We are looking for someone who has already built real agent systems: orchestration, tool use, memory, and the LLM interfaces that hold it all together. You are fluent across the model landscape, comfortable switching between providers and open-source models, and you know how to get the best out of each. You think in terms of what the product needs and ship at a pace that compounds.

What You Will Do

  • Build and ship agentic AI systems end to end, from idea to production, at a fast and deliberate pace
  • Design and own the LLM interface layer: orchestration, tool calling, memory, evaluation, and the glue that makes agents reliable
  • Work fluently across many LLMs (proprietary and open-source), choosing and routing the right model for each job
  • Shape product and technical direction together, deciding not just how to build but what is worth building
  • Set the engineering standards and best practices for LLM and agent application development
  • Iterate on models and systems with a sharp focus on real business and user impact
  • Scale systems from first working version to production-grade reliability, performance, and cost efficiency
  • Stay ahead of the frontier and bring the best new models, tools, and techniques into the product quickly

What We Are Looking For

  • Proven experience building agentic systems in production, not just demos or prototypes
  • Deep, hands-on experience with LLMs: prompt engineering, fine-tuning, tool use, retrieval, and evaluation
  • Fluency across multiple LLM providers and open-source models, with strong judgment on tradeoffs
  • 6-10 years of software engineering experience, strong fundamentals, fluent in Python, and comfortable owning systems end to end
  • Solid grasp of NLP, ML, and LLM fundamentals
  • Experience building, deploying, and scaling ML and LLM pipelines in production
  • A genuine product sense: you can hold both the user problem and the engineering reality at once
  • A strong bias for action, fast iteration, and continuous learning
  • Deep interest in the latest open-source models, agent frameworks, and AI advancements

Who Will Thrive Here

You will do your best work here if you like ambiguity, move quickly without breaking trust, and care as much about shipping the right thing as shipping it fast. You want real ownership over what gets built and how, and you measure yourself by what reaches users and scales.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior AI Engineer job at Pepper?

Use the apply link on this page: you apply directly with Pepper on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Pepper want for this Senior AI Engineer role?

The job description asks for agentic systems, LLMs, prompt engineering, fine-tuning, tool use, retrieval, evaluation and Python. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Pepper?

Apply to the Pepper roles that match your experience, and tailor your resume to each job description: for this role that means showing agentic systems, LLMs, prompt engineering. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior AI Engineer job remote or onsite?

This is based in Mumbai, Maharashtra.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Pepper, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →