Senior AI Engineer

Touchstones
India

About Touchstones

Touchstones is an AI-native hiring company. We build role-specific engineering work samples where candidates are allowed to use AI. We capture the work trail and map every piece of evidence to the hiring team's rubric, and a human reviewer makes the call. We've run 850+ candidate screens, growing 145% month over month, and we're backed by Mucker Capital. You'd be one of the first engineers, working directly with the founder.

Location: Remote (India). Full-time, Mid-Senior level.

What you'll do

  • Build the LLM pipelines that evaluate captured work against each rubric criterion, with evidence citations and calibrated reasoning.
  • Design evaluation harnesses (golden sets, regression evals, recall/precision on evidence retrieval) so scoring quality is measured, not assumed.
  • Author and harden AI-engineering assessments: retrieval evaluation, agent tool-call guardrails, prompt-injection defenses.
  • Ship agentic features for reviewers: summarizing work trails, flagging gaps, drafting follow-up interview questions.
  • Own model choice, cost, latency and fallback across providers.
  • Keep the product's principles intact: AI advises, humans decide, no biometric signals.Requirements
  • 5+ years in software engineering, including 2+ years shipping LLM-powered features to production.
  • Strong Python and/or TypeScript; experience with LLM APIs, structured outputs, tool calling and RAG.
  • Hands-on experience building evals and judging model quality with data.
  • A product mindset and comfort with startup ambiguity.
  • Clear written communication; able to overlap with US Pacific mornings.Nice to have
  • Experience with hiring/HR tech, assessment design or psychometrics.
  • Background in agent safety, guardrails or red-teaming.
  • Postgres/Supabase or Next.js experience.
  • Open-source or public writing on AI evaluation.Compensation
  • India: competitive, up to 55 LPA (higher for exceptional fit), plus early-employee equity.How to apply

Apply through LinkedIn, or you can also send an email to tanushri@touchstones.ai with your resume, experience, the job you're applying for, and why you think you're qualified.

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior AI Engineer job at Touchstones?

Use the apply link on this page: you apply directly with Touchstones on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Touchstones want for this Senior AI Engineer role?

The job description asks for Python, TypeScript, LLM APIs, structured outputs, tool calling and RAG. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Touchstones?

Apply to the Touchstones roles that match your experience, and tailor your resume to each job description: for this role that means showing Python, TypeScript, LLM APIs. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior AI Engineer job remote or onsite?

This is based in India.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Touchstones, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →