Lead Ai Engineer

Kotech Solutions
Gujarat, India

Job Title: Lead AI Engineer – Core Platform

Location: Ahmedabad, Gujarat

Experience: 4 – 8 Years

Employment Type: Full-time, Permanent

Notice Period: Immediate to 30 days preferred

COMPANY OVERVIEW

We are a technology company specialising in AI evaluation and trust infrastructure, headquartered in Ahmedabad, Gujarat. Our platform enables organisations to assess the reliability, safety and performance of AI-powered applications.

ROLE SUMMARY

We are seeking an experienced Lead AI Engineer to define the technical architecture of our platform and lead the design and development of its core evaluation engine. The role reports directly to senior leadership and carries end-to-end ownership of the platform's architecture and technical direction.

KEY RESPONSIBILITIES

1. Define the end-to-end system architecture, technical roadmap and engineering standards for the platform, covering mobile, web, administration and core services.

2. Prepare and maintain detailed technical documentation, including architecture blueprints, data models and implementation plans for the wider engineering team.

3. Design, develop and maintain a real-time evaluation engine for verifying the behaviour of AI systems against defined criteria.

4. Implement LLM-based evaluation frameworks, including rubric-based scoring, confidence thresholds and human-in-the-loop review workflows.

5. Develop a configuration-driven framework that enables new evaluation scenarios to be deployed without code changes.

6. Implement result classification, de-duplication and auditable scoring mechanisms.

7. Design and implement integrity controls, including fraud detection, anomaly detection and safeguards against manipulation.

8. Integrate the evaluation engine with downstream systems, including payment and reporting services.

9. Establish best practices for testing, observability, security, performance and cloud cost optimisation.

10. Contribute to technical hiring and provide mentorship to engineering team members.

DESIRED COMPETENCIES

Must-Have (Technical):

  • 4–8 years of professional software engineering experience, including a minimum of 2 years building and operating LLM-based applications in production environments.
  • Hands-on experience with LLM evaluation methodologies (LLM-as-a-judge, rubric-based scoring, evaluation datasets) or automated assessment systems (online judges, assessment platforms).
  • Experience implementing agentic workflows and tool/function calling with commercial and open-weight models (e.g. OpenAI, Anthropic, Llama, Mistral).
  • Strong proficiency in Python and/or TypeScript.
  • Strong working knowledge of PostgreSQL, event-driven architectures, message queues and observability tooling.
  • Sound understanding of application security principles and secure system design.
  • Proven experience delivering products from concept to production.

Good-to-Have (Technical):

  • Experience in AI red-teaming, prompt-injection mitigation or application security testing.
  • Participation in Capture The Flag (CTF) competitions or bug bounty programmes.
  • Experience with fraud detection, risk management or trust and safety systems.
  • Familiarity with Supabase, React Native/Expo and cloud platforms (AWS, GCP or Azure).

Behavioural Competencies:

  • Strong analytical and problem-solving skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently and take ownership of outcomes.
  • Working knowledge of Gujarati and/or Hindi will be an added advantage.

EDUCATIONAL QUALIFICATION

B.E. / B.Tech / M.E. / M.Tech / MCA in Computer Science, Information Technology or a related discipline.

COMPENSATION

Competitive and commensurate with experience, with a performance-linked bonus.

SELECTION PROCESS

1. Profile screening

2. Technical discussion

3. Technical design assessment (remunerated)

4. Final discussion with leadership

Score my resume against this job, free →

Questions about this job

How do I apply for the Lead Ai Engineer job at Kotech Solutions?

Use the apply link on this page: you apply directly with Kotech Solutions on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Kotech Solutions want for this Lead Ai Engineer role?

The job description asks for LLM-based applications, LLM evaluation methodologies, automated assessment systems, agentic workflows, Python, TypeScript, PostgreSQL and event-driven architectures. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Kotech Solutions?

Apply to the Kotech Solutions roles that match your experience, and tailor your resume to each job description: for this role that means showing LLM-based applications, LLM evaluation methodologies, automated assessment systems. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Lead Ai Engineer job remote or onsite?

This is based in Gujarat.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Kotech Solutions, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →