AI Research Engineer

𝗔𝗯𝗼𝘂𝘁 𝘁𝗵𝗲 𝗷𝗼𝗯

This role is for one of our client companies — a VC-backed Software Development, AI Infrastructure, Automotive, and Telecommunications startup that has raised $2M USD in funding.

𝗦𝗮𝗹𝗮𝗿𝘆: Up to 35LPA

Apply once and, if selected, get access to up to 20 remote and onsite interview opportunities.

🚀 𝗪𝗵𝗮𝘁 𝗪𝗲'𝗿𝗲 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴

CodeRound AI matches the top 5% tech talent with the fastest-growing, VC-funded AI startups across Silicon Valley and India.

Top-tier product startups across the US, UK, EU, UAE, and India have hired top engineers through CodeRound.

🚀 𝗔𝗜 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 (3+ 𝗬𝗲𝗮𝗿𝘀 𝗼𝗳 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲)

We’re seeking an AI Research Engineer to own model evaluations end-to-end, turning ambiguous capabilities into rigorous, reproducible benchmarks. Working closely with researchers, you will design datasets, analyze model behavior at scale, and directly shape the training lifecycle.

🧩 𝗪𝗵𝗮𝘁 𝗬𝗼𝘂'𝗹𝗹 𝗗𝗼

• Design rigorous benchmarks for reasoning, coding, and agentic capabilities across C/C++, Rust, embedded systems, hardware specifications, and engineering tasks.
• Develop deterministic evaluators using compilers, emulators, simulators, static analysis, formal verification, and hardware-in-the-loop systems.
• Build distributed infrastructure to run evaluations reliably against models and live training checkpoints.
• Diagnose regressions and anomalous results, separating model failures from issues in prompts, data, evaluators, or infrastructure.
• Design robust metrics, difficulty curricula, contamination-resistant tasks, and experiments around prompting, sampling, and scaffolding.
• Turn evaluation failures into targeted datasets, reward signals, and new training objectives in collaboration with RL researchers.
• Create dashboards, experiment tracking, and evaluation libraries that make model performance easy to understand and trust.✅ 𝗬𝗼𝘂'𝗿𝗲 𝗮 𝗚𝗿𝗲𝗮𝘁 𝗙𝗶𝘁 𝗜𝗳 𝗬𝗼𝘂
• Strong Python programming and software engineering fundamentals.
• Experience building benchmarks, evaluation systems, automated graders, research infrastructure, or similar testbeds.
• Strong understanding of LLMs and modern evaluation methodologies.
• Strong analytical and experimental thinking; you care deeply about whether a metric actually measures the intended capability.
• Experience debugging complex systems and investigating unexpected experimental results.
• Strong written and verbal communication.✨ 𝗪𝗵𝘆 𝗝𝗼𝗶𝗻 𝗨𝘀?
• Own the development of cutting-edge infrastructure from day one.
• Solve complex engineering challenges that directly shape our product roadmap.
• Accelerate your career alongside elite researchers in a fast-paced environment.
• Work closely with a brilliant, collaborative team of industry pioneers.