ML Engineer (Model Distillation/Knowledge Distillation)

Location: Noida or Bengaluru

About the Role

We believe small, well-distilled models can match much larger systems at a fraction of the cost — and that belief is only as good as the distillation pipeline behind it. As a Distillation Engineer, you'll build and run that pipeline.

What You'll Do

• Design and run teacher-student distillation pipelines to produce small, efficient models
• Implement quantization-aware training and model compression techniques
• Manage student-model refresh cycles as teacher models and training data improve
• Evaluate distilled-model quality against both public benchmarks and real production tasks
• Collaborate with our evaluation and data teams on synthetic data generation for distillation

What You'll Bring

• 5+ years of relevant experience in machine learning engineering or applied research
• Hands-on experience with knowledge distillation and teacher-student training
• Experience with quantization-aware training and model compression techniques
• Proficiency in PyTorch and Python
• Comfort iterating quickly on model quality tradeoffs under compute constraints

Education

• Master's or PhD in Machine Learning, Computer Science, or a related quantitative field.

Nice to Have

• A master's or PhD in Machine Learning, ideally with a publication record in model compression or efficient inference
• Experience building small, production-quality language models