Python +AI ML Engineer

Job Description

We are seeking a skilled Python + AI ML Engineer ,Bangalore having 5+ yrs of experience.

About Us

CodeVyasa is a mid-sized product engineering company that works with top-tier product and solutions organizations such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are a team of 550+ engineers, driving innovation across Product & Data Engineering, focusing on Agentic AI, RPA, Full Stack, and GenAI-based solutions.

Must-Have Skills

• Strong hands-on experience with Python
• Strong production experience with Flask and/or FastAPI
• Strong backend development experience with REST APIs, microservices and scalable architectures
• Hands-on experience building AI/LLM workflows and applications
• Experience with LLM integration, prompt engineering and model/API orchestration
• Good understanding of RAG, embeddings, vector databases and retrieval workflows
• Experience integrating LLMs with backend applications and enterprise systems
• Strong understanding of API design, authentication, error handling and performance optimization
• Experience with databases such as PostgreSQL, MySQL or MongoDB
• Good understanding of asynchronous processing, queues and distributed systems

AI/LLM Responsibilities

• Design and develop LLM-powered backend applications and workflows
• Integrate LLM APIs and AI services into production systems
• Build and optimize RAG and retrieval-based workflows
• Develop prompt chains, tool/function calling and AI-driven automation
• Work with vector databases and embedding-based search
• Evaluate and improve LLM response quality, latency and reliability
• Implement appropriate guardrails, monitoring and error handling for AI workflows

Backend Responsibilities

• Build scalable and maintainable backend services using Python + Flask/FastAPI
• Design and develop REST APIs and microservices
• Optimize application performance, database queries and API response times
• Develop integrations with internal and external systems
• Write clean, testable and production-ready code
• Collaborate with AI/ML, frontend and product teams to deliver end-to-end solutions

Good to Have

• Experience with LangChain, LangGraph, LlamaIndex or similar LLM frameworks
• Experience with OpenAI, Azure OpenAI, Anthropic or other LLM APIs
• Exposure to AWS/Azure/GCP
• Experience with Docker and Kubernetes
• Knowledge of Kafka, RabbitMQ or other messaging systems
• Experience with AI agents, tool calling and multi-agent workflows
• Familiarity with LLM evaluation and observability tools

Why Join CodeVyasa?

• Work on innovative, high-impact projects with leading global clients.
• Exposure to modern technologies, scalable systems, and cloud-native architectures.
• Continuous learning and upskilling opportunities through internal and external programs.
• Supportive and collaborative work culture with flexible policies.
• Competitive salary and comprehensive benefits package.
• Free healthcare coverage for employees and dependents.