Kong Admin

Recro

Bengaluru, Karnataka, India

Work Details

Job Summary

We are looking for a skilled Kong Administrator / AI Gateway Engineer to join Recro's technology team in

Bangalore. The ideal candidate will bring strong hands-on experience in API Gateway management, Kong

administration, and AI/LLM proxy development, along with solid foundations in cloud infrastructure (Azure),

Infrastructure as Code (Terraform), and CI/CD automation. This role will support enterprise-grade API and AI

Gateway solutions, enabling secure, scalable and governed access to multiple LLM providers.

Key Responsibilities

Configure, administer, and support Kong Gateway environments (OSS/Enterprise) including setup,

maintenance and upgrades.

Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
Configure AI-specific policies including prompt logging, content filtering, token controls and guardrails.
Enable secure access to multiple LLM providers (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini,

Mistral, Llama) through a unified gateway architecture.

Develop routing strategies across multiple AI models based on latency, cost and availability, including load

balancing and failover management.

Implement AI observability, token analytics, usage tracking and cost governance.
Integrate RAG-based AI services through secure API management frameworks.
Implement API security, authentication, throttling and governance policies (OAuth2, JWT, OIDC).
Deploy and manage Kong in Kubernetes-based environments using Docker and Helm.
Manage Kong Konnect configurations — routes, services, consumers, catalog, upstreams and API packages.
Provision and manage infrastructure using Terraform, with Azure compute, storage, security and networking.
Automate deployments and operational processes using CI/CD tools (Jenkins / GitHub Actions).
Monitor, troubleshoot and optimize gateway performance using Prometheus, Grafana and ELK/Splunk.
Ensure compliance with enterprise AI governance, security and regulatory requirements.
Establish AI platform standards, reusable AI APIs and best practices for GenAI adoption.
Support AI agent and MCP (Model Context Protocol)-based integrations within enterprise ecosystems.

Must-Have Skills

4+ years of relevant experience in API Management, Middleware or Platform Engineering.
Hands-on experience with Kong Gateway administration (OSS/Enterprise) — setup, maintenance and

upgrades.

Good-to-Have Skills

Ansible for configuration automation.
Exposure to other API gateways such as Apigee, IBM API Connect etc.
AWS and/or GCP (compute, storage, security and network).
Kong Konnect configurations — routes, services, consumers, catalog, upstreams, API packages.
AI Gateway / LLM proxy development and multi-LLM integration.
Vector databases and RAG architecture concepts.
Prompt management, prompt security and guardrails.
LLMOps and AI observability / model performance monitoring.

Technical Skill Areas

Gateway & API ManagementKong Gateway (OSS/Enterprise), Kong Konnect, API Lifecycle Management, REST APIs, GraphQL

AI / LLM AI Gateway, LLM Proxy Development, OpenAI / Azure OpenAI Integration, Multi-LLM Integration, RAG Concepts, Vector Databases

Security OAuth2, JWT, OIDC, API Security, AI Security, Responsible AI, Model Governance

Cloud & Infra Azure (must-have), AWS/GCP (good to have), Kubernetes, Docker, Helm

CI/CD Jenkins, GitHub Actions, Azure DevOps, Terraform, Ansible

Monitoring Prometheus, Grafana, ELK/Splunk, Token Usage Monitoring, Cost Optimization

Experience Requirement

4+ years of total experience in API Management, Middleware, or Platform Engineering, with hands-on Kong

Gateway administration experience. Experience with cloud-native and microservices architectures is preferred.