AI Data Engineer

Quess Singapore
India

Remote role (Work from home)

Singapore client

Offshore role

Working hours and public holidays as per Singapore

Key Responsibilities

  • Design, develop and deploy autonomous AI agents to execute multi-step data engineering tasks, including data ingestion, transformation, validation and remediation.
  • Build multi-agent architectures where specialised agents collaborate on data quality, schema evolution, pipeline optimisation and workflow automation.
  • Develop agentic Retrieval-Augmented Generation (RAG) solutions to retrieve and analyse enterprise data, answer business queries and generate reports.
  • Build AI agents that interact with AWS services such as Glue, Redshift, Athena, S3 and Lambda to diagnose pipeline failures, optimise queries and support infrastructure operations.
  • Implement agent orchestration using LangChain, LangGraph, CrewAI, AutoGen or AWS Bedrock Agents.
  • Develop self-healing data pipelines that detect anomalies, identify root causes and initiate corrective actions.
  • Build intelligent data governance agents to manage metadata, classify sensitive information, enforce data quality standards and support IFRS17 compliance.
  • Develop conversational data agents that enable business users to query data and generate insights using natural language.
  • Implement agent memory and knowledge management solutions using vector databases, knowledge graphs and persistent context stores.
  • Establish human-in-the-loop controls for high-impact decisions, including approval workflows, escalation mechanisms and uncertainty handling.
  • Develop evaluation and observability frameworks to monitor agent accuracy, task completion, cost efficiency and hallucination risks.
  • Implement appropriate guardrails and security controls to ensure safe, auditable and reliable agent execution.
  • Leverage AWS Kiro to accelerate AI-assisted development and data pipeline engineering.

Mandatory Requirements

  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science or a related discipline.
  • Minimum 5 years of experience in data engineering, including ETL development, data modelling and data architecture on AWS.
  • Minimum 3 years of hands-on AWS experience, including AWS Glue with PySpark, S3, RDS PostgreSQL, Redshift, Athena and Airflow.
  • Minimum 2 years of hands-on experience developing LLM-powered applications and AI agents.
  • Strong Python programming skills and practical experience with agentic AI frameworks such as LangChain, LangGraph, CrewAI, AutoGen or AWS Bedrock Agents.
  • Experience designing multi-agent systems with tool use, planning, memory and coordinated task execution.
  • Hands-on experience with prompt engineering, function calling and structured LLM outputs using models such as Claude, GPT-4, Llama or Amazon Titan.
  • Experience building RAG pipelines, including embeddings, vector databases such as OpenSearch, Pinecone or pgvector, chunking strategies and retrieval optimisation.
  • Strong understanding of agent design patterns, including ReAct, Plan-and-Execute, Reflection, Tool Use and Multi-Agent Collaboration.
  • Experience with AWS AI and orchestration services, including Amazon Bedrock, SageMaker, Lambda and Step Functions.
  • Practical experience using AWS Kiro for data pipeline development.
  • Experience with Model Context Protocol (MCP) to connect AI agents with enterprise tools and data sources.
  • Strong SQL skills, including complex query development, data analysis and optimisation.

Good to Have

  • Knowledge of the insurance industry and insurance data processes.
  • Functional understanding of IFRS17 requirements.
  • Experience with agent evaluation, tracing and monitoring tools such as LangSmith, Weights & Biases or custom observability frameworks.

EA License Number: 23C2060 Registration ID is R22109715

Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)

This is in partnership with the Employment and Employability Institute Pte

Ltd (“e2i”).e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to Quesscorp Singapore’s PDPA and e2i’s PDPA

Score my resume against this job, free →

Will you get shortlisted for this role? Check your match free →