Senior Data Engineer
Antal International
Bengaluru, Karnataka, India
Looking for a Senior Data Engineer with 4+ years of experience to build and scale data pipelines powering AI training datasets.
Key requirements:
- Strong Python & SQL
- Hands-on AWS – S3, Athena, Glue, DynamoDB, Lake Formation
- Airflow / workflow orchestration
- Apache Hudi or Delta Lake
- Strong experience with large-scale audio/video or multimodal data pipelines
- Understanding of GPU workloads, WebDataset / Parquet / sharded data
- Experience with data ingestion, processing and quality validation
This is a great opportunity for someone who enjoys working at the intersection of Data Engineering, AI infrastructure and multimodal data.