Senior Data Engineer

Excelon Solutions
Bengaluru, Karnataka, India

Senior Data Engineer to build the pipelines that turn raw multimodal capture — audio, egocentric video and sensor streams from 20+ countries — into versioned, quality-checked, client-ready datasets for frontier AI and robotics teams.

Location: Bengaluru, Karnataka, India

  • Employment: full-time, on-site
  • Experience: 5+ years

WHAT YOU WILL DO

Design and build batch and streaming pipelines that ingest raw audio, video and sensor (IMU) data from the global capture network into cloud storage.

  • Build processing stages for unstructured media: transcoding, segmentation, metadata extraction, deduplication and joins with annotation and contributor data.
  • Own data quality: automated validation, QC gates and anomaly detection so that bad captures are caught before they reach a client.
  • Build dataset versioning, lineage and manifests so any delivered dataset can be reproduced exactly.
  • Package and deliver datasets in the formats client teams ask for (Parquet, WebDataset, Hugging Face datasets, MCAP and similar), on time and to specification.

WHAT YOU NEED

5+ years of data engineering, building production pipelines end to end

Strong Python and SQ

  • Distributed processing at scale — Spark, Ray, Beam or Dask
  • Workflow orchestration (Airflow, Dagster or Prefect) and cloud object storage on AWS or GCP
  • Has worked with large unstructured or media data (audio, video, images, sensor logs), not only tabular warehouse data

Score my resume against this job, free →

Questions about this job

How do I apply for the Senior Data Engineer job at Excelon Solutions?

Use the apply link on this page: you apply directly with Excelon Solutions on LinkedIn. Before you do, score your resume against this job description on Fitboard. It shows which skills and keywords the job asks for that your resume doesn't show, so you can fix them first.

What skills does Excelon Solutions want for this Senior Data Engineer role?

The job description asks for Python, SQ, Spark, Ray, Beam, Dask, Airflow and Dagster. Make sure your resume shows the ones you have, in the words the job uses: applicant tracking systems look for them.

How can I get a job at Excelon Solutions?

Apply to the Excelon Solutions roles that match your experience, and tailor your resume to each job description: for this role that means showing Python, SQ, Spark. A resume that matches the job's own keywords is more likely to get past screening. Fitboard scores your resume against this exact job for free.

Is this Senior Data Engineer job remote or onsite?

This is based in Bengaluru, Karnataka.

Is it free to apply? Does Fitboard charge anything?

Applying is free: you apply directly with Excelon Solutions, and this job page and its apply link cost nothing. Checking your resume against this job is free too, with 3 free scans when you sign in and no credit card needed.

Will you get shortlisted for this role? Check your match free →