Lead Software Engineer

Job Requirements

JP - UHGJP00126453

Role - Data Engineer

Number of RRIDs required - 5

JD - Description

Please list the required skills and attributes for this role, including expected years of experience where applicable.

Core Data Engineering: 5+ years of experience designing, building, and optimizing robust, scalable data pipelines

Programming Languages: 4+ years of strong production-grade coding experience in Python and advanced proficiency writing complex, optimized SQL queries

Big Data Technologies: 3+ years of experience working with distributed computing frameworks such as Apache Spark (or PySpark).

Data Warehousing Architecture: Advanced proficiency in cloud data platforms (such as Snowflake, Google BigQuery, or AWS Redshift) and building optimized dimensional models

Problem-Solving Data Quality: Proven track record of implementing rigorous data validation data cleansing, and error-handling frameworks

Please list the preferred skills and attributes for this role, including expected years of experience where applicable.

Cloud Infrastructure: 2+ years of hands-on experience with cloud platforms particularly with managed data services and serverless computing

Orchestration Tools: Experience managing and monitoring complex workflows using tools like Apache Airflow, Prefect, or dbt.

CI/CD & DevOps: Experience deploying pipelines via CI/CD frameworks and infrastructure-as-code

Streaming Architecture: Familiarity with real-time data streaming technologies such as Apache Kafka or AWS Kinesis is a strong plus.

Primary Responsibilities

Pipeline Development Design build and maintain automated scalable ETL/ELT pipelines ingesting high-volume data from disparate sources.

Data Modeling Optimization: Build clean relational and dimensional data models supporting self-service analytics and BI workloads.

Performance Tuning: Monitor troubleshoot and optimize data workflows and queries for speed, cost-efficiency, and reliability.

Collaboration Integration: Partner with analysts data scientists and business teams to translate requirements into structured datasets.

Preferred Experience Domain

Prior experience in enterprise software or high-growth technology environments

Strong grasp of data value chain models, cross-functional mapping, and Agile delivery

Required AI Skills Maintain 90%+ weekly usage of approved GenAI tools to boost coding documentation, and analysis workflows

Work Experience

5-7Years