Sr Data Engineer

NAZZTEC

Bengaluru, Karnataka, India

Role: Senior Data EngineerLocation: Bangalore

Experience: 5+ Years

Employment Type: Full-Time

About the Role

We are looking for a Senior Data Engineer to join our team and work across the complete data engineering lifecycle—from concept and development through deployment and operations.

The role involves designing, building, and optimizing cloud-native data pipelines, real-time data processing solutions, APIs, microservices, and modern data platforms using Microsoft Azure, Kubernetes, Docker, Dagster, Apache Iceberg, Python, Java, SQL, and Golang.

This is a hands-on engineering role requiring strong expertise in data engineering, cloud platforms, containerization, DevOps, data architecture, and modern application development.

Key Responsibilities

1. Data Integration & Engineering

Design, develop, and maintain scalable and resilient real-time and batch data pipelines.
Build data ingestion and processing workflows using:
Azure App Service
Azure Functions
Azure Event Hub
Azure Service Bus
Azure Logic Apps
Azure Cosmos DB
Azure SQL
ADLS Gen2
Apache Iceberg
Dagster
Develop APIs and asynchronous data services.
Optimize pipelines, storage, processing performance, scalability, and cloud costs.
Work with diverse data sources and implement reliable data integration solutions.2. Platform Engineering
Containerize applications and workloads using Docker.
Deploy and manage workloads using Kubernetes / AKS.
Create and manage Helm charts.
Implement Infrastructure-as-Code using Terraform.
Implement platform observability through:
Logs
Metrics
Distributed traces
Alerts
Work with monitoring and observability tools such as Grafana, Prometheus, ELK Stack, and Filebeat.
Optimize platform scalability, failover, availability, and resource utilization.
Troubleshoot and resolve production/platform issues to maintain continuous availability.3. Data Modelling & Governance
Design and maintain canonical schemas and dimensional data models.
Manage schema evolution across data producers and consumers.
Implement data lineage, quality checks, SLAs, and data versioning.
Develop automated data validation and reconciliation frameworks.
Ensure data governance and quality across the data platform.
Work with metadata and governance tooling.4. DevOps, CI/CD & Security
Design and manage CI/CD pipelines using:
GitHub Actions
Azure DevOps
Automate application deployment, testing, and operational workflows.
Implement Infrastructure-as-Code using Terraform.
Apply security-by-design principles.
Work with:
Azure Key Vault
OAuth 2.0
API authentication
Encryption at rest and in transit
RBAC / ABAC
Data masking
Secrets management
Ensure compliance with relevant data protection regulations such as GDPR and PDPA.5. Full-Stack Application Development
Develop data-driven web applications, dashboards, and internal platform tools using:
Next.js
React
TypeScript
Build high-performance backend services and APIs using Golang (Go).
Develop RESTful and event-driven microservices.
Implement concurrency patterns and event-driven architectures.
Deploy backend services on Kubernetes.
Implement distributed tracing and telemetry using OpenTelemetry.6. Collaboration & Technical Leadership
Collaborate with Data Engineering, Analytics, Cybersecurity, Product, and ML/AI teams.
Participate in architecture and design reviews.
Conduct code reviews and maintain engineering best practices.
Mentor junior engineers.
Work as a bridge between Data Engineering and ML/AI initiatives.
Communicate effectively with both technical and business stakeholders.

Required Skills & Experience

5+ years of professional Data Engineering experience.
Strong proficiency in:
Python
Java
SQL
Strong experience in:
Data architecture
Data lakes
Data pipelines
Data collection
Data warehousing
Data processing
Data analysis
Data monitoring
Data governance
Hands-on experience with Microsoft Azure, particularly:
Azure App Service
Azure Functions
Azure Event Hub
Azure Service Bus
Azure Logic Apps
Azure Cosmos DB
Azure SQL
ADLS Gen2
Strong experience with:
Docker
Kubernetes / AKS
Helm
Terraform
CI/CD
Knowledge of observability and monitoring tools:
Grafana
Prometheus
Elasticsearch
Logstash
Kibana
Filebeat
Familiarity with Dagster orchestration.
Experience with Apache Iceberg is highly relevant.
Knowledge of data governance, metadata management, data lineage, and data quality frameworks.
Exposure to security practices including:
OAuth 2.0
API authentication
RBAC / ABAC
Secrets management
Encryption
Data masking
Knowledge of GDPR / PDPA or similar data protection regulations.
Hands-on experience with Next.js / React / TypeScript.
Experience developing backend services and APIs using Golang (Go).
Experience with microservices, concurrency, REST APIs, and event-driven architectures.
Experience with OpenTelemetry / distributed tracing is preferred.
Strong communication and stakeholder-management skills.

Educational Qualifications

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline.
Cloud and/or Data Engineering certifications are preferred.Domain Experience – Preferred

Experience in large-scale operational environments such as:

Aviation
Cargo Handling
Ground Handling
Food Solutions
Logistics
Transportation
Supply Chain
Large-scale enterprise operations

Preferred Candidate Profile

We are looking for a hands-on Senior Data Engineer who can work across Data Engineering + Azure Cloud + Kubernetes + DevOps + Backend Engineering + modern data applications.

The ideal candidate should be comfortable working in an environment involving real-time data, cloud-native architectures, APIs, microservices, data platforms, observability, and ML/AI integration.

Personal Characteristics

Strong analytical and problem-solving skills
Engineering and solution-oriented mindset
Comfortable working in ambiguous and fast-changing environments
Strong ownership and accountability
Excellent communication skills
Ability to collaborate across technical and business teams
Strong learning and mentoring mindset

#Hiring #NowHiring #SeniorDataEngineer #DataEngineer #DataEngineering #AzureDataEngineer #Azure #MicrosoftAzure #AzureCloud #AzureData #AzureFunctions #AzureAppService #AzureEventHub #AzureServiceBus #AzureCosmosDB #AzureSQL #ADLS #ADLSGen2 #ApacheIceberg #Dagster #Python #Java #SQL #DataArchitecture #DataPipelines #DataLake #DataEngineeringJobs #CloudDataEngineering #CloudNative #Docker #Kubernetes #KubernetesJobs #AKS #Helm #Terraform #InfrastructureAsCode #IaC #DevOps #DevOpsJobs #CICD #GitHubActions #AzureDevOps #Grafana #Prometheus #ELK #Elasticsearch #Logstash #Kibana #Filebeat #Observability #DataGovernance #DataQuality #DataLineage #MetadataManagement #DataSecurity #AzureKeyVault #OAuth2 #RBAC #ABAC #GDPR #PDPA #NextJS #ReactJS #TypeScript #Golang #GoLang #GoDeveloper #BackendEngineering #Microservices #RESTAPI #EventDrivenArchitecture #OpenTelemetry #DistributedTracing #MLOps #AIEngineering #MLAI #DataPlatform #SoftwareEngineering #TechHiring #ITJobs #TechJobs #BangaloreJobs #BangaloreHiring #BengaluruJobs #BengaluruHiring #IndiaJobs #HiringInBangalore #JobsInBangalore

Score my resume against this job, free →