Data Engineer with QA

Prophecy Technologies
Hyderabad, Telangana, India

🚨 HIRING ALERT | DATA QA / VALIDATION ENGINEER – AZURE & PYTHON

We are looking for an experienced Data QA / Validation Engineer with strong expertise in Python, SQL, PySpark, Azure Data Factory, Azure Synapse, and data validation to support large-scale data processing, reconciliation, automation, and reporting initiatives.

🔹 Role Details

💼 Role: Data QA / Validation Engineer

📍 Location: PAN India

🎯 Experience: 5+ Years

⏳ Notice Period: Immediate to 30 Days Preferred

🔹 Core Skills

✅ Requirement Analysis & Business Rule Validation

✅ Test Planning, Execution & Defect Investigation

✅ Source-to-Target Mapping Validation

✅ Data Completeness & Reconciliation

✅ Schema, Layout & Column Sequence Validation

✅ Python Development & Automation

✅ SQL / SQL Server & Data Analysis

✅ PySpark Notebook Development

✅ Azure Data Factory (ADF)

✅ Azure Synapse Analytics

✅ Azure Storage & Cosmos DB

✅ AWS S3 & Azure-to-AWS File Transfer Validation

✅ Power BI Dashboard & Reporting Validation

🔹 Key Responsibilities

  • Perform source-to-target data validation and reconciliation
  • Validate large-scale datasets across multiple file formats
  • Develop and maintain Python-based validation frameworks
  • Create SQL queries for data analysis and verification
  • Develop PySpark notebooks for data processing and validation
  • Build automated test pipelines using Azure Data Factory
  • Validate source, intermediate, and output data
  • Analyze exception/reject records and identify root causes
  • Monitor production jobs and support issue resolution
  • Validate Power BI dashboards and reporting metrics
  • Collaborate with stakeholders in an Agile delivery environment🔹 Tools & Technologies

Python | SQL Server | PySpark | ADF | Azure Synapse | Azure Cosmos DB | Azure Storage | AWS S3 | Power BI | SSMS | Rally | Excel | Microsoft Copilot

🤖 AI & Automation

Experience with Microsoft Copilot and automation enablement will be an added advantage.

📩 Apply Now

Interested candidates can share their updated resume at:

📧 devakar@prophecytechs.com

Subject: Data QA / Validation Engineer – PAN India

🔄 Immediate to 30 Days Joiners Preferred

Please Like | Share | Tag suitable candidates in your network.

#Hiring #DataQA #DataValidation #DataEngineer #Python #SQL #PySpark #AzureDataFactory #ADF #AzureSynapse #Azure #AWS #PowerBI #DataQuality #ETLTesting #DataEngineering #QAJobs #PANIndiaJobs #ImmediateJoiners #ProphecyTechnologies

Score my resume against this job, free →

Get your ATS score for this role — free. Score my resume free →