Data Engineer

Company: Finarb Analytics Consulting Pvt. Ltd.

Job Title: Data Engineer – SQL Server / Azure Data Factory / Microsoft Fabric

Location: Hyderabad or Kolkata, India

Experience: 3–6 Years

Employment Type: Full-Time

Number of Openings: 2

About FinarbFinarb Analytics Consulting is a data, analytics, and technology consulting firm helping organizations transform complex data into actionable business insights through advanced analytics, business intelligence, artificial intelligence, and modern data platforms.

Website: https://www.finarb.ai

About the RoleWe are seeking skilled and motivated Data Engineers to join our growing data engineering team in Hyderabad or Kolkata.

The ideal candidate will have strong hands-on experience with Microsoft SQL Server, T-SQL, Azure Data Factory (ADF), and ETL/ELT development, along with experience maintaining and troubleshooting production data pipelines.

This role will focus on ensuring the stability, reliability, and performance of existing data integration workloads while supporting the organization's transition to Microsoft Fabric.

The successful candidate will work closely with data architects, senior data engineers, BI developers, and data quality teams to maintain existing data infrastructure, resolve production issues, and contribute to modern cloud-based data engineering solutions.

We are looking for engineers who demonstrate strong technical ownership, excellent troubleshooting skills, and the ability to independently investigate and resolve complex data-related challenges.

Key Responsibilities1. Data Pipeline Development and Maintenance

• Design, develop, maintain, and enhance ETL/ELT pipelines using Azure Data Factory.
• Develop and maintain SQL-based data extraction, transformation, and loading processes.
• Build reusable, parameterized, and scalable data integration workflows.
• Implement incremental data loading, scheduling, and dependency management.
• Integrate data from relational databases, cloud storage, APIs, and enterprise applications.
• Monitor pipeline execution and ensure timely, reliable data processing.2. SQL Server Development and Optimization
• Develop and optimize complex T-SQL queries, stored procedures, views, functions, and database objects.
• Work with large datasets and complex relational database structures.
• Analyze query execution plans and resolve SQL performance bottlenecks.
• Optimize indexing strategies, joins, transformations, and data processing logic.
• Investigate database-related failures, data inconsistencies, and performance issues.
• Maintain efficient and reliable data processing across SQL Server environments.3. Production Support and Troubleshooting
• Monitor daily production data pipelines, SQL jobs, and scheduled workloads.
• Investigate and resolve ADF pipeline failures, SQL execution errors, and data processing issues.
• Perform root cause analysis and implement permanent corrective solutions.
• Troubleshoot missing records, duplicate data, incorrect transformations, and data discrepancies.
• Implement appropriate logging, monitoring, error handling, and alerting.
• Ensure production incidents are resolved within agreed service levels.
• Maintain documentation of recurring issues and their resolutions.4. Data Quality and Reconciliation
• Develop and execute SQL-based data validation and reconciliation checks.
• Ensure completeness, consistency, accuracy, and integrity of data across systems.
• Investigate discrepancies between source systems, staging layers, and reporting datasets.
• Collaborate with data quality engineers to establish repeatable validation processes.
• Support data testing during pipeline enhancements, releases, and migrations.
• Implement controls to detect and prevent recurring data quality issues.5. Microsoft Fabric Migration and Integration
• Support the migration of existing SQL Server and Azure Data Factory workloads to Microsoft Fabric.
• Assist in developing and maintaining Fabric Data Factory pipelines, Lakehouse, and Warehouse solutions.
• Work with senior engineers and architects on data ingestion, transformation, and integration activities.
• Support data mapping, migration testing, reconciliation, and validation.
• Troubleshoot migration-related issues and ensure consistency between legacy and target systems.
• Contribute to the development of modern data engineering practices using Microsoft Fabric.6. Engineering Standards and Collaboration
• Follow established coding standards, documentation practices, and development processes.
• Participate in code reviews, testing, deployment, and release management.
• Maintain technical documentation for pipelines, SQL transformations, dependencies, and operational procedures.
• Collaborate with data architects, BI developers, and business stakeholders.
• Identify opportunities to improve pipeline performance, automation, and operational reliability.
• Support continuous improvement of data engineering processes and infrastructure.Required Technical SkillsSkill / TechnologyExpected ProficiencyMicrosoft SQL ServerStrong hands-on experienceT-SQLAdvanced queries, stored procedures, CTEs, window functionsAzure Data FactoryPipeline development, monitoring, debuggingETL / ELTStrong development and troubleshooting experienceData WarehousingDimensional modeling, staging, incremental loadsSQL Performance TuningQuery optimization, indexing, execution plansProduction SupportIncident investigation, root cause analysisData ReconciliationSQL-based validation and troubleshootingAzure CloudFamiliarity with Azure data servicesMicrosoft FabricBasic knowledge or practical exposure

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• 3–6 years of professional experience in data engineering, database development, or ETL development.
• Strong hands-on experience with SQL Server and advanced T-SQL programming.
• Practical experience developing and maintaining Azure Data Factory pipelines.
• Experience troubleshooting production ETL workflows and resolving complex data issues.
• Strong understanding of relational databases, data warehousing, and data integration concepts.
• Experience working with large datasets and performance-sensitive workloads.
• Ability to independently investigate pipeline failures and data discrepancies.
• Good understanding of data validation, reconciliation, and quality assurance.
• Strong analytical, debugging, and problem-solving skills.Preferred / Good-to-Have Skills
• Hands-on exposure to Microsoft Fabric, including Fabric Data Factory, Lakehouse, Warehouse, and OneLake.
• Knowledge of Python and PySpark for data processing and transformation.
• Experience with Azure Data Lake Storage Gen2.
• Familiarity with Delta Lake and modern lakehouse architectures.
• Experience with Azure DevOps, Git, and CI/CD pipelines.
• Knowledge of Azure Key Vault, managed identities, and secure data integration.
• Experience supporting data platform modernization or migration projects.
• Familiarity with Power BI and downstream reporting requirements.
• Microsoft Fabric Data Engineer Associate (DP-700) certification is an advantage.Key Competencies
• Strong technical ownership and accountability.
• Excellent debugging and root cause analysis capabilities.
• Ability to work independently in production environments.
• Strong attention to data accuracy and reliability.
• Effective communication and collaboration skills.
• Ability to balance development work with production support responsibilities.
• Willingness to learn and adopt emerging data technologies.
• Proactive approach to identifying and preventing operational issues.What Success Looks Like
• Stable and reliable execution of daily data pipelines and SQL workloads.
• Timely resolution of production failures and data discrepancies.
• Improved performance and maintainability of existing ETL processes.
• Accurate and consistent data across integrated systems.
• Successful contribution to Microsoft Fabric migration activities.
• Well-documented, reusable, and scalable data engineering solutions.
• Strong collaboration with engineering, architecture, and data quality teams.Why Join Finarb?
• Work on enterprise-scale data engineering and analytics solutions.
• Gain practical exposure to Microsoft Fabric and modern cloud data platforms.
• Participate in data platform modernization and migration initiatives.
• Collaborate with experienced data architects and engineering professionals.
• Develop expertise across SQL Server, Azure, and Microsoft Fabric technologies.
• Work in a technically challenging environment with opportunities for professional growth.Job Location: Hyderabad / Kolkata

Employment: Full-Time

Experience: 3–6 Years

Open Positions: 2

• Company Website: https://www.finarb.ai