Senior Azure Data Engineer | Python | Databricks | Spark | Azure Cloud

Responsibilities:

• Design and build REST APIs, Azure Functions, and event-driven integrations across applications, data platforms, and AI services.
• Develop data processing and transformation logic using Databricks, Spark, Python, and SQL.
• Implement integrations that preserve security context — authentication, authorization, and row-level access — end to end.
• Own solutions through the full lifecycle: design, build, CI/CD deployment, monitoring, and production support.
• Contribute to design reviews, engineering standards, and technical documentation.
• Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.Requirements:
• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
• 4+ years of software engineering in enterprise cloud environments.
• Strong Python and SQL; API design and serverless development on Azure.
• Hands-on experience with Databricks/Spark, ADLS Gen2, and Azure SQL.
• Working knowledge of Entra ID auth, Azure DevOps, Git, and CI/CD.
• Exposure to AI integration patterns (AI Search, RAG, Copilot Studio) preferred.
• Strong verbal and written communication skills, with the ability to explain technical concepts to both engineering and business audiences.
• Ability to work asynchronously across time zones.

Required Technical Skills

• Technical Knowledge:
• Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
• Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
• Experience with Python and Spark.
• Experience with data transformation and orchestration tools such as Azure Data Factory, Databricks, Synapse, Azure Functions, Logic Apps, and others.
• Knowledge of structured, semi-structured and unstructured data sources.
• Teamwork:
• Demonstrates the ability to effectively work in a team environment, align to stakeholders and business objectives.
• Communication:
• Have excellent verbal and written communication skills and demonstrates the ability to effectively work asynchronously across time zones.
• Technical Leadership:
• Demonstrates strong technical leadership through mentoring, guiding a team through technical challenges and ensuring best practices and standards are being followed.