Senior Data Engineer(Snowflake)
What you’ll do:
You will be working as a Data Engineer within the Healthcare & Lifesciences domain, designing and delivering data pipelines for structured and unstructured data that are running across multiple geographies, helping healthcare organizations achieve their business goals with use of data ingestion technologies & BI solutions. You will be working with Architects from other specialties such as Cloud engineering, Software engineering, ML engineering to create solutions and applications that cater to latest trends in the healthcare industry such as digital diagnosis, software as a medical product, AI marketplace, amongst others.
Role & Responsibilities:
● In-depth knowledge of Snowflake’s data warehousing capabilities.
● Understanding of Snowflake’s virtual warehouse architecture and how to optimize performance and cost.
● Proficiency in using Snowflake’s data sharing and integration features for seamless collaboration.
● Develop and optimize complex SQL scripts, stored procedures, and data transformations.
● Work closely with data analysts, architects, and business teams to understand requirements and deliver reliable data solutions.
● Implement and maintain data models, dimensional modeling for data warehousing, data marts, and star/snowflake schemas to support reporting and analytics.
● Integrate data from various sources including APIs, flat files, relational databases, and cloud
services.
● Ensure data quality, data governance, and compliance standards are met.
● Monitor and troubleshoot performance issues, errors, and pipeline failures in Snowflake and associated tools.
● Participate in code reviews, testing, and deployment of data solutions in development and production environments.
Skills expectation:
● Must have:
o Experience with ETL/ELT tools and techniques, including Snowpipe, AWS Glue, openflow, fivetran or similar tools for real-time and periodic data processing.
o Strong skills in writing SQL queries, stored procedures, user-defined functions and functions in any of the SQL supported databases
o Skills in optimizing SQL queries for performance and efficiency and transforming data within Snowflake using SQL.
o Strong software development skills in Python
o Experience with DBT for database object modeling and provisioning.
o Experience in version control tools, particularly Azure DevOps.
Leadership qualities
o Ability to lead technology teams and provide them mentorship / support to accelerate performance.
o Experience in leading multiple large projects as well as a deep understanding of Agile developments
o Effective communication with all the stakeholders involved.
o Communicate clearly about complex subjects and technical plans with technical and non technical audiences.
Good to have:
o Requirement gathering and understanding of the problem statement
o End-to-end ownership of the entire delivery of the project
o Designing and documentation of the solution
o Team management and mentoring
o Strong understanding of data security, compliance and governance
Behavioural skills:
● Effective communication with all the stakeholders involved
● Need to communicate clearly about complex subjects and technical plans
● Must also have the ability to interact with other members of the team (Juniors, Seniors, ATA, TA, BA, etc) to get their designs from concept to development. Keeping various audiences in mind, engineers must write their reports in clear language accessible to all.
What is in it for you:
● Opportunity to learn cloud native services and how to utilize those services to solve various business problems.
● More hands-on learning opportunity in Python, SQL, etc
● Allocated work will allow you to not only just complete the task but you will be given an opportunity to own-up the work and take responsibility of its end-to-end delivery