GCP Data Engineer
Tata Consultancy Services
Bengaluru, Karnataka, India
Job description
Job Description
Role: Google Data Engineer
Experience: 6-10 Years
Location: Chennai, Bengaluru, Hyderabad, Pune, Kochi, Kolkata, NCR, Delhi
Virtual Interview: 10th Oct
Required Technical Skill Set:
SQL + GCP (BigQuery, Pub/Sub, Dataflow, Composer DAGs, Airflow)
Key Requirements:
- Experience in BigQuery, Pub/Sub, Dataflow, Composer DAGs, and Airflow.
- Strong SQL knowledge with the ability to translate complex business scenarios into efficient queries.
- Experience in data modeling and data mapping.
- Hands-on experience with Google Cloud SDK and API scripting.
- Strong programming experience in Python.
- Experience working in Agile processes and DevOps methodologies.
- Retail domain experience will be an added advantage.Responsibilities:
- Create and maintain optimal data pipeline architecture, replicating existing processes.
- Analyze, explore, and select appropriate tools for data migration and transformation.
- Assemble large, complex datasets that meet functional and non-functional business requirements.
- Ensure data security through masking and encryption techniques.
- Work with data and analytics experts to improve data system functionality.
- Identify, design, and implement process improvements by automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
Note: Please apply only if your experience and skill set align with the requirements mentioned above.
We are not looking for immediate joiners. We are specifically seeking candidates who have a 90-day notice period.