PySpark Developer
Tata Consultancy Services
Hyderabad, Telangana, India
PySpark Developer
Location: Chennai / Hyderabad / Kolkata
Experience: 6–8 Years
Notice Period: Immediate to 90 Days
Key Skills:
- Strong hands-on experience in PySpark
- Expertise in Apache Spark and Big Data processing
- Experience with Python programming
- Good understanding of Data Engineering concepts
- Exposure to Hive, Hadoop, SQL
- Knowledge of cloud platforms (Azure/AWS) is a plus
- Experience in ETL pipeline development and optimization
Responsibilities:
- Design, develop, and optimize PySpark-based data pipelines
- Process large-scale datasets efficiently
- Collaborate with data architects, analysts, and business teams
- Ensure data quality, performance, and scalability
- Troubleshoot and enhance existing Spark applications