Pyspark Developer
Tata Consultancy Services
Bengaluru, Karnataka, India
About the Role
PySpark and Spark SQL Working with Dataframes using different APIs Spark Functions Advanced Data transformations Good knowledge in SQL Applying UDFS Error handling, logging and monitoring Unix, Scheduling Tool Performance Tuning & Generic process development
Must have 5-10 Years of experience
Location: Bengaluru, Pune, Hyderabad, Kolkata, Chennai
Responsibilities
- PySpark and Spark SQL
- Working with Dataframes using different APIs
- Spark Functions
- Advanced Data transformations
- Good knowledge in SQL
- Applying UDFS
- Error handling, logging and monitoring
- Unix, Scheduling Tool
- Performance Tuning & Generic process development
- Banking Domain Knowledge