Confluent Kafka & Apache Flink Developer | Noida | Onsite | 8+ YOE | Contract: 12 Months | Immediate Joiner

Codians.ai
Noida, Uttar Pradesh, India

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲: 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗞𝗮𝗳𝗸𝗮 & 𝗔𝗽𝗮𝗰𝗵𝗲 𝗙𝗹𝗶𝗻𝗸 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿

𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲: 𝟴+ 𝗬𝗲𝗮𝗿𝘀

𝗖𝗼𝗻𝘁𝗿𝗮𝗰𝘁 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻: 𝟭𝟮 𝗠𝗼𝗻𝘁𝗵𝘀

𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: 𝗡𝗼𝗶𝗱𝗮, 𝗨𝘁𝘁𝗮𝗿 𝗣𝗿𝗮𝗱𝗲𝘀𝗵

𝗪𝗼𝗿𝗸 𝗠𝗼𝗱𝗲: 𝗢𝗻𝘀𝗶𝘁𝗲

𝗡𝘂𝗺𝗯𝗲𝗿 𝗼𝗳 𝗣𝗼𝘀𝗶𝘁𝗶𝗼𝗻𝘀: 𝟭

𝗝𝗼𝗯 𝗦𝘂𝗺𝗺𝗮𝗿𝘆

We are looking for an experienced Confluent Kafka Developer with strong expertise in Java, Apache Kafka, Confluent Platform, and custom Kafka Connect plugin development. The ideal candidate will be responsible for designing, developing, and maintaining scalable, reliable, and high-performance data streaming solutions.

The candidate should have expert-level Java programming skills, hands-on experience with Confluent Kafka and custom connector development, and knowledge of KSQL or ksqlDB. Experience with Apache Flink and real-time stream processing will be an added advantage.

𝗞𝗲𝘆 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀

  • Design, develop, and maintain real-time data streaming applications using Apache Kafka and Confluent Platform.
  • Develop robust, scalable, and high-performance Java-based applications and services.
  • Design and implement custom Confluent Kafka Connect plugins, including source and sink connectors.
  • Build integrations between Kafka and external systems such as databases, APIs, enterprise applications, and data platforms.
  • Configure and manage Kafka topics, partitions, consumer groups, offsets, and message-processing workflows.
  • Develop real-time data transformations and streaming queries using KSQL or ksqlDB.
  • Implement error handling, retries, dead-letter queues, and fault-tolerance mechanisms for reliable data processing.
  • Optimize application performance, throughput, latency, resource utilization, and message-processing efficiency.
  • Work with Schema Registry and serialization formats such as Avro, JSON Schema, and Protobuf.
  • Troubleshoot and resolve issues related to Kafka connectivity, connector failures, data consistency, and streaming pipelines.
  • Write clean, maintainable, reusable, and testable code following established engineering standards.
  • Collaborate with architects, technical leads, QA engineers, and DevOps teams to deliver reliable solutions.
  • Participate in code reviews, unit testing, integration testing, deployment, and production support.
  • Work with Apache Flink for stream-processing requirements, where applicable.

𝗥𝗲𝗾𝘂𝗶𝗿𝗲𝗱 𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗦𝗸𝗶𝗹𝗹𝘀

  • Overall Experience: 8+ years of software development experience, preferably in Java development and data engineering.
  • Java: Expert-level proficiency in Core Java, object-oriented programming, collections, concurrency, multithreading, exception handling, and performance optimization.
  • Confluent Kafka: Strong hands-on experience with Apache Kafka and Confluent Platform.
  • Custom Kafka Connect Plugin Development: Experience developing, configuring, testing, and deploying custom Kafka Connect source and sink connectors.
  • KSQL / ksqlDB: Experience writing streaming queries, performing data transformations, filtering events, and processing streaming data.
  • Kafka Fundamentals: Strong understanding of producers, consumers, brokers, topics, partitions, consumer groups, offsets, and delivery semantics.
  • REST APIs & Integration: Experience integrating streaming applications with external systems and enterprise services.
  • Data Serialization: Knowledge of Avro, JSON, Protobuf, and Confluent Schema Registry.
  • Testing & Debugging: Experience with unit testing, integration testing, troubleshooting, and production issue resolution.
  • Version Control: Familiarity with Git and collaborative development workflows.
  • 𝗚𝗼𝗼𝗱-𝘁𝗼-𝗛𝗮𝘃𝗲 𝗦𝗸𝗶𝗹𝗹𝘀
  • Hands-on experience with Apache Flink for real-time stream processing.
  • Understanding of stateful stream processing, event-time processing, windowing, checkpointing, and fault tolerance in Flink.
  • Experience with Kafka Streams or other stream-processing frameworks.
  • Exposure to Docker, Kubernetes, CI/CD pipelines, and automated deployments.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Knowledge of monitoring and observability tools for distributed applications.
  • Experience working with relational and NoSQL databases.
  • Preferred Candidate Profile
  • Strong analytical and problem-solving skills.
  • Ability to work independently on complex development and integration tasks.
  • Good communication and collaboration skills.
  • Ability to troubleshoot production issues and deliver solutions within agreed timelines.
  • Strong focus on code quality, system reliability, and performance optimization.

𝗘𝗻𝗴𝗮𝗴𝗲𝗺𝗲𝗻𝘁 𝗗𝗲𝘁𝗮𝗶𝗹𝘀

𝗣𝗼𝘀𝗶𝘁𝗶𝗼𝗻: 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗞𝗮𝗳𝗸𝗮 & 𝗔𝗽𝗮𝗰𝗵𝗲 𝗙𝗹𝗶𝗻𝗸 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗿

𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲: 𝟴+ 𝗬𝗲𝗮𝗿𝘀

𝗢𝗽𝗲𝗻𝗶𝗻𝗴𝘀: 𝟭

𝗖𝗼𝗻𝘁𝗿𝗮𝗰𝘁 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻: 𝟭𝟮 𝗠𝗼𝗻𝘁𝗵𝘀

𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: 𝗡𝗼𝗶𝗱𝗮, 𝗨𝘁𝘁𝗮𝗿 𝗣𝗿𝗮𝗱𝗲𝘀𝗵

𝗪𝗼𝗿𝗸 𝗠𝗼𝗱𝗲: 𝗢𝗻𝘀𝗶𝘁𝗲

  • Interested candidates with expert-level Java skills, strong Confluent Kafka expertise, and hands-on experience in custom Kafka Connect plugin development are encouraged to apply. Apache Flink experience will be an added advantage.

Score my resume against this job, free →

Will you get shortlisted for this role? Check your match free →