Job Description
Roles & Responsibilities
Job Description
As a Java Kafka Data Engineer, your main responsibilities will be as follows:
- Design, develop and maintain solutions for processing and managing large datasets on distributed architectures.
- Participate in the implementation of data pipelines using Kafka for real-time data integration and distribution.
- Develop Java applications for streaming and batch data processing.
- Ensure the implementation of processes for optimizing and automating data flows.
- To guarantee the quality, performance and scalability of applications by producing reliable and efficient code.
- Working closely with the Data and DevOps teams to design suitable architectures and optimize system performance.
- Participate in the evolution of the data infrastructure by providing continuous improvements and integrating new technologies.
- Provide support and resolution of technical incidents in production related to data processing.
- Write the technical documentation and specifications for the solutions implemented.
Required skills:
Comp tences techniques :
- Mastery of the Java language and best development practices.
- Solid experience with Kafka (topic management, producers, consumers, Kafka Streams, etc.).
- Knowledge of distributed data architecture concepts.
- Experience with data processing frameworks (e.g., Apache Spark, Flink, etc.) is a plus.
- Ma trise des bases de donn es SQL et NoSQL (ex : PostgreSQL, MongoDB, Cassandra, etc.).
- Knowledge of continuous integration tools and DevOps practices (Docker, Kubernetes, CI/CD).
- Good understanding of distributed systems and the challenges of scalability and high availability.
- Knowledge of big data and cloud computing (AWS, GCP, Azure) would be a plus.
Comp tences non techniques :
- Ability to work in a team and collaborate with different technical profiles (data scientists, devops, etc.).
- Autonomy and rigor in the management of tasks and projects.
- Good analytical skills and ability to solve complex problems.
- A sense of innovation and curiosity for new technologies.
- Excellent communication.
Desired Candidate Profile
Qualifications
Search profile:
- You have a degree from an engineering school or a university degree in computer science, with a specialization in data technologies.
- You have significant experience with a minimum of 3-5 years in Java development and data flow management systems, ideally with Kafka.
- You have already worked in large-scale production environments and are comfortable with performance and scalability issues.