Job Description
Roles & Responsibilities
The program includes: Data Engineering, real-time streaming, GCP Cloud and pipeline industrialization.
Your responsibilities:
- Design, develop and maintain large-scale data processing solutions
- Participate in the implementation of business projects related to ELT solutions
- Developing and optimizing high-performance Big Data processing
- Participate in the testing, acceptance and validation phases
- Maintain and develop data assets
- Collaborating closely with the development and production teams
- Actively contribute to the continuous improvement of the platforms
Technical stack and environment:
- Java / Scala
- Apache Spark
- Apache Kafka
- Google Cloud Platform (GCP)
- BigQuery / BigTable
- Advanced SQL
- DBT
- Pub/Sub
- GitLab CI/CD
- Docker Compose
- Linux / Git
Desired Candidate Profile
Desired profile:
Master's degree (Bac+5) in computer science or equivalent
Between 3 and 7 years of experience in Java/Scala Data Engineering
Solid experience in Data and Cloud architectures
Excellent command of BigQuery and processing large volumes
Knowledge of real-time environments and data streaming
Experience with Agile/Scrum methodologies