Job Description
Roles & Responsibilities
The consultant will be responsible for:
- Development and maintenance of data transformation pipelines with DBT.
- Manipulation and processing of large volumes of data via BigQuery and advanced SQL.
- Data flow management and integration with Pub/Sub.
- Automation of data workflows via GitLab CI/CD and Docker Compose.
- Development of batch processing for feeding and exporting data streams.
- Deployment of generic GUIs via SQL inserts.
- Developing Bash shell scripts in a Linux environment.
- Use of the internal Carrefour framework (G n pi).
- Collaboration with the Flux team in an Agile environment.
Desired Candidate Profile
Diploma of a Bac+5 in engineering school or equivalent university degree with a specialization in computer science, or demonstrating equivalent significant experience.
Exp rience : 5 7 ans en Data Engineering.
Required skills:
- DBT, SQL avanc , BigQuery, GCP, Pub/Sub, GitLab CI/CD, Docker Compose, PostgreSQL, Linux, Shell Bash, Git, Vim, Agile Scrum.