Job Description

Roles & Responsibilities

Job Description

Within the Technology Department, the BI/Data team manages and executes Business Intelligence and Data Engineering projects, ensuring the quality, performance and scalability of the solutions.

You will play a key role in the design, optimization, and monitoring of our data pipelines. You will contribute your Databricks expertise to improve the architecture, performance, and reliability of our data flows for internal clients.

Main tasks:

As a Databricks expert, you will be involved in the main aspects of designing, optimizing, and developing the data platform:

• Design, develop and optimize data processing and transformation pipelines on Azure Databricks and Azure Data Lake .

• Define and implement robust and scalable data architectures to support the growth of data volumes.

• Implement automated tests and guarantee the quality and reliability of data pipelines.

• Participate in the definition and optimization of CI/CD pipelines via Azure DevOps .

• Apply best practices in Data Engineering and software engineering at all stages of development.

• Collaborating with Data Product Owners and business teams to propose innovative solutions tailored to needs.

• Supervise data processing and ensure monitoring via Datadog or equivalent tools.

• Identify and implement optimizations to improve performance and reduce costs on Databricks.

Main technical environment:

• Languages : SQL, PySpark, Python, Scala.
• Tools & BI : ​​Power BI, SSIS, SSAS, Business Objects, Datadog, Snyk.
• Cloud & Data : Azure Databricks, Azure Data Factory, ADLS Gen2.
• CI/CD & DevOps : Git, Azure DevOps.

Desired Candidate Profile

Qualifications

Your strengths to make a difference:

• Master's degree (Bac+5) in computer science, engineering or equivalent field.
• Minimum 5 years of experience in Data Engineering, Data Architecture or Databricks , with experience in leading teams or projects.
• Advanced mastery of several languages: Python, PySpark, Scala, SQL .
• Proven expertise in the development and optimization of Databricks pipelines , with the ability to define technical standards and best practices.
• Mastering Spark UI to diagnose and improve the performance of complex treatments.
• Very good knowledge of the Azure Cloud ecosystem and its data-oriented services (ADF, ADLS, Databricks).
• Experience in implementing good development practices: clean code, versioning, unit testing, CI/CD , and BI modeling principles.
• Advanced practice of dbt or similar frameworks for SQL transformation and data orchestration.
• Experience working in Agile methodology , in collaboration with Product Owners, Data and project teams.
• Leadership and team spirit : able to guide and coach team members, make strategic decisions and propose innovative solutions.
• Ability to adapt quickly in a constantly evolving technical environment and proactive in suggesting improvements to architecture and processes.