• The Big Data Tech Lead is a pivotal role responsible for orchestrating and leading the development and implementation of the company's big data solutions. This role involves not only hands-on technical expertise but also leadership and guidance to ensure that the big data infrastructure meets the business objectives efficiently and effectively.

  
  

  Responsibilities:

  
  
• Lead the design, architecture, and development of scalable and robust big data solutions to meet business requirements.
• Mentor and guide a team of data engineers, providing technical leadership, and fostering a culture of innovation and excellence.
• Collaborate with cross-functional teams including data scientists, business analysts, and software engineers to understand data needs and drive the development of data solutions.
• Define and enforce best practices for data engineering, including data acquisition, storage, processing, and provisioning.
• Oversee the implementation of data pipelines, ensuring efficiency, reliability, and scalability.
• Evaluate and recommend appropriate big data technologies, tools, and frameworks to optimize performance and cost-effectiveness.
• Stay updated with emerging trends and advancements in big data technologies, incorporating them into the company's data architecture where relevant.
• Lead efforts to ensure data quality, security, and compliance with regulatory requirements.
• Collaborate with infrastructure and operations teams to deploy and maintain big data infrastructure in on-premises and cloud environments.
• Provide technical leadership in troubleshooting and resolving complex technical issues related to data processing, storage, and access.

Requirements:

• Minimum of 7 years of experience in data engineering or related roles, with at least 2 years in a leadership or senior technical position.
• Proven track record of designing and implementing large-scale big data solutions, including data pipelines, storage systems, and processing frameworks.
• Expertise in big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, etc., and proficiency in associated programming languages (e.g., Java, Scala, Python).
• Strong understanding of distributed computing principles and architectures, as well as experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
• Deep knowledge of data modeling, database design, and optimization techniques, including both relational and NoSQL databases.
• Excellent leadership, communication, and collaboration skills, with the ability to work effectively across teams and influence technical decisions.

--

Novancy One, a leader in staffing and recruitment for information systems and digital transformation, is committed to equality and diversity in our hiring process. We welcome applications from candidates of all backgrounds, ensuring equal opportunities regardless of race, color, religion, gender, sexual orientation, national origin, disability, age, or veteran status. Feel you've been overlooked? Let us know at [Click to show email]. Explore our current job openings at https://novancy.com/jobs/ or submit your resume for future opportunities at https://novancy.com/cv.