Ingestion Engineer

Mars Petcare consists of five Divisions: Pet Nutrition, Royal Canin, Mars Veterinary Health & Diagnostics and Kinship. The Pet Nutrition division is currently embarking on a 3-year Digital Transformation program that aims to digitise Mars irreversibly.

As part of our Pet Nutrition digital-first strategy, our purpose is to establish strong Digital & Data Foundations (DDF) for PN products through transversal foundational technology & data capabilities that enable the creation of scalable fit-for-purpose solutions, deliver superior propositions and fuel an integrated supply chain, with Increased agility and reduced cost. Some of the key deliverables we will look to unlock are: 

• From siloed, small-scale product performance evaluation to a fully integrated, data-driven performance assessment through real-time predictive solutions, maximising capability and reducing evaluation time & cost by building confidence to drive superior propositions across the portfolio. 

• From traditional Innovation and scale-up protocols to innovative digital modelling, which enables rapid scenario evaluation, accelerated development, and scale-up, with increased agility and reduced costs and resources. 

• From dispersed physical quality records to digitalised quality standards, capturing data and trend predictions, which can be leveraged to proactively mitigate emerging risks and avoid non-quality Impacts. 

• From fragmented legacy IT systems holding unreliable data to an integrated R&D and SUPPLY digital & data ecosystem with respective sub-domains to enact step-change operational efficiency and maximise business value by confidently utilising trustworthy data

As an Ingestion Engineer in the DDF team, your key responsibilities are as follows: 

1. Technical Proficiency: 

• Collaborate in hands-on development using Python, PySpark, ADF, and other relevant technologies to ingest data for downstream consumption. 

• Assist in engineering and managing data models and pipelines within a cloud environment, utilising technologies like Databricks, Spark, Delta Lake, and SQL. 

• Contribute to the maintenance and enhancement of our progressive tech stack, which includes Python, PySpark, Logic Apps, Azure Functions, ADLS, Django, and ReactJs.

• Support the implementation of DevOps and CI/CD methodologies to foster agile collaboration and contribute to building robust data solutions.

• Develop code that adheres to high-quality standards, promoting a scalable and maintainable data platform. 

2. Learning and Growth; Contribution to Solutions: 

• Collaborate with the team to learn and apply the best practices in data engineering.

• Actively participate in engineering projects, gaining experience in developing high-quality, scalable, and sustainable data solutions.

• Stay updated with emerging technologies and trends in data engineering, contributing to the team's knowledge base by sharing insights and ideas.

• Assist in the development of data solutions within the Pet Nutrition data platform, working on challenging aspects under the guidance of senior team members.

• Contribute to the management of data from various divisions to generate valuable data assets related to pets and pet owners.

• Support the maintenance of a semantic and intelligent data layer to contribute to the comprehensive leadership of the data solution within the environment. 

3. Collaboration and Communication: 

• Collaborate closely with analysts, data scientists, and team members to understand their requirements and assist in translating them into actionable data solutions.

• Maintain effective communication with the Data Ingestion Lead, actively participating in team discussions and sharing ideas to improve platform excellence.