The Senior Data Engineer designs, builds, and maintains complex data systems, ensuring efficient processing and accessibility of large datasets for decision-making, while collaborating with multi-functional teams.
Cargill's size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way.
Cargill is a family company providing food, ingredients, agricultural solutions and industrial products that are vital for living. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials - from eggs to edible oils, salt to skincare, feed to alternative fuel. Our 160,000 colleagues, operating in 70 countries, make essential products that touch billions of lives each day. Join us and reach your higher purpose at Cargill.
This position is in Cargill's agricultural supply chain business. We sit at the heart of the supply chain, partnering with farmers and customers to source, make and deliver essential products.
Job Summary
The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
Minimum and Typical Years of Work Experience
Minimum requirement of 4 years of relevant work experience. Typically reflects 5 years or more of relevant experience.
Preferred Experience:
Equal Opportunity Employer, including Disability/Vet.
Cargill is a family company providing food, ingredients, agricultural solutions and industrial products that are vital for living. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials - from eggs to edible oils, salt to skincare, feed to alternative fuel. Our 160,000 colleagues, operating in 70 countries, make essential products that touch billions of lives each day. Join us and reach your higher purpose at Cargill.
This position is in Cargill's agricultural supply chain business. We sit at the heart of the supply chain, partnering with farmers and customers to source, make and deliver essential products.
Job Summary
The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
- DATA INFRASTRUCTURE: Leverage Infrastructure as Code to support the data products.
- DATA FORMATS: Examines and resolves appropriate data formats to improve data usability and accessibility across the organization.
- DATA & ANALYTICAL SOLUTIONS: Develops complex data products and solutions using advanced engineering and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust.
- DATA PIPELINES: Develops and maintains streaming and batch data pipelines that facilitate the seamless ingestion of data from various data sources, transform the data into information and move to data stores like data lake, data warehouse and others.
- DATA SYSTEMS: Reviews existing data systems and architectures to identify areas for improvement and optimization.
- STAKEHOLDER MANAGEMENT: Collaborates with multi-functional data and advanced analytic teams to gain requirements and ensure that data solutions meet the functional and non-functional needs of various partners.
- DATA FRAMEWORKS: Builds complex prototypes to test new concepts and implements data engineering frameworks and architectures that improve data processing capabilities and support advanced analytics initiatives.
- AUTOMATED DEPLOYMENT PIPELINES: Develops automated deployment pipelines improving efficiency of code deployments with fit for purpose governance.
- DATA MODELING: Performs complex data modeling in accordance to the datastore technology to ensure sustainable performance and accessibility.
Minimum and Typical Years of Work Experience
Minimum requirement of 4 years of relevant work experience. Typically reflects 5 years or more of relevant experience.
Preferred Experience:
- Professional previous experience as Software Engineer
- Professional Experience with the following is preferred:
- Python
- Snowflake database
- Advanced SQL/Query tuning
- Terraform
- Docker
- Experience with KNIME Analytics Platform
- Experience with columnar data formats like Parquet or Iceberg
- Previous experience working with large datasets
Equal Opportunity Employer, including Disability/Vet.
Top Skills
Docker
Iceberg
Knime
Parquet
Python
Snowflake
SQL
Terraform
Similar Jobs at Cargill
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
This role manages external market data accuracy and compliance, applies governance policies, and supports internal stakeholders with data management strategies.
Top Skills:
Agile MethodologyFitsJIRAMarket Data Management (Mdm)
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
The Sr. Director of AI & Data Science develops and implements AI solutions, leads teams, drives innovation, and aligns AI initiatives with business goals to deliver measurable outcomes.
Top Skills:
AIAWSCi/CdData ScienceDistributed ComputingMachine Learning
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Lead cloud security initiatives by designing and implementing security solutions for cloud environments, ensuring compliance, and optimizing technology investments.
Top Skills:
AWSAzureCasbCi/CdCiemCnappCspmCwpp
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
