Caterpillar Logo

Caterpillar

Data Engineer - Physical AI Platform

Reposted 7 Days Ago
Hybrid
Chicago, IL
98K-158K Annually
Mid level
Hybrid
Chicago, IL
98K-158K Annually
Mid level
Design, build, optimize, and maintain scalable real-time and batch data pipelines, microservices, and cloud-based ingestion systems. Develop AWS-based data workflows, integrate APIs and databases, implement automated testing and validation, and monitor distributed systems for reliability and data quality. Translate business requirements into scalable system designs while supporting CI Autonomy and collaborating in an agile environment.
The summary above was generated by AI
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Help Build the Future of Caterpillar -
At Caterpillar, technology always has a purpose, which is to solve our customers' toughest challenges. Through Cat Technology, we are solving problems by building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world-on real jobsites, at global scale.
You'll build and deploy against one of the most unique data foundations-over 1.6 million connected assets generating real-world data daily. These data and platform capabilities are enabling the development of AI models, edge computing architectures, and software systems that scale across fleets, products, and industries. The result will be a new generation of machines that continuously learn, improve, and deliver performance at scale.
Be Part of What's Next in Autonomous Construction Sites
Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible-intelligent machines operating in dynamic jobsites-into reality.
Our connected ecosystem brings together massive volumes of high-quality data to create a foundation where engineers like you can build and deploy against.
If this work motivates you, we invite you to join our team. In these roles, you'll work at the intersection of the physical and digital worlds. You'll help design and deliver intelligent systems that enable machines to perceive their environment, make informed decisions, and support safer, more productive operations.
Apply today to build the new era of construction autonomy at Caterpillar.
Job Summary
As a Data Engineer, you will actively participate in designing, building, and maintaining scalable data pipelines, microservices, and cloud-based data systems in an agile development environment, with a focus on performance, reliability, and data quality.
What You Will Do:
  • Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
  • Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
  • Translate business requirements into reliable data workflows, mappings, and system designs
  • Implement automated testing and validation to ensure data integrity across distributed systems
  • Monitor and troubleshoot pipelines using tools like CloudWatch to maintain reliability

What You Will Have:
  • Decision Making and Critical Thinking: Ability to analyze issues in distributed data systems and deliver scalable solutions
  • Effective Communication: Ability to document data flows, mappings, and system behavior clearly for cross-team use
  • Software Development: Experience building backend systems and pipelines using Python, Java, and modern frameworks
  • Software Development Life Cycle: Experience delivering solutions in an agile environment
  • Software Integration Engineering: Experience integrating APIs, streaming platforms, and databases
  • Software Product Design/Architecture: Ability to design scalable, event-driven data systems
  • Software Product Technical Knowledge: Strong understanding of AWS services and data engineering tools
  • Software Product Testing: Experience implementing testing strategies to ensure data quality and system reliability

Top Candidates Will Have:
  • Bachelor's degree in Computer Science, Computer Engineering, or related field
  • 2+ years development experience on modern, large scale, complex data platforms
  • 3+ years developing and deploying Java or Python solutions to a production environment
  • Experience building high-throughput, scalable data pipelines
  • Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
  • Proficiency in SQL, including data quality and validation practices
  • Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
  • Experience developing microservices that support real-time data ingestion
  • Experience developing software applications using relational and noSQL databases
  • Ability to ensure data integrity across distributed and streaming systems
  • Experience with API development and secure integrations (OAuth 2.0)
  • Proven experience with monitoring, testing, and automation in large-scale data environments

Additional Details:
  • This position requires the candidate to work full-time at the Chicago, IL office
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available with this position.

Summary Pay Range:
$97,530.00 - $158,480.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Relocation is available for this position.
Visa sponsorship is available for eligible applicants.
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Similar Jobs at Caterpillar

Yesterday
Hybrid
89K-145K Annually
Junior
89K-145K Annually
Junior
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Performs data gathering, mining, processing, modeling, and customer analytics on large datasets. Applies NLP, text analysis, machine learning, and statistical methods to identify customer needs and generate business insights. Develops and optimizes algorithms, presents findings to management through data visualization, and supports requirements analysis and data-driven decision-making. The role also involves AI agent development, cloud technologies, version control, and Agile collaboration.
Top Skills: AgileAmazon BedrockAWSData VisualizationDatabase SystemsGitGithub CopilotGCPLangchainMachine LearningAzureNatural Language ProcessingNumpyPandasPythonScipy
Yesterday
Hybrid
98K-158K Annually
Entry level
98K-158K Annually
Entry level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Develops Python data pipelines and business data objects for applications. Designs, implements, tests, and deploys software and CI/CD pipelines, performs source-to-target mapping, resolves complex technical issues, and promotes software quality practices. The role requires collaboration across functional teams, independent execution of complex assignments, and experience with cloud platforms, Snowflake, version control, and AI coding tools.
Top Skills: Amazon CloudwatchAmazon DynamodbAmazon EventbridgeAmazon KinesisAmazon RdsAmazon S3Amazon SagemakerAws CloudformationAws FargateAws IamAws LambdaAzure DevopsCi/CdClaude CodeGitGithub ActionsGithub CopilotJenkinsPythonSnowflake
Yesterday
Hybrid
159K-259K Annually
Expert/Leader
159K-259K Annually
Expert/Leader
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Leads enterprise marketing technology architecture and multi-year roadmaps across content, digital experience, PIM, commerce, analytics, personalization, identity, and omnichannel platforms. Designs application, data, integration, and infrastructure architectures; guides platform strategy, governance, security, privacy, and lifecycle management. Partners with marketing, product, data, security, and engineering teams, evaluates technologies, leads architecture reviews, resolves complex design issues, directs delivery partners, and mentors technical talent while aligning investments to measurable business outcomes.
Top Skills: Adobe AnalyticsAdobe Creative CloudAdobe Dynamic MediaAdobe Experience CloudAdobe Experience ManagerAdobe Experience PlatformAdobe Journey OptimizerAdobe TargetAdobe WorkfrontAkeneo PimAWSAzureCatdvCi/CdContentfulDitaGoogle AnalyticsInformatica PimNext.JsOauthOidcReactReal-Time CdpRest ApisSAMLScene7Serverless ComputingUniformWebhooks

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account