Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.
Core Responsibilities
Skills and Experience:
#LI-DNP
Core Responsibilities
- Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- Collaborate with development teams on data modeling, data ingestion, and capacity planning
- Work with users to ensure data integrity and availability
- Act as a Big Data SME and consult on a variety of data-related questions from users and developers
Skills and Experience:
- 5+ years experience working in a mature data engineering environment
- 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
- 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
- Experience with Apache Spark, Apache Flink or similar tools
- Strong Java, Python, and SQL development skills
- Experience with common data-science toolkits, especially python-based
- Hands-on experience with Kubernetes and Docker
- Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
- Strong statistical analysis skills
- Demonstrated ability to troubleshoot and conduct root-cause analysis
- Unix scripting experience (bash, python, etc.)
#LI-DNP
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
Top Skills:
AnsibleClaudeHadoopJavaKafkaKubernetesLinuxPrometheusPuppetPythonS3S3-Compatible Enterprise StorageYarn
Fintech • Machine Learning • Software • Financial Services
Operate and maintain the Performance Team's data platform: ensure reliability, correctness, and performance of ETLs and pipelines; implement quality checks, alerting, runbooks, and automation; troubleshoot GitLab CI/CD and resource bottlenecks; continuously tune workloads for efficiency.
Top Skills:
Data PipelinesETLGitGitlab Ci/CdPandasPysparkPython
Fintech • Machine Learning • Software • Financial Services
The Data Center Engineer will manage physical servers and network hardware, ensuring their installation, maintenance, and troubleshooting, along with overseeing documentation and vendor coordination.
Top Skills:
BashFiber OpticsLinuxNetwork CablingNetwork DevicesPythonServer HardwareStorage Systems
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
