Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands-on role for someone who enjoys working close to the bare metal systems. Operating large-scale open-source storage, enterprise storage, tuning Linux systems for performance, automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.
Core Responsibilities:
Skills & Experience:
Core Responsibilities:
- Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
- Tune Linux systems for I/O throughput and overall performance
- Automate configuration and deployment using Ansible, Puppet or other automation platform
- Build observability into the platform with Prometheus and related tooling
- Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka
- Familiarity with Kubernetes
Skills & Experience:
- 5+ years of experience in systems engineering with a strong focus on data storage
- Strong Linux fundamentals, debugging skills, including performance tuning for I/O throughput
- Hands-on experience with Ansible and Puppet for configuration management and automation
- Familiarity with open-source, S3 API compliant, and enterprise storage technologies
- Working knowledge of the Hadoop ecosystem, including YARN
- Experience in Java and Python
- Comfort working with AI-assisted development tools such as Claude (e.g., "vibecoding") in an enterprise setting
- Experience with Prometheus-based monitoring and alerting
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
Top Skills:
Alert ManagerAlertaBashDatabricksDockerDremioFlinkGrafanaHadoopHdfsIcebergJavaKafkaKubernetesOpsgeniePrometheusPythonS3SparkSQL
Fintech • Machine Learning • Software • Financial Services
Design and verify next-generation ASICs for latency-sensitive trading systems. Responsibilities include RTL development in SystemVerilog, verification and testing, debugging, integration, tooling and automation, and cross-team collaboration to meet performance and reliability goals.
Top Skills:
AsicBashC++Clock-Domain CrossingDebugging ToolsEthernetFpgaPmaPythonRtlSystemverilogUnit TestingVerification Frameworks
Fintech • Machine Learning • Software • Financial Services
Perform hands-on electronics lab work: validate and bring up circuit boards and ASICs, operate and maintain test equipment and fixtures, manage inventory and lab infrastructure, support manufacturing coordination, assembly, shipping, and documentation to enable hardware production and deployment.
Top Skills:
3D PrinterMultimeterOscilloscopePcb/Circuit BoardsSolderingTest EquipmentTest Fixtures
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
