Develop and enhance the CentML platform for machine learning, focusing on scheduling and performance of ML models across several cloud service providers.
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
Overview:
We are seeking highly motivated and skilled systems engineers to join our team to help in developing the CentML platform that offers a cost effective infrastructure for serving and training large scale machine learning models. As a systems engineer, you will play a crucial role in building a unified solution that brings our innovative in-house technologies such as Hidet compiler, DeepView, and other ML optimizations into a single, cohesive platform. Your expertise will drive the scalability, performance, and reliability of the platform, enabling our customers to seamlessly access and utilize a comprehensive suite of ML services that we offer.
Responsibilities:
- Taking part in the design and development of the CentML platform.
- Designing and building solutions for scheduling large scale ML training and inference workloads on GPU clusters over multiple CSPs.
- Communicate with our product teams and define use cases, and develop methodology & benchmarks to evaluate different approaches.
Qualifications:
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Graduate degree with research experience is a plus.
- Experience building large scale systems from scratch. Prior experience in container-based deployment systems like Kubernetes is a big plus.
- Strong coding skills (in at least one of Python and C++).
- Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc.
Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.
Top Skills
C++
Kubernetes
Python
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Architect and develop a payments platform, mentor engineers, manage project priorities, and collaborate on technical roadmaps to enhance crypto adoption.
Top Skills:
AWSDatabricksDockerGoGrpcKafkaSnowflake
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Staff Software Engineer on the Risk Platform team, you'll architect and develop distributed systems, manage project priorities, mentor team members, and implement foundational infrastructure components to enhance system resilience and mitigate risks.
Top Skills:
DockerGoPostgresRuby on RailsRubySinatra
Big Data • Fintech • Mobile • Payments • Financial Services
The Software Engineer II will develop, design, and implement API and microservice interfaces for merchant data management, enhancing performance and reliability of Affirm's systems.
Top Skills:
ChronosphereElasticsearchKibanaKotlinMySQLPythonRollbarSentry.Io
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
