The role involves designing, architecting, and managing a multi-tenant Red Hat OpenShift cluster on bare metal and migrating workloads from on-prem and Azure environments while ensuring security and performance for AI workloads.
Role Overview
We are building a high-performance, multi-tenant OpenShift cluster on bare metal in our AI-optimized data center. Our goal is to offer OpenShift as a Service to private AI-focused clients who wish to host their compute-intensive workloads in a scalable, secure, and isolated environment.
We’re looking for a hands-on Red Hat OpenShift Engineer who can design, architect, and implement this platform from scratch using industry best practices. Once the cluster is built, this role will also lead the migration of existing on-prem and Azure workloads to the new OpenShift environment.
Key Responsibilities
- Design, architect, and build a multi-tenant OpenShift cluster on bare metal
- Configure and maintain all aspects of the OpenShift platform for high availability, scalability, and security
- Define and implement networking, storage, ingress, monitoring, and logging
- Develop detailed architecture documents, blueprints, and SOPs
- Lead and execute migration of existing workloads from on-premise and Azure environments to OpenShift
- Ensure smooth onboarding for multiple AI-focused client tenants with isolated environments
- Support DevOps team with advanced Linux/OpenShift troubleshooting
- Implement and enforce RBAC, tenant isolation, resource quotas, and compliance controls
- Optimize performance for AI-heavy workloads running on GPU-enabled infrastructure
- Own operational stability, platform upgrades, and monitoring
Required Skills & Experience
- 5+ years of deep hands-on experience with Red Hat OpenShift and Kubernetes
- Proven experience designing, building, and managing bare metal OpenShift clusters
- Solid understanding of Linux internals, container runtimes, networking, and troubleshooting
- Experience with application migration from both on-premise and Azure environments into OpenShift
- Strong experience with multi-tenancy architecture, including workload isolation and security
- Familiarity with storage (CSI), networking (CNI), and service mesh implementations
- Proficiency in monitoring and observability tools (e.g., Prometheus, Grafana, ELK)
- Experience with Infrastructure as Code (Ansible, Terraform) and CI/CD automation
- Strong documentation and communication skills
Certifications (Required)
- Red Hat Certified Specialist in OpenShift Administration
- Red Hat Certified Engineer (RHCE) or equivalent Linux certification
Nice to Have
- Familiarity with AI/ML compute environments (e.g., GPU workloads, NVIDIA operators)
- Experience with hybrid cloud or edge computing models
- Exposure to enterprise-grade security, compliance, and policy enforcement
Top Skills
Ansible
Elk
Grafana
Kubernetes
Linux
Prometheus
Red Hat Openshift
Terraform
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The VP of Engineering for the Enterprise Platform will lead engineering teams, define platform architecture, and drive innovation for identity security solutions at SailPoint.
Top Skills:
AICloud-Native ArchitectureEvent-Driven SystemsGraph DatabasesGraphQLIdentity/Security PlatformsMicroservicesMl
Manufacturing
The Luxury Sales Manager drives sales for The House of Rohl product portfolio, focusing on customer relationships, business development, and achieving sales targets.
Top Skills:
MS Office
Manufacturing
The Luxury Sales Manager drives sales for The House of Rohl product portfolio, builds relationships with retailers and the specification community, and seeks new business opportunities while meeting sales targets.
Top Skills:
MS Office
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

