The Senior Platform/DevOps Engineer designs, automates, and operates Databricks platforms, ensuring scalability and reliability while collaborating with data and engineering teams.
Description
At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW. The Senior Platform / DevOps Engineer plays a critical role in designing, automating, and operating enterprise-grade Databricks platforms in support of data and AI initiatives. This role partners closely with engineering, data, and cloud teams to ensure scalable, secure, and cost-optimized platform services. The engineer operates with a high degree of autonomy, contributing deep technical expertise while supporting mission-critical workloads.
* What you'll do:
* Automate and manage Databricks workspaces, clusters, Unity Catalog, identity, networking, and secret scopes using Infrastructure-as-Code tools such as Terraform.
* Design, implement, and maintain CI/CD pipelines using GitHub Actions and Azure DevOps to support data and platform deployments.
* Establish and enforce platform guardrails including cluster policies, cost controls, logging, alerting, drift detection, and secure networking standards.
* Ensure platform health, scalability, reliability, and cost optimization across Databricks environments.
* Provide tier-3 operational support, troubleshoot complex incidents, and drive root-cause resolution.
* Collaborate with data engineering, analytics, and AI teams to enable efficient development and deployment of data solutions.
* Contribute to platform standards, documentation, and continuous improvement initiatives.
What we expect of you:
* 5 years of experience in designing, developing, and deploying solutions on the Databricks platform with strong understanding of its architecture and capabilities.
* Proficiency in Python, including PySpark, and SQL; experience with Scala or Java is a plus.
* Strong understanding of cloud platforms such as AWS, Azure, or GCP, including compute, storage, identity and access management, and networking services.
* Hands-on experience with data warehousing, data lake, and Lakehouse architectures, including Delta Lake and Medallion Architecture concepts.
* Proven experience building and maintaining ETL and ELT pipelines in enterprise environments.
* Experience using Git-based version control and CI/CD practices for data and platform deployments.
* Strong problem-solving, critical thinking, and communication skills, with the ability to operate independently in complex technical environments.
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It's why we're coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we're headed. We're proud to share our story and Make Amazing Happen at CDW. The Senior Platform / DevOps Engineer plays a critical role in designing, automating, and operating enterprise-grade Databricks platforms in support of data and AI initiatives. This role partners closely with engineering, data, and cloud teams to ensure scalable, secure, and cost-optimized platform services. The engineer operates with a high degree of autonomy, contributing deep technical expertise while supporting mission-critical workloads.
* What you'll do:
* Automate and manage Databricks workspaces, clusters, Unity Catalog, identity, networking, and secret scopes using Infrastructure-as-Code tools such as Terraform.
* Design, implement, and maintain CI/CD pipelines using GitHub Actions and Azure DevOps to support data and platform deployments.
* Establish and enforce platform guardrails including cluster policies, cost controls, logging, alerting, drift detection, and secure networking standards.
* Ensure platform health, scalability, reliability, and cost optimization across Databricks environments.
* Provide tier-3 operational support, troubleshoot complex incidents, and drive root-cause resolution.
* Collaborate with data engineering, analytics, and AI teams to enable efficient development and deployment of data solutions.
* Contribute to platform standards, documentation, and continuous improvement initiatives.
What we expect of you:
* 5 years of experience in designing, developing, and deploying solutions on the Databricks platform with strong understanding of its architecture and capabilities.
* Proficiency in Python, including PySpark, and SQL; experience with Scala or Java is a plus.
* Strong understanding of cloud platforms such as AWS, Azure, or GCP, including compute, storage, identity and access management, and networking services.
* Hands-on experience with data warehousing, data lake, and Lakehouse architectures, including Delta Lake and Medallion Architecture concepts.
* Proven experience building and maintaining ETL and ELT pipelines in enterprise environments.
* Experience using Git-based version control and CI/CD practices for data and platform deployments.
* Strong problem-solving, critical thinking, and communication skills, with the ability to operate independently in complex technical environments.
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
Similar Jobs at CDW
Information Technology
The Senior Analytics Engineer transforms curated data into analytical assets, develops BI-ready models, and collaborates with data stakeholders to deliver analytics solutions.
Top Skills:
AWSAzureDatabricksGCPGitPysparkPythonSQL
Information Technology
The Senior ML/MLOps Engineer designs and manages scalable machine learning solutions on Databricks, collaborating with teams to productionize models and ensure reliable operations.
Top Skills:
Azure DevopsAzure Machine LearningDatabricksMlflowPythonPyTorchScikit-LearnSQLTensorFlow
Information Technology
Designs, builds, and maintains scalable data pipelines on Databricks, focusing on data quality, integrity, and governance, while collaborating with teams to deliver data solutions.
Top Skills:
Azure Data FactoryDatabricksDelta LakeMlflowPysparkPythonPyTorchScikit-LearnSparkSQLTensorFlow
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
