Designs, deploys, governs, and supports enterprise Databricks platforms across AWS Commercial and GovCloud environments. Responsibilities include Terraform-based workspace deployment, AWS networking, Unity Catalog administration, CI/CD automation, security and governance controls, platform monitoring, cost optimization, incident escalation, and stakeholder guidance. Requires extensive Databricks administration, AWS infrastructure, infrastructure-as-code, Python, Linux, and federal security environment experience.
This is a remote position.
Location: Remote – United States
Security Clearance: Active Secret or higher REQUIRED
Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client.
Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered.
The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
- Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost.
- Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements
- Active Secret security clearance or higher is required.
- U.S. citizenship required.
- 6+ years of experience engineering, administering, or supporting Databricks platforms.
- Strong hands-on experience with Databricks in AWS environments.
- Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
- Strong knowledge of Databricks Secure Reference Architecture.
- Hands-on Unity Catalog administration experience.
- Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
- Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
- Python proficiency.
- Linux systems administration experience.
- Hands-on experience with AWS services including:
- VPC
- IAM
- S3
- KMS
- EC2
- CloudWatch
- VPC
- Strong troubleshooting and root-cause analysis capabilities.
- Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
- AWS GovCloud experience.
- Experience working within regulated, security-sensitive, or compliance-heavy environments.
- Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Leads Enterprise Security services, setting and enforcing security standards across identity, endpoints, business applications, cloud infrastructure, networking, IoT, and automation. Partners with IT, SOC, vulnerability management, governance, and threat operations teams to secure applications, monitor environments, manage EDR policies, remediate vulnerabilities, assess risks, and maintain compliance. Also drives AI security initiatives and uses AI tools to improve enterprise security capabilities and team efficiency.
Top Skills:
AWSAzureCircleCIEdrFedrampGCPGithub ActionsGleanGoHashicorp VaultIso 27001JAMFJavaLastpassLinuxmacOSMicrosoft IntuneOktaPowershellPythonSalesforceSoc 2TinesWindowsZapier
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Own and grow a local sales territory through primarily in-person prospecting, business visits, demos, partnerships, and full-cycle selling of Square’s commerce and financial services solutions. Build pipeline, establish seller relationships, manage referrals, maintain Salesforce activity and forecasts, and consistently exceed quota. The role requires field sales execution, business development, consultative selling, reliable transportation, and residence in the assigned market.
Top Skills:
Salesforce
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Provides operational administration for employee health, welfare, retirement, leave, and disability benefits across North America and Latin America. Manages enrollments, employee inquiries, HRIS and carrier data, leave tracking, vendor invoices, reconciliations, compliance reporting, and open enrollment support. Partners with HR Operations, Payroll, Finance, and external vendors while maintaining accurate records and documentation.
Top Skills:
Benefits Administration PlatformsDayforceHrisExcel
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
