Designs and optimizes Databricks data pipelines, Spark jobs, clusters, data models, ETL/ELT processes, and Lakehouse architectures. Implements governance, security controls, CI/CD, and cloud integrations across AWS, Azure, and GCP. Advises engineering teams, mentors staff, defines technical roadmaps, collaborates with stakeholders, and troubleshoots Databricks performance and system issues.
True Zero Technologies, a veteran-owned small business, was founded on the principle that the purposeful enablement of people and technology in an organization directly ties to the quality of its outcomes. True Zero recognizes that those outcomes begin and end with our people, and that is what we have built a community of like-minded, driven, and passionate individuals and innovators who are aligned in a common goal of delivering top-tier services to our customers. Our culture and commitment have been recognized through numerous accolades, including being named one of the Best Places to Work in 2023 in two categories (“Prosperous and Thriving” ($5MM–$50MM in gross revenue) and “Mid-Atlantic Region” (DC, DE, MD, NC, VA, WV)), and again in 2025 as a Best Places to Work honoree. In addition, True Zero earned coveted spots on the Inc. 5000 list of fastest-growing companies in America in 2022, 2023, and 2025, a testament to our sustained growth driven by our people-first approach and unwavering dedication to excellence.
Position Responsibilities
- Performance & Optimization: Optimize data pipelines, configure clusters, and implement best practices for cost and performance.
- Governance & Security: Implement security protocols, such as Unity Catalog, IAM, and data access controls.
- Technical Leadership: Act as a trusted advisor to engineering teams, mentor staff, and define technical roadmaps.
- Collaboration: Work with data engineers and stakeholders to align technical solutions with business requirements.
- Technical Expertise: Strong proficiency in Databricks, Apache Spark, Python/PySpark, and SQL.
- Cloud Proficiency: Experience with cloud platforms, specifically AWS (S3, Glue) or Azure.
- Data Modeling: Expertise in data modeling, data profiling, and ETL/ELT pipeline design
- Architecture & Development: Design and implement scalable data pipelines, data models, and Lakehouse architectures.
- Implement CI/CD pipelines, use tools like Azure DevOps or Git for version control, and automate routine tasks.
- Integrate data from various cloud sources and services (AWS, Azure, GCP) such as Blob Storage, Data Lake Storage, and other databases.
- Optimize Spark jobs & monitor system metrics to quickly troubleshoot issues related to the Databricks environment.
Position Qualifications
- Requires 3-5 years of experience in data engineering, data warehousing, or data architecture roles.
- US citizenship and ability to obtain and maintain a federal security clearance may be required
- Bachelors degree is highly preferred
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Consulting
Leads HPE’s storage sales organization supporting the Department of War and Intelligence Community. Manages and develops approximately 6–10 sales employees, drives quota attainment, forecasts, customer engagement, pipeline growth, and profitability. Coaches teams on enterprise storage solutions, pricing, and sales strategy; builds executive customer relationships; manages complex deals and escalations; and provides market, competitive, and won/lost feedback to internal stakeholders. Requires active TS clearance and substantial DOW/IC and enterprise technology or storage sales experience.
Top Skills:
Enterprise Storage Technologies
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Owns the end-to-end lifecycle of enterprise data warehouse and business intelligence products, including vision, strategy, roadmaps, backlogs, requirements, user acceptance testing, and optimization. Partners with engineering, architecture, vendors, and business stakeholders to develop solutions, analyze data, manage incidents and changes, ensure compliance, and report performance. Leads product demos and grooming sessions, manages client communication, and mentors Product Specialists.
Top Skills:
AgileBusiness IntelligenceData WarehousingJIRA
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Leads enterprise cyber incident response operations in a 24x7x365 environment. Manages incident prioritization, escalations, containment, remediation, forensic analysis, documentation, metrics, process maturity, and on-call coverage. Serves as incident commander for significant events, partners with stakeholders and technical teams, and communicates risks to senior leadership. Coaches responders, improves playbooks and automation, and drives the strategic development of the incident response program.
Top Skills:
AWSAzureCase ManagementCisspCloud SecurityCyber Kill ChainDiamond ModelEdrEmail SecurityEndpoint Detection And ResponseGcfaGciaGcihGnfaGoogle Cloud PlatformHost-Based Forensic ToolsMitre Att&CkNetwork AnalysisNetwork-Based Forensic ToolsNistSoarXdr
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
