Designs and optimizes Databricks data pipelines, Spark jobs, clusters, data models, ETL/ELT processes, and Lakehouse architectures. Implements governance, security controls, CI/CD, and cloud integrations across AWS, Azure, and GCP. Advises engineering teams, mentors staff, defines technical roadmaps, collaborates with stakeholders, and troubleshoots Databricks performance and system issues.
True Zero Technologies, a veteran-owned small business, was founded on the principle that the purposeful enablement of people and technology in an organization directly ties to the quality of its outcomes. True Zero recognizes that those outcomes begin and end with our people, and that is what we have built a community of like-minded, driven, and passionate individuals and innovators who are aligned in a common goal of delivering top-tier services to our customers. Our culture and commitment have been recognized through numerous accolades, including being named one of the Best Places to Work in 2023 in two categories (“Prosperous and Thriving” ($5MM–$50MM in gross revenue) and “Mid-Atlantic Region” (DC, DE, MD, NC, VA, WV)), and again in 2025 as a Best Places to Work honoree. In addition, True Zero earned coveted spots on the Inc. 5000 list of fastest-growing companies in America in 2022, 2023, and 2025, a testament to our sustained growth driven by our people-first approach and unwavering dedication to excellence.
Position Responsibilities
- Performance & Optimization: Optimize data pipelines, configure clusters, and implement best practices for cost and performance.
- Governance & Security: Implement security protocols, such as Unity Catalog, IAM, and data access controls.
- Technical Leadership: Act as a trusted advisor to engineering teams, mentor staff, and define technical roadmaps.
- Collaboration: Work with data engineers and stakeholders to align technical solutions with business requirements.
- Technical Expertise: Strong proficiency in Databricks, Apache Spark, Python/PySpark, and SQL.
- Cloud Proficiency: Experience with cloud platforms, specifically AWS (S3, Glue) or Azure.
- Data Modeling: Expertise in data modeling, data profiling, and ETL/ELT pipeline design
- Architecture & Development: Design and implement scalable data pipelines, data models, and Lakehouse architectures.
- Implement CI/CD pipelines, use tools like Azure DevOps or Git for version control, and automate routine tasks.
- Integrate data from various cloud sources and services (AWS, Azure, GCP) such as Blob Storage, Data Lake Storage, and other databases.
- Optimize Spark jobs & monitor system metrics to quickly troubleshoot issues related to the Databricks environment.
Position Qualifications
- Requires 3-5 years of experience in data engineering, data warehousing, or data architecture roles.
- US citizenship and ability to obtain and maintain a federal security clearance may be required
- Bachelors degree is highly preferred
Similar Jobs
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Provides onsite IT and infrastructure leadership for a large outdoor proving ground. Designs, deploys, monitors, and supports wireless, cellular, microwave, mesh, and private 5G networks enabling autonomous and remotely operated equipment. Manages cybersecurity, vulnerability remediation, vendors, projects, budgets, and stakeholder relationships while conducting RF planning, troubleshooting, root cause analysis, and reliability improvements.
Top Skills:
CellularCisco NetworkingDrive-Test ToolsLteMicrowave CommunicationsOt EnvironmentsPowershellPrivate 5GPythonRfSite Survey ToolsSpectrum AnalyzersWi-FiWireless Mesh
Cloud • Security • Software • Cybersecurity • Automation
Manages a distributed team of Solutions Architects across India while serving as a player-coach on strategic sales opportunities. Leads technical evaluations, workshops, demonstrations, and proof-of-concept engagements; builds executive customer relationships; and translates technical requirements into business outcomes. The role also owns regional operating practices, forecasting, resource allocation, KPI tracking, cross-functional alignment, hiring, coaching, and team development across Sales, Channel, Marketing, Enablement, and Product Management.
Top Skills:
DevsecopsGitlab
Cloud • Security • Software • Cybersecurity • Automation
Owns the roadmap and execution of global partner programs across sourcing, co-selling, services, adoption, renewals, and marketplace motions. Coordinates cross-functional stakeholders, improves partner journeys, designs incentives, maintains program documentation, creates enablement materials, and establishes performance reporting. This strategic individual contributor connects partner activity to pipeline, revenue, and customer outcomes while driving program adoption, compliance, and continuous improvement.
Top Skills:
Artificial IntelligenceCloud ComputingDevsecopsGitlabSaaS
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
