Designs, builds, and optimizes enterprise Databricks Lakehouse pipelines and data products using Spark, Delta Lake, SQL, and Python. Leads complex data initiatives, production support, governance, CI/CD, workflow orchestration, monitoring, and modernization of legacy SQL Server solutions. Partners with stakeholders, optimizes performance and cost, mentors engineers, and drives engineering standards across Azure data platforms.
As a Senior BI Data Engineer, you will design, build, and optimize enterprise-scale data solutions that power analytics and business decision-making across Boston Beer. You will work hands-on with Databricks, Azure data services, and modern data engineering practices to deliver reliable, scalable, and high-performing data products. In this role, you'll partner with stakeholders across multiple business functions while helping drive platform modernization, engineering excellence, and technical innovation.
ResponsibilitiesWhat You'll Brew:
- Design, build, and support scalable Databricks Lakehouse data pipelines using Apache Spark, Delta Lake, Structured Query Language (SQL), and Python.
- Lead technical design and delivery for complex data initiatives that span multiple systems, platforms, and business functions.
- Diagnose production issues, perform root cause analysis, evaluate technical alternatives, and implement solutions that improve reliability, scalability, and maintainability.
- Develop reusable frameworks and engineering practices for data ingestion, transformation, orchestration, testing, monitoring, data quality, and production support.
- Administer and support Databricks platform capabilities, including workspace configuration, Unity Catalog, permissions management, and data governance.
- Design and manage production workflows, including scheduling, dependency management, monitoring, alerting, and failure recovery.
- Implement continuous integration and continuous deployment (CI/CD) processes using Azure DevOps, Git-based development workflows, and Databricks Asset Bundles.
- Collaborate with business stakeholders, analytics teams, and technology partners to define requirements and deliver impactful data solutions.
- Optimize data pipelines, compute resources, and storage for performance, observability, reliability, and cost efficiency while supporting modernization of legacy SQL Server solutions.
- Mentor engineers, conduct code and design reviews, and contribute to continuous improvements in engineering standards and practices.
- Work in a standard office environment with occasional travel as needed to support business objectives and team collaboration.
Minimum Qualifications:
- Bachelor's degree in Computer Science, a closely related field, or equivalent practical experience.
- 7+ years of experience in data engineering, data warehousing, data integration, analytics engineering, or related technology roles.
- 3+ years of hands-on Databricks development experience supporting production environments.
- Strong expertise with Databricks Lakehouse, Apache Spark, Delta Lake, Databricks Workflows, Unity Catalog, and distributed data processing.
- Experience working with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Key Vault.
- Advanced SQL and Python skills with experience building, operating, and optimizing complex ETL/ELT pipelines and analytical data models.
- Experience with modern DevOps and data engineering practices, including Git-based development, automated testing, CI/CD, orchestration, monitoring, security, governance, and production support.
- Demonstrated ability to lead technical solution design, evaluate technical trade-offs, and independently deliver complex data initiatives.
- Strong communication and collaboration skills with experience providing technical guidance to engineering teams.
Preferred Qualifications:
- Experience with advanced Databricks capabilities, including Databricks Asset Bundles, workspace administration, platform configuration, and governance.
- Experience with Power BI semantic modeling, reporting enablement, and analytics consumption patterns.
- Experience modernizing legacy SQL Server data solutions to cloud-based platforms.
- Familiarity with artificial intelligence (AI), machine learning (ML), feature engineering, or model-ready data products.
- Knowledge of SAP, Salesforce, Supply Chain, Manufacturing, or consumer packaged goods business processes.
Level: L6
At the Boston Beer Company and in accordance with pay transparency laws, we are open about our salary ranges. For this role, the salary range is between $120,000 and $187,000. However, it's important to note that where the person hired starts in this range is dependent on their related experience, skillset and location. Additionally, this position qualifies for a discretionary annual bonus based on company and individual performance, and certain sales roles might include a car allowance.
Some Perks:
Our people are our most important "ingredient." We hire the best talent; and we reward, develop, and retain them too.
In addition to generous healthcare on day one, stock purchase plan, 401k and more, Full Time Boston Beer Coworkers have the following perks available*:
- Tuition reimbursement
- Fertility/adoption support
- Free financial coaching
- Health & wellness program and discounts
- Professional development & training
- Free beer!
*Talk to your recruiter about eligibility
Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Fair Chance Ordinance and the CA Fair Chance Act.
Boston Beer Corporation is an equal opportunity employer and is committed to a diverse workforce. In order to help ensure reasonable accommodation for individuals protected by Section 503 of the Rehabilitation Act of 1973, the Vietnam Veteran's Readjustment Act of 1974, and Title I of the Americans with Disabilities Act of 1990, applicants who wish to request accommodation in the job application process can contact [email protected] for assistance.
#LI-KP1
The Boston Beer Company Boston, Massachusetts, USA Office
The Innovation and Design Building, Boston, Massachusetts , United States, 02210
Similar Jobs
Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Develops acoustical and mechanical reference designs for wearable audio, noise cancellation, and voice applications. Responsibilities include acoustical simulation, experiments, measurements, prototype and fixture construction, data analysis, system-level tradeoff assessment, and technical documentation. Collaborates with mechanical, DSP, electrical, software, research, and product development teams to translate ambiguous concepts into scalable engineering solutions.
Top Skills:
Audio PrecisionB&KComsolDspFeaGrasListen Inc.MatlabNational InstrumentsPspiceSimspeakerSimulink
50 Minutes Ago
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Analyzes autonomous-vehicle telemetry, time-series signals, incidents, software releases, and operational data to investigate safety issues and root causes. Integrates diverse data sources into analysis-ready datasets, validates data quality, applies engineering and signal-processing methods, and delivers rigorous findings for safety assurance and operational decisions. The role also develops reusable detection methods, metrics, pipelines, and analytical tooling while collaborating across engineering, operations, safety, human factors, and data teams.
Top Skills:
BigQueryC++Ci/CdCloud Data PlatformsDistributed ProcessingDockerGitKubernetesPythonRobot Operating System (Ros)Signal ProcessingSQLTime-Series Analysis
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads GM Europe's commercial performance across the UK and Ireland, translating regional strategy into country plans and driving sales, service, revenue, profitability, customer experience, and network effectiveness. Manages dealerships, fleet customers, distributors, and other route-to-market partners; coordinates marketing, product, distribution, inventory, and service activities; leads cross-functional initiatives; and develops a high-performing country organization while ensuring compliance, governance, and risk management.
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
