Designs and implements scalable data lakehouse platforms on GCP, including BigQuery, GCS, BigLake, and Dataplex. Leads real-time and batch data pipeline development, data governance, metadata management, security, and performance optimization. Partners with clients and stakeholders to translate business needs into architecture, leads technical teams, mentors engineers, and provides hands-on solutioning and technical advisory support.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
Meet Egen
Life at Egen
Culture and Values at Egen
Career Development at Egen
Benefits at Egen
Responsibilities
- Be part of the end-to-end architecture, design, and implementation of scalable Data Lakehouse solutions on Google Cloud Platform (GCP) using BigQuery, GCS, BigLake, and Dataplex
- Collaborate directly with customers to understand business goals, data challenges, and technical requirements; translate them into robust architectural blueprints and actionable plans
- Design and implement data pipelines supporting both real-time and batch ingestion using modern orchestration and streaming frameworks
- Establish and enforce best practices for data cataloging, metadata management, lineage, and data quality across multiple systems
- Define and implement data security, access control, and governance models in compliance with enterprise and regulatory standards
- Serve as the technical lead for project teams - mentoring engineers, reviewing solutions, and ensuring architectural consistency across deliverables
- Balance strategic architecture discussions with hands-on solutioning, POCs, and deep dives into data pipelines or performance tuning
- Partner with stakeholders, cloud architects, and delivery leads to drive solution adoption, scalability, and long-term maintainability
- Represent the company as a trusted technical advisor in client engagements - clearly articulating trade-offs, best practices, and recommendations
Qualifications
- 6+ years of progressive experience in Software Engineering and Data Platform development, with 5+ years architecting data platforms on GCP and/or Databricks
- Proven hands-on experience designing and deploying Data Lakehouse platforms with data products and medallion architectures
- Strong understanding of data ingestion patterns (real-time and batch), ETL/ELT pipeline design, and data orchestration using tools such as Airflow, Pub/Sub, or similar frameworks
- Expertise in data modeling, storage optimization, partitioning, and performance tuning for large-scale analytical workloads
- Experience implementing data governance, security, and cataloging solutions (Dataplex, Data Catalog, IAM, or equivalent)
- Excellent communication and presentation skills - able to confidently engage with technical and non-technical stakeholders and guide clients through solution decisions
- Demonstrated ability to lead by example in mixed teams of engineers, analysts, and architects, balancing architectural vision with hands-on delivery
- Nice to have: Experience with Databricks (Delta Lake, Unity Catalog) and hybrid GCP-Databricks data architectures
- Strong problem-solving mindset, curiosity to explore new technologies, and ability to “zoom out” for architecture discussions and “zoom in” for code-level troubleshooting
Similar Jobs
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Define and lead the architecture of NBCUniversal’s greenfield Microsoft Fabric enterprise data platform. Establish lakehouse, warehouse, integration, real-time streaming, data modeling, governance, security, DevOps, and observability standards. Translate architecture and business objectives into delivery roadmaps, epics, stories, and implementation plans while guiding multidisciplinary engineering teams. Design scalable solutions combining operational, historical, master, and reference data to support reporting, analytics, automation, AI, and reusable data products.
Top Skills:
Amazon KinesisAPIsAzure DevopsAzure Event HubsBicepChange Data CaptureCi/CdData FactoryDelta LakeEventhouseEventstreamGithub ActionsKafkaLakehouseAzureMicrosoft FabricNotebooksOnelakePower BIPysparkPythonReal-Time IntelligenceSemantic ModelsSQLTerraformWarehouse
Financial Services
Lead the enterprise data architecture strategy, standards, and governance. Design logical and physical data models, source-to-target mappings, data integration and warehouse architectures, metadata repositories, data dictionaries, and RDM/MDM solutions. Establish data quality, reference data, master data, and metadata policies while supporting business intelligence implementations. Provide technical leadership, mentoring, documentation, testing support, and guidance across database development projects.
Top Skills:
Business IntelligenceData As A Product (Daap)Data IntegrationData MeshData ModelingData WarehousingMaster Data Management (Mdm)Metadata ManagementReference Data Management (Rdm)
Aerospace • Information Technology • Security • Cybersecurity • Defense
Designs and optimizes enterprise data warehouse solutions, SQL queries, ETL workflows, and Tableau dashboards. Responsibilities include data ingestion, performance tuning, data quality validation, BI governance, documentation, and reporting automation using SQL, Python, and Tableau. The role collaborates with business partners to translate data needs into actionable insights and supports mission-critical analytics applications in a fully remote environment.
Top Skills:
APIsAWSDatabricksEnterprise Data WarehousingETLGitPythonSQLSQL ServerT-SqlTableau DesktopTableau PrepTableau Server
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
