Lead Data Engineer responsible for shaping the Snowflake platform architecture, mentoring data engineers, and optimizing data solutions. Responsibilities include managing Agile delivery, implementing ELT pipelines, ensuring data quality, and applying security protocols while facilitating communication with stakeholders.
Allata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences. We architect and modernize secure, scalable solutions using cloud platforms and top engineering practices.
Allata also empowers clients to unlock data value through analytics and visualization and leverages artificial intelligence to automate processes and enhance decision-making. Our agile, cross-functional teams work closely with clients, either integrating with their teams or providing independent guidance—to deliver measurable results and build lasting partnerships.
We’re looking for a hands-on Lead Data Engineer to own and evolve our clients’ Snowflake data platform. You’ll lead and mentor a squad of data engineers, shape the technical roadmap, and deliver high-quality, cost-efficient, and secure data solutions. This role blends architecture, delivery leadership, and coding—ideal for someone who can set standards, coach others, and still dive deep when needed.
Role & Responsibilities:
- Define and evolve Snowflake platform architecture, standards, and best practices.
- Translate business goals into a pragmatic technical roadmap and delivery plan.
- Lead and mentor data engineers; establish quality bars, review code, and guide execution.
- Manage delivery using Agile rituals; align priorities across data, analytics/BI, and application teams.
- Design, build, and optimize ELT pipelines on Snowflake with an ELT-first approach (dbt preferred).
- Implement modern data ingestion using tools such as Fivetran, ADF, Glue, or Matillion.
- Set up orchestration and CI/CD for data using Airflow or Dagster and Git-based pipelines.
- Ensure data quality, observability, monitoring, alerting, documentation, and runbooks.
- Apply performance tuning and cost optimization in Snowflake, including query profiling and warehouse sizing.
- Implement security and governance in Snowflake (RBAC, masking, row access policies, auditing, data sharing).
- Facilitate discovery with stakeholders, clarify requirements, and communicate trade-offs and recommendations.
Hard Skills - Must have:
- Deep hands-on Snowflake experience: warehouses, databases/schemas, stages, file formats, external tables, Snowpipe, Streams and Tasks, Time Travel/Fail-safe, query performance, micro-partitions, clustering, and cost management.
- Strong SQL and Python for data engineering use cases.
- ELT-first development with dbt or an equivalent modeling/testing/documentation framework.
- Experience with modern ingestion and orchestration (Fivetran, ADF, Glue, Matillion, Airflow, or Dagster).
- Cloud experience (AWS preferred; Azure or GCP considered), including storage, IAM, networking basics, and secrets management.
- CI/CD for data with Git-based workflows and environment promotion.
- Familiarity with Infrastructure as Code (e.g., Terraform Snowflake provider).
- Solid understanding of dimensional modeling and data quality practices.
Nice to have/It's a plus:
- Snowpark (Python), UDFs or stored procedures, and Dynamic Tables.
- Streaming or CDC with Kafka, Kinesis, or Debezium; event-driven patterns.
- BI or semantic layer exposure (Power BI, Tableau, Looker); metrics layer concepts.
- Experience with Azure Synapse, Microsoft Fabric, or Databricks in lakehouse contexts.
- Security and compliance exposure (PII handling, encryption, auditing, regulated environments).
Soft Skills:
- Proven leadership with coaching, feedback, objective setting, and conflict resolution.
- Excellent stakeholder communication; able to facilitate discovery and manage expectations.
- Ownership mindset with proactive risk identification, prioritization, and mitigation.
- Structured problem-solving; comfortable with ambiguity and change.
At Allata, we value differences.
Allata is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Allata makes employment decisions without regard to race, color, creed, religion, age, ancestry, national origin, veteran status, sex, sexual orientation, gender, gender identity, gender expression, marital status, disability or any other legally protected category.
This policy applies to all terms and conditions of employment, including but not limited to, recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Top Skills
Adf
Airflow
AWS
Azure
Dbt
Fivetran
GCP
Git
Glue
Matillion
Python
Snowflake
SQL
Terraform
Similar Jobs
.png)
Fintech • Real Estate • Financial Services
As a Senior Data Engineer, you will build Crowd Street's data platform, manage data pipelines, and collaborate with teams to meet data needs.
Top Skills:
Azure Data FactoryAzure Synapse AnalyticsAzureMicrosoft Power BiPython
Information Technology • Security • Cybersecurity
As a Senior Data Engineer, you will build and maintain big data pipelines, engage in all software development phases, and collaborate with cross-functional teams to enhance system performance and stability.
Top Skills:
AirflowSparkAWSClickhouseDockerHiveJenkinsKafkaKafka ConnectPostgresPythonRedisScalaScylladbTerraform
_1.png)
Other
As a Senior Data Engineer, you will enhance the data lakehouse, optimize data workloads, perform complex transformations, and develop frameworks to improve delivery velocity, focusing on cybersecurity solutions.
Top Skills:
Cloud Data ProcessingData WarehousingDatabricksDistributed Processing FrameworkPythonSpark
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
