Quantiphi Logo

Quantiphi

Sr Data Engineer

Reposted 14 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
As a Senior Data Engineer, you will design and maintain scalable data pipelines, focusing on architecture, ingestion, storage, and analytics on GCP. You'll collaborate with stakeholders and optimize data structures for performance while ensuring adherence to data governance and compliance standards.
The summary above was generated by AI

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Company Highlights:

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate—we lead. Headquartered in Boston, with 4000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years

  • 3x AWS AI/ML award wins

  • 3x NVIDIA Partner of the Year titles

  • 2x Snowflake Partner of the Year awards

  • We have also garnered Top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here.

About The Role
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.
Key Responsibilities

  • Define and own the overall data architecture for ingestion, storage, transformation, and analytics on GCP (focused on BigQuery and Cloud Composer).
  • Design data modeling frameworks and best practices for structured and semi-structured insurance data (Policy, Claims, Billing).
  • Collaborate with Business Analysts to translate functional Guidewire requirements into conceptual and logical data models.
  • Work with Data Modelers and Data Engineers to define physical schemas, transformation strategies, and data lineage standards.
  • Design and oversee data ingestion architecture from Guidewire (staging, raw, curated layers) using SQL-based ELT pipelines.
  • Establish data governance, metadata management, and data quality frameworks for transparency and compliance.
  • Review and optimize BigQuery data structures (partitioning, clustering, query tuning, storage tiering).
  • Define naming conventions, security models (IAM/RLS), and access control standards for the data warehouse.
  • Ensure architecture alignment with cloud best practices for scalability, cost optimization, and maintainability.
  • Provide architectural direction and mentorship to the Data Engineering Lead, Data Modeler, and Data Engineers.
  • Partner with enterprise security and infrastructure teams to maintain compliance with data privacy regulations.

Required Skills and Experience

  • 10+ years of experience in data architecture/design with at least 6+ years on GCP.
  • Deep expertise in Google BigQuery data warehouse design and performance tuning.
  • Strong working knowledge of Cloud Composer (Airflow) and orchestration pipelines.
  • Solid understanding of insurance data structures, preferably from Guidewire systems (PolicyCenter, BillingCenter, ClaimsCenter).
  • Experience architecting enterprise-grade ELT frameworks and multi-layered data architectures (staging → raw → curated → analytics).
  • Hands-on proficiency in SQL and schema design for analytical environments (star/snowflake models).
  • Familiarity with data governance, cataloging, and metadata management.
  • Ability to lead technical teams and guide design decisions with both functional and technical stakeholders.

What is in it for you:

  • Be part of the fastest-growing AI-first digital transformation and engineering company in the world

  • Be a leader of an energetic team of highly dynamic and talented individuals

  • Exposure to working with fortune 500 companies and innovative market disruptors

  • Exposure to the latest technologies related to artificial intelligence and machine learning, data and cloud

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Similar Jobs

2 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate scalable, secure cloud-based data platforms and pipelines across the full data engineering lifecycle. Instrument and monitor pipelines, optimize performance, troubleshoot production issues, reduce technical debt, drive cloud and open-source adoption, and maintain documentation and governance for federal and military healthcare data solutions.
Top Skills: AzureCi/CdDevOpsGoogle Cloud Platform (Gcp)OraclePostgresSQLSQL Server
4 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and optimize scalable ETL/data pipelines (SQL Server, Snowflake, Databricks) for large healthcare datasets. Support production cycles, monitor and resolve issues, perform root cause analysis, ensure data quality, conduct code reviews, estimate work, and partner with stakeholders to deliver reliable data solutions.
Top Skills: .NetAzureDatabricksOraclePythonSnowflakeSQLSQL ServerSsisTeradata
8 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
120K-201K Annually
Senior level
120K-201K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.
Top Skills: AirflowAWSAzureDagsterData LakeDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account