While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
About Quantiphi:
Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.
Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. Headquartered in Boston, with 4,000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:
17x Google Cloud Partner of the Year awards in the last 8 years.
3x AWS AI/ML award wins.
3x NVIDIA Partner of the Year titles.
2x Snowflake Partner of the Year awards.
We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.
We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.
We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.
Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here!
For more details, visit: Website or LinkedIn Page.
Experience Level: 8+ years of experience
Work Location: Atlanta, GA (Preferred)/ Anywhere in USA or Canada
About the Role:
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.
What Success Look Like:
Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.
Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.
Implement data models optimized for analytics, performance, and operational excellence.
Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.
Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.
Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.
Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.
Essential Skills/Qualifications:
8+ years of experience in data engineering or a related field.
Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.
Hands-on experience building and optimizing data pipelines in AWS or GCP environments.
Track record of working with complex source systems and developing accurate extraction and transformation logic.
Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.
Solid understanding of distributed computing, data partitioning, and performance tuning.
Nice to haves:
Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.
Familiarity with Delta Lake, orchestration tools, or Unity Catalog.
Experience with CI/CD for data pipelines and automated testing frameworks.
What We Offer:
Join a high-growth, AI-first digital engineering and transformation company
Work with Fortune 500 clients and cutting-edge market disruptors
Collaborate with a talented, dynamic, and driven team
Gain exposure to the latest technologies in AI, ML, cloud, and data engineering
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Top Skills
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
