The role involves engineering modern data platforms, focusing on data ingestion, transformation, and storage while utilizing Azure services and MS Fabric, supporting an investment management firm.
Location: Boston, MA
Position Type: Hybrid
Hybrid Schedule: 4 days/week onsite
Contract Length: 7 months, contract-to-hire
Position Overview:
This role involves designing, building, and optimizing modern data platforms that power intelligent, data-driven experiences for global clients. Responsibilities include enabling scalable ingestion, transformation, and storage of enterprise data across lakehouse and warehouse architectures while operating at the intersection of cloud, data engineering, and analytics. The position also includes close collaboration with architects, analysts, and product teams to ensure data solutions are reliable, high-performing, and aligned with business objectives.
Duties:
Required Qualifications:
Preferred Qualifications:
Position Type: Hybrid
Hybrid Schedule: 4 days/week onsite
Contract Length: 7 months, contract-to-hire
Position Overview:
This role involves designing, building, and optimizing modern data platforms that power intelligent, data-driven experiences for global clients. Responsibilities include enabling scalable ingestion, transformation, and storage of enterprise data across lakehouse and warehouse architectures while operating at the intersection of cloud, data engineering, and analytics. The position also includes close collaboration with architects, analysts, and product teams to ensure data solutions are reliable, high-performing, and aligned with business objectives.
Duties:
- Design and implement end-to-end data ingestion pipelines using Azure services, including API-based ingestion and Azure Data Factory (ADF).
- Build and manage lakehouse and data warehouse solutions using modern data storage formats to support analytical and operational workloads.
- Develop and optimize data transformations using PySpark, ensuring scalability, performance, and cost efficiency.
- Apply medallion architecture (bronze, silver, gold layers) to enable high-quality, governed, and reusable datasets.
- Partner with cross-functional teams to support data modeling, analytics, and downstream consumption use cases.
- Contribute to best practices around data quality, reliability, and maintainability across the data platform.
Required Qualifications:
- Hands-on experience or strong working knowledge of Microsoft Fabric, including its role in modern analytics and lakehouse architectures.
- Proven experience working in Azure for data ingestion and orchestration.
- Strong experience with Azure Data Factory (ADF) for pipeline development and scheduling.
- Experience building API-based data ingestion solutions.
- Solid understanding of data storage formats, including CSV, JSON, and Parquet.
- Experience designing and working with data warehouses and lakehouse architectures.
- Strong foundation in data modeling concepts for analytical workloads.
- Practical experience implementing medallion architecture patterns.
- Proficiency in PySpark for large-scale data transformations and optimization.
- Ability to write clean, maintainable, and well-documented data pipelines.
Preferred Qualifications:
- Experience optimizing Spark jobs for performance and cost in cloud environments.
- Familiarity with data governance, data quality, or observability practices in large-scale data platforms.
- Experience collaborating with analytics, data science, or AI teams on production-grade data solutions.
- Exposure to agile delivery models and working in cross-functional, client-facing teams.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The role involves evaluating AI solutions for compliance, leading AI/ML controls, enhancing reporting processes, and guiding governance strategies within the Audit and Assurance team.
Top Skills:
AIAnalyticsAutomation ToolsData ScienceData Wrangling TechnologyMl
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Senior Associate in Data Engineering at PwC, you will design and implement data architecture strategies, analyze complex issues, mentor junior members, and build client relationships while ensuring adherence to project standards.
Top Skills:
AWSAws GlueAws LambdaAzureAzure Data FactoryAzure FunctionsDataflowGCPGcp DataprocGcp Functions
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The role involves optimizing supply chain operations, improving efficiency, and mentoring team members while managing projects and client relationships.
Top Skills:
Kinaxis TechnologySupply Chain Analytics Tools
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
