Develop and maintain datasets for visualization and machine learning; automate data pipelines; partner with teams to build data products.
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
Requirements
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
Benefits
- Education Assistance/Student Loan Repayment - up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k - 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance
Similar Jobs
Cloud • Information Technology
The Data Architect will design and implement a data strategy on Google Cloud, facilitate architecture discussions, and manage database migrations while providing architectural recommendations to customers.
Top Skills:
AirflowBeamBigQueryCloud SqlCloud WorkflowsDataflowDataformDataprocDbtDjangoFast ApiFlaskGCPGraphQLPandasPythonSpark
Healthtech • HR Tech • Information Technology • Professional Services
The role involves building and maintaining financial data pipelines in Databricks, bridging Snowflake, and ensuring data accuracy for finance reporting.
Top Skills:
Cloud-Based Data Engineering PlatformsDatabricksPysparkSnowflakeSparkSQL
Artificial Intelligence • Information Technology • Consulting • Big Data Analytics
The Data Architect will design data architecture, drive strategy for data warehousing, oversee reporting projects, and mentor the team while ensuring compliance with standards.
Top Skills:
ETLMs Power BiSAPSnowflakeTalend
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
