Design, build, and maintain scalable data pipelines and ETL/ELT frameworks using Python and PySpark. Develop reusable components, microservices, and cloud-based data solutions on AWS and Snowflake. Ensure code quality via reviews, CI/CD, logging, and best practices while collaborating with stakeholders to solve data problems.
Key Responsibilities Application & Data Development
- Design, develop, and maintain scalable data pipelines, applications, and utilities using Python and PySpark.
- Build robust ETL/ELT frameworks and data processing solutions for large-scale datasets.
- Develop reusable components, libraries, and automation solutions following coding standards and best practices.
- Write clean, maintainable, and efficient code with proper error handling and logging.
- Participate in code reviews and ensure adherence to development standards.
Must-Have Skills
- Strong hands-on development experience in Python.
- Experience with PySpark and large-scale data processing.
- Strong understanding of software engineering principles, coding standards, design patterns, and best practices.
- Experience with AWS Cloud services such as Glue, Lambda, S3, EC2, API Gateway, ECS, etc.
- Hands-on experience with Snowflake or other cloud data platforms.
- Solid understanding of relational and non-relational databases.
- Experience developing Microservices.
- Knowledge of CI/CD pipelines, Git, version control, and DevOps practices.
- Strong SQL and data modeling skills.
- Excellent analytical, debugging, and problem-solving skills.
- Strong communication and stakeholder management skills
Key Responsibilities Application & Data Development
- Design, develop, and maintain scalable data pipelines, applications, and utilities using Python and PySpark.
- Build robust ETL/ELT frameworks and data processing solutions for large-scale datasets.
- Develop reusable components, libraries, and automation solutions following coding standards and best practices.
- Write clean, maintainable, and efficient code with proper error handling and logging.
- Participate in code reviews and ensure adherence to development standards.
Must-Have Skills
- Strong hands-on development experience in Python.
- Experience with PySpark and large-scale data processing.
- Strong understanding of software engineering principles, coding standards, design patterns, and best practices.
- Experience with AWS Cloud services such as Glue, Lambda, S3, EC2, API Gateway, ECS, etc.
- Hands-on experience with Snowflake or other cloud data platforms.
- Solid understanding of relational and non-relational databases.
- Experience developing Microservices.
- Knowledge of CI/CD pipelines, Git, version control, and DevOps practices.
- Strong SQL and data modeling skills.
- Excellent analytical, debugging, and problem-solving skills.
- Strong communication and stakeholder management skills
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Similar Jobs
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
Define and lead the long-term technical vision and architecture for GoodRxs data platform. Guide platform modernization, large-scale migrations, scalability, reliability, observability, CI/CD, and developer experience. Mentor engineering teams, author standards and design docs, establish data governance and reusable patterns, and enable analytics, ML/AI workloads across the company.
Top Skills:
AWSCodefreshDockerEksEmrETLGCPGitGlueJIRALambdaRdsRedshiftS3SQLTerraform
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, build, and optimize BigQuery-based data solutions and data models. Manage data storage, partitioning, clustering, ETL, and data quality. Collaborate with architects, data scientists, and engineers to deliver scalable, secure cloud data infrastructure and documentation; senior hires provide technical leadership, code review, and process improvement.
Top Skills:
Ansi Sql)BigQueryConfluenceGoogle Cloud Platform (Gcp)JIRAPythonSql (Bigquery Sql
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Own and modernize Upside s analytics data platform: migrate pipelines, reduce cost, improve governance, design reusable modeling/orchestration patterns, deliver domain-critical data products, lead cross-functional initiatives, mentor engineers, and support ML and product teams.
Top Skills:
AWSCi/CdDagsterDatabricksDbtSnowflakeTerraform
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
