Design and maintain data pipelines for geospatial and optimization workflows, integrating data sources, and optimizing algorithms within simulation environments.
We are looking for a motivated and skilled Data Engineers with a solid foundation in data pipeline development, geospatial data handling, and optimization algorithms. This role involves working with cutting-edge technologies including 3D simulation platforms, real-time data integration, and advanced optimization tools. You will contribute to the design, implementation, and optimization of data-driven solutions within simulation environments. The ideal candidate is passionate about technology, eager to work on innovative projects, and capable of collaborating across multidisciplinary teams.
Requirements
- 1 to 4 years of experience in data engineering, with exposure to geospatial data and optimization algorithms.
- Proficiency in Python and SQL.
- Experience with Apache Spark and Databricks.
- Familiarity with 3D simulation platforms is highly desirable.
- Knowledge of optimization tools such as CuOpt, Gurobi, or CPLEX.
- Experience with cloud platforms (AWS, Azure) and scalable data architectures.
- Strong analytical and problem-solving abilities.
- Good communication and teamwork skills.
- Fluent English is mandatory.
Responsibilities
- Design, develop, and maintain data pipelines supporting geospatial and optimization workflows.
- Integrate data sources such as Apache Kafka, S3, and others into simulation environments.
- Develop and optimize real-time pipelines using tools like Apache Spark and Databricks.
- Implement and customize optimization algorithms or modules (e.g., CuOpt, Gurobi, CPLEX) for enhanced system performance.
- Collaborate with cross-functional teams including data scientists and engineers to deliver impactful simulation and decision-making tools.
- Analyze and improve the performance and scalability of systems and algorithms.
- Work with cloud platforms (AWS, Azure) to deploy and manage data and optimization solutions.
- Maintain geospatial databases using tools like PostGIS and ArcGIS.
Top Skills
Apache Kafka
Spark
Arcgis
AWS
Azure
Cplex
Cuopt
Databricks
Gurobi
Postgis
Python
SQL
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech
As a Senior Data Scientist, you will design AI-enabled genomics algorithms, analyze clinical data, and collaborate with interdisciplinary teams to optimize patient care and advance medical research.
Top Skills:
Python,Pandas,Scikit-Learn,Lifelines,Jupyter,Sql,Bigquery,Docker,Git,Cloud Computing
eCommerce • Food • Software
Lead predictive modeling for HR insights, develop analytics solutions, analyze datasets, and collaborate with stakeholders to drive data-driven decisions.
Top Skills:
GreenhouseLookerPythonRSnowflakeSQLTableauWorkday
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
As a Researcher at Apollo.io, you will conduct user research, develop personas, and collaborate with teams to improve user experience and product strategy.
Top Skills:
Data Analysis TechniquesMixed MethodsQualitative ResearchQuantitative ResearchSurvey SoftwareUsability Testing
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
