Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.
About Urban SDK
Urban SDK is shaping the Future of Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with insights and automation for mission-critical decisions. We equip critical public services with geospatial AI, enabling precise, data-driven decisions with efficiency and confidence.
Our Commitment to PeopleWe are committed to aligning business growth with professional outcomes for every employee. Our commitment has been recognized by Jacksonville Business Journal and Will Reed as a noted Best Places to Work.
About the role
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial traffic analytics applications. The ideal candidate will have experience with Python, Databricks, S3, and modern data engineering practices, including automated testing, CI/CD, and data quality monitoring.
Responsibilities
- Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks and cloud platforms.
- Manage large-scale geospatial and temporal datasets stored in AWS S3.
- Collaborate with data scientists to productionize machine learning models and ensure smooth data availability.
- Implement data validation, testing, and monitoring frameworks to ensure data accuracy, consistency, and reliability.
- Optimize data storage and processing strategies to handle high volumes of traffic and mobility data efficiently.
- Develop and maintain documentation for data workflows, architecture, and processes.
- Work closely with cross-functional teams to understand data requirements and ensure timely delivery.
- Stay up-to-date with the latest trends and best practices in data engineering, cloud technologies, and big data processing.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 3+ years of experience as a data engineer or in a similar role.
- Strong proficiency in Python and associated libraries for data engineering (pandas, PySpark, etc.).
- Hands-on experience with Databricks and Spark for large-scale data processing.
- Experience with AWS services, especially S3, and knowledge of cloud-based data architectures.
- Solid understanding of data pipeline testing, version control, and CI/CD practices.
- Experience with SQL and NoSQL databases.
- Strong problem-solving skills and attention to detail.
Preferred Skills
- Familiarity with geospatial data formats and processing (GeoJSON, Shapefiles, PostGIS).
- Experience with workflow orchestration tools (Databricks, Prefect, or similar).
- Knowledge of containerization (Docker/Kubernetes) and cloud-native data solutions.
- Experience supporting machine learning pipelines in production.
Compensation
- Location: Jacksonville, FL (Town Center Area) or Remote
- Type: Full-time
- Reports to: Director of Engineering
- Salary Based on Experience
- Annual Bonus
- Medical, Vision, Dental, 401(k)
- 21 Days Vacation
- Office Lunch provided Daily
Top Skills
AWS
Aws S3
Ci/Cd
Databricks
NoSQL
Pandas
Pyspark
Python
Spark
SQL
Version Control
Similar Jobs
.png)
Artificial Intelligence • Fintech • Information Technology • Machine Learning • Financial Services
The Data Engineer will design and build scalable data systems, contribute to the architecture of the data platform, and collaborate with AI/ML engineers to enhance automation and intelligence in Canoe's systems.
Top Skills:
AirflowAWSDbtKafkaPostgresRedshiftSnowflakeSQL
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Principal Data Engineer will lead data engineering efforts on public cloud, design scalable solutions, build data pipelines, and drive deliverables with a high level of technical expertise in relevant technologies.
Top Skills:
AdfAzureCi/CdContainersDatabricksDelta LakeDockerJenkinsKafkaSnowflakeSparkTerraform
Fintech • Machine Learning • Payments • Software • Financial Services
The Senior Distinguished Data Engineer will architect and deliver data solutions for Compliance and AML, mentor talent, and drive modern tech adoption.
Top Skills:
AWSPythonScalaSQL
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
