Build and operate batch and streaming data pipelines on Google Cloud for analytics and machine learning. Ingest, transform, validate, and curate datasets in BigQuery; implement data quality, governance, security, monitoring, Terraform infrastructure, and CI/CD. Provide technical direction, lead code reviews, and document data processes. The role requires cloud data engineering experience, technical team leadership, strong SQL and Python skills, and eligibility for a federal Public Trust investigation.
Who we are...
Latitude is a growing Service-Disabled Veteran Owned (SDVOSB) Company within the Federal Sector. We have experience in working with various federal clients across multiple different agencies. We believe in adopting and growing a remote work-from-home culture wherever possible to ensure a healthy work-to-life balance. We believe in automating the mundane and investing in our employees helping them grow their careers over time. We strive for innovation and want to develop solutions that we can take pride in and help break through some of the barriers that exist in technology and the government sectors today.
We are hiring a Data Engineer to build and run the data pipelines behind analytics and machine learning work on Google Cloud Platform for a federal health customer. You will work with data architects, data scientists, ML engineers, and application teams to ingest, transform, and deliver curated datasets in BigQuery. The role sits on a cloud operations and migration team and includes technical leadership on data engineering standards and practices. This position is fully remote in the United States.
What you will do...
- Build, maintain, and optimize batch and streaming data pipelines on Google Cloud that support analytics and machine learning.
- Ingest data from APIs, databases, SaaS systems, streaming feeds, and files, then transform it and deliver curated datasets in BigQuery.
- Build data quality rules, schema validation, and automated tests into pipelines, and monitor pipeline health with Cloud Monitoring and Cloud Logging.
- Apply governance and security standards, including IAM, encryption, data masking, and auditing, and maintain pipeline infrastructure with Terraform and CI/CD.
- Provide technical direction on data engineering standards, lead code reviews, and document datasets, transformations, and operating procedures.
Minimum qualifications...
- Bachelor's degree in computer science, software engineering, information systems, data engineering, or a related technical field.
- 3+ years of hands-on data engineering experience, including building production data pipelines on a cloud platform.
- 3+ years leading technical teams, including setting technical standards and processes for cloud and on-premises environments and guiding technology decisions.
- Hands-on experience with BigQuery, Cloud Storage, Dataflow, Dataproc, and Pub/Sub.
- Strong SQL and Python, with experience in distributed data processing and data modeling.
- Experience transforming large datasets and delivering ML-ready datasets for model training.
- Ability to obtain and maintain a federal background investigation (Public Trust).
Preferred qualifications...
- Master's degree in a technical discipline.
- Experience supporting federal government programs, especially federal health.
- Knowledge of regulated environments: FedRAMP, HIPAA, NIST 800-53, CIS benchmarks.
- Experience with Vertex AI or other ML platforms, and with feature store concepts.
- Experience with Cloud Composer (Airflow), dbt, Dataplex, and Datastream for change data capture.
- Experience with Apache Kafka or other streaming technologies, and with Looker or Looker Studio.
- Security certification such as CISSP or CCSP.
Clearance...
Citizenship...
Applicants selected will be subject to a Security Investigation and May need to Meet Requirements for Access to Protected and/or Classified Information
Citizenship...
Applicants need to be a US Citizen to be considered for the position and have physically resided in the United States for a minimum of 3 years due to background investigation requirements.
- Medical, Vision, Dental
- Paid Vacation & Sick Time
- Paid Federal Holidays
- 401k Retirement Plan with 100% Company Matching
- Employer Paid Life Insurance
- Continued Education Assistance
- Employee Assistance Program (EAP)
- Commuter Benefits Program
- Health Savings Account (HSA)
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.
Top Skills:
Apache AirflowAWSAzureDagsterData LakeData ModelingData PipelinesDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills:
AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills:
Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
