Veeda AI Logo

Veeda AI

Senior Machine Learning Engineer — Data Infrastructure

Posted 3 Days Ago
Remote or Hybrid
Hiring Remotely in California, USA
Senior level
Remote or Hybrid
Hiring Remotely in California, USA
Senior level
Design, build, and operate large-scale crawling, ingestion, and ETL/ELT pipelines for petabyte-scale image and video datasets. Optimize distributed processing (Ray/Spark/Dask), ensure dataset provenance/versioning, reduce cost/latency, and collaborate with CV engineers and ML scientists. Provide technical leadership and mentor junior engineers.
The summary above was generated by AI
About Us

Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most challenging problems at the intersection of AI, robotics, and embodied intelligence. If you're excited about pushing the boundaries of what's possible with Physical AI, you'll have the opportunity to make an outsized impact from day one.

Responsibilities
  • Crawling & Ingestion at Scale: Architect and own the scraping and crawling infrastructure that acquires petabytes of image and video data — designing systems that are resilient, compliant, and able to keep pace with a fast-moving content landscape.

  • Image-Data Pipeline Design: Build and maintain production data pipelines that clean, transform, and process raw visual assets—handling format diversity, resolution variance, metadata extraction, and noise at scale.

  • ETL/ELT for Training & Evaluation: Design ETL/ELT workflows that prepare image and video datasets for ML model training and evaluation, including annotation ingestion, quality scoring, and reproducible dataset versioning.

  • Performance & Cost Optimization: Continuously profile and optimize pipelines for throughput, latency, and cloud storage/compute costs—ensuring research velocity without unnecessary overhead.

  • Distributed Processing Ownership: Select, deploy, and operate distributed data-processing frameworks (e.g., Ray, Spark, Dask) to handle compute-intensive tasks like large-batch image transformation, embedding generation, and feature extraction.

  • Cross-Functional Partnership: Work directly with Computer Vision Engineers, ML Scientists, and product teams to translate data requirements into reliable, well-documented pipelines and close the feedback loop between model performance and data quality.

  • Technical Leadership: Lead data-pipeline design reviews, mentor junior and mid-level data engineers, establish best practices for the data team, and raise the overall engineering bar.

Requirements
  • You have 5+ years of professional experience in data engineering or a closely related discipline with a strong foundation in distributed systems, database design, and handling large binary assets (images, video) at scale.

  • You possess strong programming skills in Python and SQL, with proven experience designing end-to-end production systems rather than basic scripts.

  • You have designed and operated web scraping or data ingestion systems running reliably in production at significant global scale.

  • You are hands-on with data-processing frameworks (e.g., PySpark, Pandas, Ray) and comfortable with image-processing libraries (OpenCV, Pillow, scikit-image).

  • You have built ETL/ELT pipelines for ML/CV use cases with a strong emphasis on dataset provenance, lineage, and reproducibility.

  • You have extensive experience with cloud object storage (AWS S3, GCP GCS) and understand the cost, latency, and durability trade-offs when managing petabyte-scale data assets.

  • Production Quality, Agent Velocity: Your daily workflow runs through AI coding harnesses (e.g., AI agents/assistants) without sacrificing software engineering rigor. You review agent code diffs with the same scrutiny as a team member's PR, recognize AI code generation failure modes, and ship rapidly without introducing technical debt or "slop."

Nice to Have
  • Experience with Ray for distributed data processing or ML-adjacent workflows.

  • Hands-on experience with data orchestration platforms (e.g., Airflow, Dagster, Prefect) to manage complex processing DAGs in production.

  • Familiarity with Computer Vision concepts and image annotation formats (COCO, PASCAL VOC, YOLO).

  • Practical knowledge of MLOps concepts, including data versioning (e.g., DVC, LakeFS) and experiment tracking for CV pipelines.

  • Experience with containerization (Docker) and orchestration (Kubernetes) for scaling data processing workloads.

  • Experience navigating multi-region data compliance challenges (GDPR, content licensing, and image rights across jurisdictions).

Similar Jobs

16 Hours Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The Account Executive will drive new customer acquisition and revenue, self-prospecting to build sales pipelines, and collaborating with marketing and sales teams. Responsibilities include understanding customer needs in voice AI, articulating Deepgram's value, and managing existing accounts for upsell opportunities.
Top Skills: AIAPIsMlSpeech-To-SpeechSpeech-To-TextText-To-Speech
Yesterday
Remote
United States
192K-287K Annually
Senior level
192K-287K Annually
Senior level
Artificial Intelligence • Productivity • Software • Automation
As a Sr. Applied AI Engineer at Zapier, you will build and enhance AI platform capabilities, focusing on LLM Ops and ML Ops to support scalable AI development across teams.
Top Skills: Cloud InfrastructureLlm OpsMl OpsPythonTypescript
Yesterday
Remote
2 Locations
244K-244K Annually
Expert/Leader
244K-244K Annually
Expert/Leader
Information Technology
As the Director of Data Science, you'll mentor teams, oversee projects, drive data-driven decisions, and implement AI and ML solutions while enhancing our data pipeline.
Top Skills: BigQueryClickhouseDruidMlNlpPythonRedshiftSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account