Ayo Seminconductor Logo

Ayo Seminconductor

Machine Learning Architect

Reposted 18 Days Ago
Be an Early Applicant
In-Office
Boston, MA, USA
Expert/Leader
In-Office
Boston, MA, USA
Expert/Leader
The Machine Learning Architect will deploy models on prototype hardware, adapt algorithms for new environments, and collaborate with hardware engineers to define architecture based on practical insights.
The summary above was generated by AI

About Ayo

We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitude improvement in speed and power efficiency with a goal of unseating the GPU as the dominant computing platform for AI.

The Role

We are seeking a deep ML practitioner to join as a founding team member - someone with hands-on experience working on or alongside a foundation model at scale, who understands what happens under the hood when splitting jobs across thousands of GPUs, and who is excited to bring that depth to novel hardware. They have a full-stack understanding of machine learning architectures, love to optimize algorithms across disciplinary boundaries, and will deploy and train models directly on our prototype chips to help us prove out what our processor can do - no prior hardware experience required.

What You’ll Do:

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on our chips.

  • Develop and adapt algorithms to train models on novel processing environments, including our prototype hardware.

  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.

  • Maintain a deep curiosity about what makes machine learning systems work - and bring that curiosity to bear on how they run on new hardware.

  • Support go-to-market strategy development

What We’re Looking For:

  • PhD in machine learning, representation learning, theory of computation, or a related field - or equivalent industry experience working on foundation models at scale.

  • Experience training models at scale - distributed training across many GPUs, working with large datasets and compute.

  • Has built and trained neural networks from scratch

  • Deep knowledge of the structure and internal operation of neural networks - including how and why they behave the way they do (e.g. interpretability or explainability work is a plus).

  • Excitement about applying deep AI expertise to new and novel hardware environments - you don’t need prior experience with photonics or silicon, but you want to learn.

  • Fluent knowledge of Python

  • Fluency in PyTorch (preferred), TensorFlow, JAX, or other industry-standard ML software libraries

Why Ayo

  • You'll be a founding AI team member - shaping how we think about and deploy AI as a company.

  • We are working on a genuinely hard and interesting problem: unseating the GPU as the dominant AI compute platform.

  • Early-stage means real ownership, real impact, and meaningful equity.

  • Competitive salary. Equity commensurate with stage and seniority. Benefits package including health, dental, and vision.

  • Fully onsite in Boston - we are a collaborative, in-person team.

Similar Jobs

2 Days Ago
In-Office or Remote
United States
79K-276K Annually
Senior level
79K-276K Annually
Senior level
Agency • Information Technology
Build and scale production Generative AI applications: design multi-agent systems and LangGraph workflows, implement advanced RAG with LlamaIndex and vector DBs, integrate and fine-tune various LLMs, and deploy containerized FastAPI services with monitoring, CI/CD, and performance/cost optimizations.
Top Skills: Api SecurityAsync PythonCi/CdClaudeDockerEmbedding ModelsFastapiGeminiGenai OptimizationHugging FaceLangchainLanggraphLlamaLlamaindexLlm MonitoringLlm QuantizationLocal Llm DeploymentModel Fine-TuningMulti-Agent SystemsOpenaiPostgresPrompt EngineeringPythonPyTorchTensorFlowVector DatabasesVector SearchWorkflow Design
33 Minutes Ago
Easy Apply
Hybrid
Somerville, MA, USA
Easy Apply
20-25 Hourly
Internship
20-25 Hourly
Internship
Enterprise Web • Hardware • Internet of Things • Software
Support day-to-day office operations: troubleshoot and set up equipment, manage inventory, mail, and hardware fulfillment, monitor the Operations Jira board and inbox, procure supplies, and support company events and workplace culture initiatives.
Top Skills: Ai TechnologiesJIRATulip Platform
33 Minutes Ago
Easy Apply
Hybrid
Somerville, MA, USA
Easy Apply
160K-200K Annually
Senior level
160K-200K Annually
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Lead observability efforts: mentor teams on SLIs/SLOs and reliability, own incident response and production debugging, maintain triage/remediation processes, and design, build, and operate core observability infrastructure and tooling used across engineering.
Top Skills: AlloyClaude SkillsGemini GemsGoGrafanaKubernetesLokiMimirMongoDBOpentelemetryPostgresPrometheusPromqlTempoTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account