Ayo Seminconductor Logo

Ayo Seminconductor

AI Lead

Reposted 26 Days Ago
Be an Early Applicant
In-Office
Boston, MA, USA
Senior level
In-Office
Boston, MA, USA
Senior level
As an AI Lead, you will deploy models on prototype hardware, develop algorithms, work with hardware engineers to refine architecture, and support market strategy development.
The summary above was generated by AI

About Ayo

We are a venture-backed early-stage startup developing processors specialized for machine learning. The processor will provide orders or magnitude improvement in speed and power efficiency with a goal of unseating the GPU as the dominant computing platform for AI.

The Role

We are seeking a deep AI practitioner to join as a founding team member - someone with hands-on experience working on or alongside a foundation model at scale, who understands what happens under the hood when splitting jobs across thousands of GPUs, and who is excited to bring that depth to novel hardware. They have a full-stack understanding of machine learning architectures, love to optimize algorithms across disciplinary boundaries, and will deploy and train models directly on our prototype chips to help us prove out what our processor can do - no prior hardware experience required.

What You’ll Do:

  • Deploy and run trained models on prototype hardware and digital twins, producing working demonstrations on our chips.

  • Develop and adapt algorithms to train models on novel processing environments, including our prototype hardware.

  • Work with hardware engineers to define and refine processor architecture based on insights learned through model training and experimentation.

  • Maintain a deep curiosity about what makes AI systems work - and bring that curiosity to bear on how they run on new hardware.

  • Support go-to-market strategy development

What We’re Looking For:

  • PhD in machine learning, representation learning, theory of computation, or a related field - or equivalent industry experience working on foundation models at scale.

  • Experience training models at scale - distributed training across many GPUs, working with large datasets and compute.

  • Has built and trained neural networks from scratch

  • Deep knowledge of the structure and internal operation of neural networks - including how and why they behave the way they do (e.g. interpretability or explainability work is a plus).

  • Excitement about applying deep AI expertise to new and novel hardware environments - you don’t need prior experience with photonics or silicon, but you want to learn.

  • Fluent knowledge of Python

  • Fluency in PyTorch (preferred), TensorFlow, JAX, or other industry-standard ML software libraries

Why Ayo

  • You'll be a founding AI team member - shaping how we think about and deploy AI as a company.

  • We are working on a genuinely hard and interesting problem: unseating the GPU as the dominant AI compute platform.

  • Early-stage means real ownership, real impact, and meaningful equity.

  • Competitive salary. Equity commensurate with stage and seniority. Benefits package including health, dental, and vision.

  • Fully onsite in Boston - we are a collaborative, in-person team.

Similar Jobs

2 Days Ago
Hybrid
Cambridge, MA, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the design, development, deployment, and support of scalable AI systems, including foundation model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability. Develop optimization techniques to improve AI system scalability, latency, throughput, hardware utilization, and cost. Shape foundational AI roadmaps, collaborate with cross-functional teams, and mentor engineers while applying emerging research to production.
Top Skills: AWSAws UltraclustersAzureC#C++Foundation ModelsGoGCPHugging FaceJavaLarge Language ModelsMachine LearningNemo GuardrailsPythonPyTorchScalaSimilarity SearchVectordbs
2 Days Ago
Hybrid
Cambridge, MA, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support foundational AI systems, including model training, LLM inference, similarity search, guardrails, evaluation, governance, and observability. Optimize large-scale AI systems for scalability, latency, throughput, hardware utilization, and cost. Partner with research, engineering, product, and program teams; apply emerging AI research in production; shape technical roadmaps; and lead or mentor engineering teams.
Top Skills: AWSAws UltraclustersAzureC#C++Foundation ModelsGoGCPHugging FaceJavaLarge Language ModelsNemo GuardrailsPythonPyTorchScalaSimilarity SearchVector DatabasesVision-Language Models
4 Days Ago
Hybrid
Cambridge, MA, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the design, development, deployment, and support of scalable AI platform components, including foundation model training, LLM inference, similarity search, guardrails, evaluation, governance, experimentation, and observability. Optimize AI training and inference for latency, throughput, cost, and hardware utilization. Partner with engineering, research, product, and program teams while contributing to technical strategy and mentoring stakeholders.
Top Skills: AWSAws UltraclustersAzureC#C++GoGCPHugging FaceJavaNemo GuardrailsPythonPyTorchScalaVectordbs

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account