Top Tech Jobs & Startup Jobs in Boston, MA

Define multi-generation hardware/software architectures for AI inference silicon, including boot, memory, DMA, scheduling, security, telemetry, and host/device interfaces. Integrate firmware, Linux, runtimes, simulation, and developer tooling; lead architecture reviews; resolve cross-team technical issues; prototype high-risk interfaces; and mentor senior engineers. The role requires deep systems expertise, strong C or C++ skills, and architecture-level ownership across pre-silicon, silicon bring-up, and production software.

Build simulation and modeling infrastructure for AI inference accelerators before silicon availability. Develop analytical performance models, functional and timing simulators, virtual platforms, and software integrations. Validate functionality and performance against reference implementations and hardware, improve simulator speed and usability, and create automated regression coverage. Collaborate with hardware, compiler, firmware, runtime, performance, and test engineers to support architecture exploration and realistic software workloads.

Owns AI-assisted engineering across accelerator software teams, embedding agentic workflows into coding, debugging, triage, testing, documentation, CI, and silicon-debug processes. Builds shared agent tooling, maintains evaluations, measures productivity gains, and establishes standards for reliable AI-native development. Requires expert experience with Codex, Claude Code, LLM APIs, evaluations, and adopted developer tooling, plus strong systems or infrastructure credibility.

The Senior Software Engineer will develop high-performance software for executing open-source LLMs on custom hardware, focusing on optimizations and efficient libraries primarily in C++.

Own technical product planning for AI inference software: define requirements across model coverage, numerics, inference engine and serving-stack features, roadmap planning, ecosystem engagement, documentation, lifecycle management, and automation using agentic AI. Translate model and system trends into engineering scope and partner with engineering and GTM teams to deliver a managed inference service.

Lead technical product planning for silicon and rack-scale inference systems: write PRDs, define SKU and lifecycle strategy, translate customer and market signals into engineering requirements, perform performance and cost modeling, maintain competitive and partner intelligence, and streamline product planning using agentic AI.