Top Tech Jobs & Startup Jobs in Boston, MA

Build and operationalize production AI solutions for federal clients, from stakeholder discovery and architecture through evaluation, deployment, governance, monitoring, and optimization. Develop LLM applications using retrieval, structured outputs, tool use, and agentic workflows. Define quality metrics, create evaluation sets, document limitations, advise clients on AI use cases, and mentor engineers while contributing to reusable internal patterns and products.

Owns AI capabilities end to end, from stakeholder discovery and technical design through development, evaluation, deployment, monitoring, and documentation. Builds LLM applications using retrieval, structured extraction, tool use, and agent patterns; defines measurable quality criteria; balances accuracy, cost, latency, security, and complexity; supports client delivery and proofs of concept; and mentors engineers new to AI.

Build production-quality AI applications for federal clients and internal products. Responsibilities include gathering requirements, designing prompts and retrieval workflows, integrating APIs and data, creating evaluations, investigating failures, documenting limitations, and supporting proofs of concept and client demonstrations. The role requires client-facing communication, comfort with ambiguity, and the ability to translate business needs into working software.

Leads a team of test specialists and owns system, regression, performance, integration, acceptance, end-to-end, and automated testing programs. Develops test strategies, translates requirements into test objectives, builds UiPath automation, analyzes defects and test results, and provides recommendations to government stakeholders. Requires Agile experience, test leadership, 5+ years of software testing experience, relevant certification, and an IT-II Non-Critical Sensitive clearance.