State Street Logo

State Street

AI Systems Design Architect - Assistant Vice President

Posted Yesterday
Be an Early Applicant
In-Office
3 Locations
90K-158K Annually
Expert/Leader
In-Office
3 Locations
90K-158K Annually
Expert/Leader
Owns end-to-end architecture for a major generative AI platform and shared AI services. Responsibilities include designing model integrations, APIs, data flows, orchestration, RAG and agentic workflows; defining architecture standards, integration contracts, and non-functional requirements; ensuring security, resilience, compliance, governance, observability, and scalability; and conducting architecture reviews and proof-of-concept assessments. The role partners with product, engineering, data science, cloud, security, and control teams to deliver production-ready enterprise AI systems.
The summary above was generated by AI
We are seeking an AI System Design Architect (AVP) with strong expertise in Generative AI, Machine Learning, enterprise architecture, cloud platforms, and scalable solution design. This role will own end-to-end system design for a major GenAI platform and shared AI services, ensuring solutions are secure, resilient, compliant, and aligned with enterprise architecture standards.

The ideal candidate will translate business and platform requirements into robust technical architectures across the AI stack, define architecture patterns and integration contracts, establish non-functional requirements, and provide architecture reviews across pods. This role requires close collaboration with product, engineering, data science, cloud, and control teams to drive scalable, production-grade AI solutions.

Key Responsibilities

  • Own end-to-end architecture and system design for a major AI platform domain, including model integration, orchestration, APIs, data flows, and downstream system interactions.

  • Define and implement reference architectures, design standards, integration contracts, and non-functional requirements (NFRs) for the platform area.

  • Translate business and product requirements into scalable, secure, resilient, and maintainable AI solution designs.

  • Partner with business stakeholders, product managers, engineers, data scientists, platform teams, and security teams to deliver enterprise-ready AI systems.

  • Design solutions leveraging cloud architecture principles on AWS, Azure, or Google Cloud, ensuring interoperability, scalability, observability, and operational readiness.

  • Establish reusable architecture patterns for RAG, model serving, prompt workflows, agentic AI workflows, and AI application integration.

  • Ensure alignment with Responsible AI, model governance, data handling, compliance, testing, risk, and production control requirements.

  • Conduct architecture assessments, technical design reviews, and proof-of-concept evaluations for new AI use cases and platform capabilities.

  • Review solution designs across pods and provide guidance on architecture decisions, trade-offs, and standards adherence.

  • Partner with engineering and DevSecOps teams to support production readiness, release architecture, monitoring, and scalability planning.

Required Qualifications

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.

  • 8–14 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture.

  • Strong hands-on experience with Generative AI, LLMs, ML systems, RAG architectures, vector databases, and AI application integration.

  • Proven experience in cloud architecture and solution design on at least one major cloud platform: AWS, Azure, or Google Cloud Platform (GCP).

  • Strong understanding of cloud-native services including compute, storage, networking, identity and access management, security, and AI/ML services.

  • Expertise in API architecture, microservices, distributed systems, event-driven architecture, and system integration patterns.

  • Experience designing solutions with strong security, resiliency, scalability, observability, and performance considerations.

  • Working knowledge of AI governance, Responsible AI, model risk, compliance, testing, and operational controls.

  • Ability to lead architecture discussions and clearly communicate complex technical concepts to technical and business stakeholders.

  • Strong collaboration, problem-solving, and stakeholder management skills.

Salary Range:

$90,000 - $157,500 Annual

The range quoted above applies to the role in the location specified. If the candidate would ultimately work outside of the location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

HQ

State Street Boston, Massachusetts, USA Office

Boston, MA, United States

State Street Boston, Massachusetts, USA Office

Boston, United States

State Street Cambridge, Massachusetts, USA Office

Cambridge, United States

State Street Quincy, Massachusetts, USA Office

Quincy, United States

State Street Waltham, Massachusetts, USA Office

Waltham, United States

State Street Westwood, Massachusetts, USA Office

Westwood, United States

State Street Weymouth, Massachusetts, USA Office

Weymouth, United States

Similar Jobs

9 Days Ago
In-Office
2 Locations
90K-158K Annually
Senior level
90K-158K Annually
Senior level
Financial Services
Lead end-to-end architecture for a major Generative AI platform: define reference architectures, integration contracts, NFRs, and reusable patterns (RAG, model serving, prompt/agent workflows). Partner with product, engineering, data science, cloud, security, and DevSecOps to ensure secure, scalable, compliant, and production-ready AI solutions. Conduct design reviews, proofs-of-concept, and drive platform governance and operational readiness.
Top Skills: Agentic AiApi ArchitectureAWSAzureCloud-Native ServicesDevsecopsDistributed SystemsEvent-Driven ArchitectureGenerative AiGoogle Cloud PlatformIdentity And Access ManagementLlmsMachine LearningMicroservicesModel ServingObservabilityPrompt WorkflowsRag ArchitecturesSecurity And ComplianceVector Databases
3 Minutes Ago
Hybrid
185K-295K Annually
Senior level
185K-295K Annually
Senior level
AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Leads architecture and development of scalable, AI-powered travel experiences. Responsibilities include high-level system design, cross-service integration, AI/ML adoption, agentic AI development, feedback and evaluation pipelines, operational excellence, incident response, technical vision, and mentoring engineers. The role requires driving reliable production systems, model governance, safety, observability, and continuous improvement across teams and domains.
Top Skills: Ai Observability FrameworksArtificial Intelligence/Machine Learning (Ai/Ml)Automated Evaluation PipelinesC#Human-In-The-Loop WorkflowsJavaKotlinLanggraphLarge Language Models (Llms)Multi-Agent ArchitecturesPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)
3 Minutes Ago
Hybrid
Boston, MA, USA
77K-202K Annually
Senior level
77K-202K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Develop and customize insurance applications on the Guidewire platform (PolicyCenter, BillingCenter, ClaimCenter). Design, code, test solutions using OOP and Guidewire technologies, manage system configurations, mentor junior staff, build client relationships, and apply firm methodologies to deliver high-quality insurance technology solutions.
Top Skills: Business RulesGosuGuidewire BillingcenterGuidewire ClaimcenterGuidewire Cloud ApisGuidewire Integration FrameworkGuidewire PlatformGuidewire PolicycenterObject Oriented ProgrammingPcfsRest Client ApiSoap ApiSpring BootUnderwriting Rules

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account