State Street Logo

State Street

AI System Design Architect, Vice President

Posted 18 Days Ago
Be an Early Applicant
In-Office
2 Locations
120K-218K Annually
Expert/Leader
In-Office
2 Locations
120K-218K Annually
Expert/Leader
Leads enterprise-wide AI architecture strategy across the Generative AI platform stack. Defines reference architectures, cloud standards, integration patterns, governance controls, and scalable designs for RAG, model serving, agentic workflows, and AI applications. Guides modernization, build-versus-buy decisions, technical due diligence, and production onboarding while ensuring security, resilience, compliance, interoperability, and cost efficiency. Partners with executives, engineering, security, risk, data, and operations teams, chairs architecture governance forums, and mentors architects and engineering leaders.
The summary above was generated by AI

About the Role

We are seeking an experienced AI System Design Architect (VP) to lead enterprise AI system architecture strategy across the full Generative AI platform stack. This role requires deep expertise in Generative AI, enterprise architecture, platform engineering, distributed systems, and scalable cloud architectures on AWS, Azure, or Google Cloud Platform (GCP).

The ideal candidate will define architecture direction, technology standards, and cloud design principles for AI platforms and shared services across the organization. This role will shape modernization priorities, represent Architecture in senior leadership and governance forums, and ensure AI systems are designed for security, resiliency, compliance, interoperability, and long-term scalability.


Key Responsibilities

  • Own and drive enterprise-wide AI system architecture strategy across the full GenAI platform stack, including shared services, orchestration layers, model integration, APIs, data flows, and downstream enterprise systems.
  • Define and govern reference architectures, design standards, architecture principles, integration patterns, and cloud design approaches for AI platforms and AI-enabled applications.
  • Provide strategic technical leadership on scalable, secure, resilient, and compliant AI system design across the organization.
  • Lead architecture decisions for cloud and hybrid AI environments on AWS, Azure, or Google Cloud, ensuring interoperability, platform reuse, cost efficiency, and operational excellence.
  • Establish reusable enterprise patterns for RAG, model serving, prompt orchestration, agentic AI workflows, AI gateways, and service integration.
  • Chair or lead architecture governance forums, reviewing major solution designs, resolving technical trade-offs, and ensuring alignment to enterprise standards.
  • Partner closely with business leaders, product teams, engineering, cloud, security, risk, data, and operations teams to align architecture strategy with business priorities.
  • Ensure AI solutions comply with Responsible AI, governance, data controls, model risk, testing standards, security requirements, and regulatory expectations.
  • Drive architecture assessments, technical due diligence, platform modernization, proof-of-concept direction, and production onboarding standards for AI systems.
  • Guide enterprise decisions on platform capabilities, shared services, build-vs-buy evaluations, and modernization opportunities.
  • Influence and mentor architects and engineering leaders to improve design quality, architectural consistency, and adoption of enterprise AI standards.
  • Represent the Architecture function in senior governance and leadership forums.

Required Qualifications

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Mathematics, or a related discipline; Master’s degree preferred.
  • 12–17 years of experience in solution architecture, enterprise application architecture, platform architecture, or AI/ML architecture, including leadership of large-scale enterprise initiatives.
  • Deep hands-on and architectural experience with Generative AI, LLMs, ML systems, RAG, vector databases, prompt design/orchestration, and AI application integration.
  • Proven expertise in cloud architecture and enterprise solution design on AWS, Azure, or Google Cloud Platform (GCP).
  • Strong understanding of cloud-native architecture including AI/ML services, networking, storage, security, IAM, resilience, and performance optimization.
  • Proven experience designing enterprise-scale, secure, resilient, and high-performing architectures for AI and data-driven applications.
  • Expertise in API architecture, microservices, distributed systems, event-driven patterns, enterprise integration, and platform design.
  • Strong understanding of AI governance, Responsible AI, model risk, compliance, testing, production controls, and control frameworks.
  • Strong understanding of DevSecOps, CI/CD, observability, monitoring, reliability engineering, and platform engineering concepts.
  • Demonstrated ability to lead architecture discussions with senior executives and communicate effectively with both technical and non-technical stakeholders.
  • Strong leadership, stakeholder management, problem-solving, and cross-functional collaboration skills.

Location & Work Schedule

This role follows a hybrid work model and requires regular on-site presence in one of the following locations:

  • Boston, MA
  • Austin, TX
  • Princeton, NJ

Salary Range:

$120,000 - $217,500 Annual

The range quoted above applies to the role in the location specified. If the candidate would ultimately work outside of the location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.


About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.


We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.


As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.


Discover more information on jobs at StateStreet.com/careers


Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

HQ

State Street Boston, Massachusetts, USA Office

Boston, MA, United States

State Street Boston, Massachusetts, USA Office

Boston, United States

State Street Cambridge, Massachusetts, USA Office

Cambridge, United States

State Street Quincy, Massachusetts, USA Office

Quincy, United States

State Street Waltham, Massachusetts, USA Office

Waltham, United States

State Street Westwood, Massachusetts, USA Office

Westwood, United States

State Street Weymouth, Massachusetts, USA Office

Weymouth, United States

Similar Jobs

An Hour Ago
In-Office
100K-100K Annually
Senior level
100K-100K Annually
Senior level
Information Technology • Internet of Things • Mobile • On-Demand • Software
Acquire residential customers in large multi-dwelling properties through door-to-door sales of Spectrum connectivity services. Meet monthly sales and penetration targets, generate additional revenue from existing customers, resolve customer concerns, track competitor offerings, complete sales documentation, collect payments, and participate in training. The role is primarily outdoors, requires variable scheduling, and involves walking extensively and lifting up to 20 pounds.
Top Skills: Cable ServicesData NetworkingInternetMobile CommunicationsTelecommunicationsTelevision
An Hour Ago
In-Office
100K-100K Annually
Junior
100K-100K Annually
Junior
Information Technology • Internet of Things • Mobile • On-Demand • Software
Acquire residential telecommunications customers through door-to-door outreach, needs analysis, consultative product presentations, order entry, and sales documentation. Achieve monthly sales targets across internet, mobile, phone, and video services while monitoring competitors and participating in meetings and training. The role is primarily outdoors, requires local territory travel, evening and weekend availability, independent work, and use of a reliable personal vehicle.
Top Skills: Computer Operating SystemsData NetworkingHigh-Speed DataLandline TelephoneMobile CommunicationsModemsRoutersSet-Top ConvertersSmartphonesSoftware ApplicationsTelecommunications ServicesVideo ServicesWireless Devices
An Hour Ago
In-Office
Senior level
Senior level
Marketing Tech
Own end-to-end product design for major areas of a B2B adtech platform, translating complex campaign, targeting, attribution, and reporting concepts into intuitive workflows. Lead research, create wireframes and prototypes in Figma, maintain the design system, partner with Product and Engineering to ship products, mentor designers, and communicate design decisions to stakeholders.
Top Skills: AIFigma

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account