Are you passionate about building innovative technology that powers AI and machine learning across a global organization? As part of our team, you’ll help shape the future of model deployment at scale, collaborating with talented engineers and data scientists. You’ll have the opportunity to work on impactful projects, grow your skills, and contribute to a platform that drives real business outcomes. We value creativity, collaboration, and a commitment to excellence.
As a Lead Software Engineer at JPMorgan Chase within Firmwide AI/ML Deployment Platform team, you will work closely with engineers to design, build, and deploy an AI solution that unifies observability data across multi-cloud environments (AWS, Azure, GCP). You will create intelligent systems that correlate cross-platform health metrics, logs, and traces to generate actionable troubleshooting recommendations and automations, enabling self-service remediation, predicting system outages before they occur, and directly reducing ticket volume by identifying and resolving repeated IT incidents. This role bridges the gap between machine learning, multi-cloud infrastructure, and automated IT operations to build predictive, self-healing solutions.
Job responsibilities
- Build and deploy infrastructure solutions for seamless integration of control plane and user accounts
- Design pipelines to ingest, aggregate, and correlate telemetry data (metrics, logs, traces) from multi-cloud infrastructures.
- Architect and implement closed-loop automation playbooks that allow infrastructure to auto-remediate common, repeatable failure modes without human intervention.
- Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
- Build and operationalize LLM/machine learning models for anomaly detection, predictive health monitoring, and forecasting system degradations.
- Integrate the AI engine with ticket data and map observability insights against ticket trends, cluster repetitive issues, and quantify the platform's impact on reducing Mean Time to Resolution (MTTR).
- Create user-friendly self-service portals or conversational AI interfaces that allow non-expert teams to diagnose and fix infrastructure issues safely.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience
- AI/ML & Data Science: Strong proficiency in Python, Java alongside experience integrating LLM / ML models. Familiarity with time-series forecasting data analysis pipelines and Natural Language Processing (NLP) for log/ticket clustering is essential. Good understanding of agentic AI concepts (A2A, MCPs, Skills, RAG, etc)
- Automation & Orchestration: Advanced experience with configuration management tools and automated workflow engines.
- Integration: Hands-on experience building custom webhooks, APIs, and integrations with ticketing systems like ServiceNow or Jira Service Management.
- Big Data Pipelines: Competency in managing large-scale, streaming data infrastructure using cloud-native data warehouses (e.g. Snowflake)
- Cloud & Infrastructure: Expertise in multi-cloud architectures across Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP) including on-prem.
- Observability Frameworks: Experience with enterprise observability stacks such as OpenTelemetry, Prometheus, Dynatrace
- Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
- Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
Preferred qualifications, capabilities, and skills
- Practical experience applying generative AI and agentic workflows to accelerate development (e.g., AI-assisted code and test generation, refactoring, documentation), with strong judgment, governance, and quality control over AI-produced outputs.
- Experience optimizing performance and reliability of AI-powered user interfaces & proficiency in React framework
- Knowledge of multi clouds domains
- Experience working with LLMs
- Experience in API development and design
About Us
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
High Risk Roles (HRR) are sensitive roles within the technology organization that require high assurance of the integrity of staff by virtue of 1) sensitive cybersecurity and technology functions they perform within systems or 2) information they receive regarding sensitive cybersecurity or technology matters. Users in these roles are subject to enhanced pre-hire screening which includes both criminal and credit background checks (as allowed by law). The enhanced screening will need to be successfully completed prior to commencing employment or assignment.
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
