Compass Logo

Compass

Senior Engineering Manager

Reposted 4 Hours Ago
Be an Early Applicant
In-Office
Boston, MA, USA
226K-251K Annually
Senior level
In-Office
Boston, MA, USA
226K-251K Annually
Senior level
Lead a hybrid AI engineering team to build and operate foundational AI platform primitives (agent orchestration, LLM gateway, telemetry, secure caching). Partner with business departments to deploy domain-specific automations, ensure AI governance and security compliance, define performance metrics, and make data-driven resourcing decisions while communicating technical strategy to stakeholders.
The summary above was generated by AI

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

As the Senior Engineering Manager for the AI Platform Team, you will lead the AI Engineering Hub of our newly established Staff AI Enablement Organization. In this highly visible role, you will bridge the gap between complex infrastructure and real-world business impact. Your mandate is two-fold: overseeing the Tier 1 Platform Foundation (building reusable, secure AI primitives like agent inference, prompt tuning, and orchestration) and coordinating the Tier 2 Staff Enablement efforts (partnering directly with departments like Finance, Legal, and Transaction Management to deploy deep, domain-specific workflow automations).

You will manage a lean, high-caliber, hybrid team of full-time Compass software engineers—ranging from Junior to Staff-level —alongside a flexible pool of strategic contractors. By treating the platform as a product, you will build a secure, unified "AI Platform Flywheel" that protects proprietary company data while systematically cutting operational overhead to capture millions in business efficiency.

Responsibilities:

  • Lead and Develop Talent: Directly manage, mentor, and grow a hybrid team of full-time engineers and contractors. Cultivate a high-performing culture through individualized coaching, clear performance standards, and proactive career pathing.
  • Drive AI Platform Strategy: Formulate and execute the roadmap for foundational AI platform primitives (agent orchestration, LLM gateway, telemetry, secure caching, etc.) in close collaboration with senior leadership and Principal Engineers.
  • Accelerate Business Enablement: Deeply partner with corporate departments (Finance, Legal, Ops, etc.) to identify automation opportunities, translating operational processes into structured AI integrations that run on your platform primitives.
  • Enforce Strict AI Governance: Oversee technical design and architecture to ensure all AI tools strictly adhere to information security, data residency, and identity and access management (IAM) guidelines.
  • Promote Operational Excellence: Establish and monitor clear performance metrics (accuracy, latency, token consumption, and cost observability). Implement robust logging, alerting, and rapid incident response systems.
  • Balance Strategic Resources: Make critical, data-driven decisions on team structure and resource allocation, deciding when to leverage flexible contractors for short-term velocity versus retaining core technical architecture inside our FTE footprint.
  • Deliver Compelling Communication: Drive high-level technical and strategic written communication (e.g., system tenets, architectural plans, and project charters) to align multiple cross-functional stakeholders around technical trade-offs.

Requirements: 

  • Strong Technical Background: 10+ years of software engineering experience, with a proven track record of building scalable developer platforms, APIs, SaaS infrastructure, or centralized backend frameworks.
  • Direct People Management: 6+ years of experience leading software engineering squads, with proven success managing senior and staff-level engineers, as well as geographically distributed teams.
  • Fluency in the Generative AI Stack: Deep familiarity with modern LLM application architectures, vector databases, prompt design, fine-tuning, retrieval-augmented generation (RAG), and agent orchestration libraries.
  • Hybrid Team Stewardship: Experience managing a blended team model of full-time employees and contractors, keeping quality bars high while driving execution velocity.
  • Comfort with Ambiguity: A proven self-starter who can take open-ended business problems and shape them into clear, structured, and phased engineering plans with minimal guidance.
  • Customer Empathy & Product Mindset: Demonstrated ability to understand the pain points of internal "customers" (non-technical business departments) and package platform capabilities into intuitive, reliable internal products.
  • Security & Compliance Aptitude: Solid understanding of enterprise security concepts, including IAM, data isolation, encryption, and regulatory compliance standards (e.g., SOC 2, PCI DSS) as they relate to cloud-based applications.

Compensation: The base pay range for this position is $225,990-$251,100; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met.

Perks that You Need to Know About:

Participation in our incentive programs (which may include eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 
Do your best work, be your authentic self.
At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Compass Boston, Massachusetts, USA Office

126 Newbury St, Boston, MA, United States

Similar Jobs

11 Days Ago
Easy Apply
Hybrid
Somerville, MA, USA
Easy Apply
160K-220K Annually
Senior level
160K-220K Annually
Senior level
Enterprise Web • Hardware • Internet of Things • Software
Lead a small engineering team owning identity & access architecture and roadmap (SSO/OIDC/SAML, SCIM, multi-tenant isolation, authorization) across Tulip's multi-cloud environment. Stay hands-on in design and code, enforce automated tests and runbooks, partner with Security, Infrastructure, Product and Customer Success, and drive adoption of AI tooling in the SDLC to accelerate safe, reliable delivery.
Top Skills: Ai ToolingAWSAzureIamOauth 2.0OidcSaml 2.0ScimSecrets ManagementSso
12 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
151K-297K Annually
Senior level
151K-297K Annually
Senior level
Big Data • Cloud • Software • Database
Lead teams focused on developer productivity and observability, build metrics and analytics infrastructure, and drive AI-enabled tooling to measurably improve the software development lifecycle. Partner with engineering and data stakeholders to define roadmaps, mentor engineers, and deliver measurable improvements in adoption, reliability, and developer experience.
Top Skills: Ai ToolsAWSData PipelinesGCPMetrics PlatformsAzureMongoDBMongodb AtlasObservability
16 Days Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
216K-324K Annually
Senior level
216K-324K Annually
Senior level
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Lead and grow a team building Klaviyo's Customer Agent conversational AI platform. Set technical direction, own roadmap, collaborate cross-functionally, guide system and model design, ensure reliability, hire and develop engineers and managers, and deliver scalable, AI-driven customer engagement features.
Top Skills: Agentic SystemsConversational AiFull-Stack DevelopmentLlm-Based ApisMachine Learning

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account