Compass Logo

Compass

Senior Engineering Manager

Posted 2 Days Ago
Be an Early Applicant
In-Office
Boston, MA, USA
226K-251K Annually
Senior level
In-Office
Boston, MA, USA
226K-251K Annually
Senior level
Lead a hybrid AI engineering team to build and operate foundational AI platform primitives (agent orchestration, LLM gateway, telemetry, secure caching). Partner with business departments to deploy domain-specific automations, ensure AI governance and security compliance, define performance metrics, and make data-driven resourcing decisions while communicating technical strategy to stakeholders.
The summary above was generated by AI

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

As the Senior Engineering Manager for the AI Platform Team, you will lead the AI Engineering Hub of our newly established Staff AI Enablement Organization. In this highly visible role, you will bridge the gap between complex infrastructure and real-world business impact. Your mandate is two-fold: overseeing the Tier 1 Platform Foundation (building reusable, secure AI primitives like agent inference, prompt tuning, and orchestration) and coordinating the Tier 2 Staff Enablement efforts (partnering directly with departments like Finance, Legal, and Transaction Management to deploy deep, domain-specific workflow automations).

You will manage a lean, high-caliber, hybrid team of full-time Compass software engineers—ranging from Junior to Staff-level —alongside a flexible pool of strategic contractors. By treating the platform as a product, you will build a secure, unified "AI Platform Flywheel" that protects proprietary company data while systematically cutting operational overhead to capture millions in business efficiency.

Responsibilities:

  • Lead and Develop Talent: Directly manage, mentor, and grow a hybrid team of full-time engineers and contractors. Cultivate a high-performing culture through individualized coaching, clear performance standards, and proactive career pathing.
  • Drive AI Platform Strategy: Formulate and execute the roadmap for foundational AI platform primitives (agent orchestration, LLM gateway, telemetry, secure caching, etc.) in close collaboration with senior leadership and Principal Engineers.
  • Accelerate Business Enablement: Deeply partner with corporate departments (Finance, Legal, Ops, etc.) to identify automation opportunities, translating operational processes into structured AI integrations that run on your platform primitives.
  • Enforce Strict AI Governance: Oversee technical design and architecture to ensure all AI tools strictly adhere to information security, data residency, and identity and access management (IAM) guidelines.
  • Promote Operational Excellence: Establish and monitor clear performance metrics (accuracy, latency, token consumption, and cost observability). Implement robust logging, alerting, and rapid incident response systems.
  • Balance Strategic Resources: Make critical, data-driven decisions on team structure and resource allocation, deciding when to leverage flexible contractors for short-term velocity versus retaining core technical architecture inside our FTE footprint.
  • Deliver Compelling Communication: Drive high-level technical and strategic written communication (e.g., system tenets, architectural plans, and project charters) to align multiple cross-functional stakeholders around technical trade-offs.

Requirements: 

  • Strong Technical Background: 10+ years of software engineering experience, with a proven track record of building scalable developer platforms, APIs, SaaS infrastructure, or centralized backend frameworks.
  • Direct People Management: 6+ years of experience leading software engineering squads, with proven success managing senior and staff-level engineers, as well as geographically distributed teams.
  • Fluency in the Generative AI Stack: Deep familiarity with modern LLM application architectures, vector databases, prompt design, fine-tuning, retrieval-augmented generation (RAG), and agent orchestration libraries.
  • Hybrid Team Stewardship: Experience managing a blended team model of full-time employees and contractors, keeping quality bars high while driving execution velocity.
  • Comfort with Ambiguity: A proven self-starter who can take open-ended business problems and shape them into clear, structured, and phased engineering plans with minimal guidance.
  • Customer Empathy & Product Mindset: Demonstrated ability to understand the pain points of internal "customers" (non-technical business departments) and package platform capabilities into intuitive, reliable internal products.
  • Security & Compliance Aptitude: Solid understanding of enterprise security concepts, including IAM, data isolation, encryption, and regulatory compliance standards (e.g., SOC 2, PCI DSS) as they relate to cloud-based applications.

Compensation: The base pay range for this position is $225,990-$251,100; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met.

Perks that You Need to Know About:

Participation in our incentive programs (which may include eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 
Do your best work, be your authentic self.
At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Compass Boston, Massachusetts, USA Office

126 Newbury St, Boston, MA, United States

Similar Jobs

2 Days Ago
Hybrid
Cambridge, MA, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead an AI engineering team to design, build, deploy, and optimize large-scale generative AI systems. Oversee foundation model training, LLM inference, similarity search, guardrails, evaluation, observability, and make strategic build-vs-buy decisions. Drive technical vision, roadmap, and talent development while ensuring scalable, cost-efficient, and responsible AI production systems.
Top Skills: AWSAws UltraclustersAzureC#C++GoGCPHuggingfaceJavaLarge Language ModelsNemo GuardrailsPythonPyTorchSimilarity SearchVectordbs
12 Days Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
Senior level
Senior level
Fitness • Hardware • Healthtech • Sports • Wearables
Lead a team of electrical engineers, overseeing development and optimization of electrical systems for wearable hardware while ensuring product quality and reliability.
Top Skills: AltiumAnalog DesignDigital DesignEcad ToolsElectrical EngineeringMixed-Signal DesignPower Systems
18 Days Ago
Remote or Hybrid
US
187K-234K Annually
Senior level
187K-234K Annually
Senior level
Big Data • Fintech • Information Technology • Insurance • Software
Lead a distributed engineering team to deliver customer-facing platform features and manage engineering best practices, mentoring junior engineers, and driving strategic improvements across the software development lifecycle.
Top Skills: APIsGenai Development ToolsGoNext.JsNode.jsPythonReactRelational DatabasesRemix

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account