Compass Logo

Compass

Senior Data Engineer II

Sorry, this job was removed at 06:06 p.m. (EST) on Thursday, Apr 17, 2025
Be an Early Applicant
Boston, MA
Boston, MA

Similar Jobs

9 Days Ago
Quincy, MA, USA
125K-188K Annually
Senior level
125K-188K Annually
Senior level
AdTech • eCommerce • Food • Marketing Tech • Retail
The Senior Data Engineer optimizes data architecture and pipelines, supports multiple teams, and ensures data delivery for projects from inception to completion.
Top Skills: Azure Data PlatformData FactoryDatabricksETLExcelSQL
2 Hours Ago
Remote
7 Locations
190K-240K Annually
Senior level
190K-240K Annually
Senior level
Productivity • Software • App development • Automation
Lead strategic growth in the Public Sector, managing the full sales cycle for software deals, building executive relationships, and influencing go-to-market strategies.
Top Skills: CRMLinkedin Sales NavigatorOutreachProspecting PlatformsSalesforce
6 Hours Ago
Boston, MA, USA
168K-252K Annually
Senior level
168K-252K Annually
Senior level
Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
As a Senior Software Engineer in Special Projects at Anduril Industries, you'll lead initiatives for efficiency improvements, design data infrastructure, analyze datasets, and collaborate with business heads for strategic insights.
Top Skills: Cicd SystemsCloud InfrastructureData EngineeringKubernetesNixPythonReactTypescript

At Compass, our mission is to help everyone find their place in the world. Founded in 2012, we’re revolutionizing the real estate industry with our end-to-end platform that empowers residential real estate agents to deliver exceptional service to seller and buyer clients.

Data is the foundation of Compass technologies. Our team is responsible for architecting, building, and maintaining a unified, scalable, and cost-effective analytics platform, including a data lake, data warehouse, data pipelines, and operational tools to support data stakeholders across the company.

As a data engineer, you will be responsible for building, optimizing, and maintaining scalable data pipelines using distributed computing on the cloud. You are a data expert who understands and optimizes data systems from the ground up. You will collaborate with data analysts and scientists to support data initiatives and ensure consistent, optimal data delivery architecture for ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.

Responsibilities:

  • Data Infrastructure Development: Design and implement fault-tolerant, scalable cloud data solutions, ensuring optimal performance, cost, and scalability. Automate infrastructure configuration using Infrastructure as Code (IaC).

  • Infrastructure Operations: Oversee platform support, troubleshooting, updates, and feature adoption. Ensure platform health and cost optimization.

  • Security & Compliance: Implement best practices for data security and encryption. Maintain regulatory compliance (e.g., CCPA).

  • Engineering Excellence: Stay updated with emerging technologies in data engineering, identifying opportunities for improvement and operational efficiency.

  • Leadership & Mentorship: Guide junior/mid-level engineers through mentorship and code reviews, fostering professional growth.

  • Collaboration: Partner with analysts, engineers, and stakeholders to align data infrastructure with business goals. Contribute to planning and decision-making.

Qualifications:

  • Bachelor’s/Master’s in Computer Science, IT, or related field.
  • 8+ years in cloud data platform development (e.g., Databricks, Spark, Kafka, Airflow).
  • Proficient in Python, Java, or C# with 8+ years of programming experience.
  • 3+ years using IaC technologies like AWS CloudFormation or Terraform.
  • Expertise in data compliance/governance and process automation.
  • Strong skills in SQL and cloud platforms (e.g., AWS Glue, GCP, Azure Data Factory).

Desirable Skills:

  • SME in cloud data platforms (e.g., Databricks, AWS Lake Formation).
  • Proven ability to enhance service performance and productivity.
  • Analytical and problem-solving skills with strong stakeholder management.
  • Experience with machine learning workflows and integration with LLMs.


Compensation: The base pay range for this position is $168k -$180k annually; however, base pay offered may vary depending on job-related knowledge, skills, and experience. Bonuses and restricted stock units may be provided as part of the compensation package, in addition to a full range of benefits. Base pay is based on market location. Minimum wage for the position will always be met.

Perks that You Need to Know About:

Participation in our incentive programs (which may include eligible cash, equity, or commissions). Plus paid vacation, holidays, sick time, parental leave, and recharge leave; medical, tele-health, dental and vision benefits; 401(k) plan; flexible spending accounts (FSAs); commuter program; life and disability insurance; Maven (a support system for new parents); Carrot (fertility benefits); UrbanSitter (caregiver referral network); Employee Assistance Program; and pet insurance.

 

Do your best work, be your authentic self.

At Compass, we believe that everyone deserves to find their place in the world — a place where they feel like they belong, where they can be their authentic selves, where they can thrive.  Our collaborative, energetic culture is grounded in our Compass Entrepreneurship Principles and our commitment to diversity, equity, inclusion, growth and mobility. As an equal opportunity employer, we offer competitive compensation packages, robust benefits and professional growth opportunities aimed at helping to improve our employees' lives and careers.

Notice for California Applicants

Los Angeles County Fair Chance Notice

Compass Boston, Massachusetts, USA Office

126 Newbury St, Boston, MA, United States

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account