Lead refactoring and optimization of scalable data pipelines, design next-generation distributed storage and processing systems, build clean interfaces for diverse data consumers, mentor engineers, and establish engineering standards and processes.
As a Staff Software Engineer, you will lead the evolution of our backend architecture, with a primary focus on refactoring and optimizing existing data pipelines. You will drive the development of next-generation distributed data storage and processing systems designed to scale indefinitely and surpass traditional query performance. Beyond modernization, you will design clean, expressive interfaces that abstract complexity for a wide range of data consumers—from core web applications to advanced business analytics and AI. Your expertise will be instrumental in transforming our infrastructure into a robust, high-performance foundation.
Primary Duties:
- Identify and develop scalable and performant solutions.
- Work across discipline to shape product strategy and execution.
- Develop the foundations of code architecture and quality.
- Mentor and coach engineers.
- Set and uphold the standard for engineering processes to support high-quality engineering.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a related field required.
- 8+ years of production-level experience as an engineer building highly scalable systems.
- 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
- Experience architecting, developing, and deploying large-scale distributed systems at scale.
- Experience with cloud technologies, e.g., AWS, Azure, GCP.
- Experience building continuous integration and continuous development (CI/CD) pipelines.
- Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
Preferred KSAs:
- 8+ years experience building highly scalable and reliable infrastructure.
- Expertise in designing, optimizing, and orchestrating robust data pipelines (ETL/ELT) and ingestion systems for large-scale, real-time, and batch processing.
- Experience managing data warehouses (e.g., Snowflake, Redshift) and leveraging analytics tools (e.g., Spark, SQL, Python, Databricks).
- Hands-on experience with containerization (Docker, Kubernetes), CI/CD pipelines, and distributed architectures (event-driven, in-memory computing).
- Deep proficiency with modern database systems, including replication, sharding, partitioning, indexing, and caching strategies for high-performance query optimization.
- Strong understanding of data security, governance, and compliance principles.
- Experience with infrastructure monitoring, performance optimization, and active participation in architecture reviews.
Physical Requirements:
Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Sell Comcast products and services through inbound voice interactions while achieving sales targets. Use consultative selling to assess customer needs, overcome objections, educate customers, process transactions through complex systems, and build positive customer relationships. The role requires professionalism, active listening, problem-solving, teamwork, adherence to sales processes, punctual attendance, and flexibility to work assigned shifts, nights, weekends, and overtime in a remote environment.
Digital Media • Information Technology • News + Entertainment
Supervises a business-to-business outbound telesales team focused on retaining and growing SMB customers. Coaches representatives on prospecting, upselling, cross-selling, account management, customer service, forecasting, and closing. Monitors CRM accuracy, activity targets, call quality, and sales performance. Conducts meetings, reviews, improvement plans, hiring, discipline, and terminations while partnering with leadership and other supervisors to drive team results.
Top Skills:
Crm Software
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Own strategy, roadmap, compliance, architecture direction, and go-to-market for ServiceNow’s U.S. public sector cloud portfolio. Lead regulated hosted, self-hosted, partner-operated, private stack, and sovereign offerings while aligning engineering, security, legal, infrastructure, and partners. Drive compliance patterns, release processes, cross-functional programs, prioritization, business cases, market analysis, field enablement, and competitive strategy for federal, state, and local government customers.
Top Skills:
AICjisCloud InfrastructureCmmcContainerizationDod Il4Dod Il5FedrampFipsIaasKubernetesNistPaasQeSaaSScrServicenowSreTls
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
