Alpaca Logo

Alpaca

Senior Data Platform Engineer

Reposted 9 Hours Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design and operate Alpaca’s scalable data platform on GCP, including lakehouse infrastructure, Kubernetes-based deployments, streaming and CDC pipelines, batch ingestion, BI access, cataloging, monitoring, and governance. Build infrastructure as code with Terraform and Ansible, operate distributed query engines and Apache Iceberg, maintain reliability practices, and collaborate with DevOps and analytics teams to support rapidly evolving data requirements.
The summary above was generated by AI

Who We Are:

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.
Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.
Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.
Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.
Our Team Members:

We're a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!
We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

About the team & role

The Data Platform team builds and operates the shared infrastructure that powers how data is stored, moved, and consumed across Alpaca. Our platform supports financial transactions, customer data, API and system events, enriched datasets, and third-party sources that power critical decisions and products for internal teams and external stakeholders. We process hundreds of millions of events each day and that scale continues to grow as Alpaca serves more customers and launches new products.

As a Senior Data Platform Engineer, you'll design, build, and operate reliable systems across Alpaca's data platform, from distributed query engines and lakehouse storage to streaming infrastructure, governance, and data serving. You'll also work closely with our AI and Data Science teams to enable agentic workflows and machine learning capabilities. As part of a small team, you'll contribute across multiple initiatives, own projects from design through production, and help shape the future of our platform.

Our team is 100% distributed and remote.

What you’ll do

  • Design, build, and operate core data platform infrastructure, including distributed query engines, lakehouse storage, orchestration, and streaming pipelines.
  • Contribute to regional platform deployments, building scalable and repeatable infrastructure using Kubernetes and infrastructure-as-code.
  • Develop real-time data processing, analytics, and alerting capabilities for operational and product use cases.
  • Partner with AI and Data Science teams on the platform foundations for agentic workflows, evaluations, and ML lifecycle tooling.
  • Evolve our data catalog, governance, and access controls so data is discoverable and properly governed.
  • Own platform reliability through observability, on-call participation, and operational improvements while collaborating with cross-functional teams.

Must-haves

  • 5+ years of experience in data infrastructure, platform engineering, or software engineering, with demonstrated end-to-end ownership of production systems.
  • Strong Python and SQL skills, with experience building reliable pipelines, services, or platform tooling.
  • Experience building or operating distributed data systems, such as query engines, lakehouses, or streaming platforms.
  • Experience operating cloud infrastructure using Kubernetes, infrastructure-as-code, and deployment automation.
  • Sound operational judgment, clear technical communication, and the ability to collaborate across engineering teams.

 Nice to Haves:

  • Experience with distributed query engines such as Trino, Presto, or Spark, and open table formats such as Apache Iceberg.
  • Experience with streaming and real-time data infrastructure such as Kafka, Redpanda, Flink, or Debezium.
  • Experience with AI and agent infrastructure, including MCP servers, retrieval systems, agent observability, or LLM evaluation.
  • Experience supporting ML infrastructure using technologies such as MLflow, Vertex AI, or similar platforms.
  • Experience with real-time analytics engines such as ClickHouse, Pinot, or Druid.
  • Experience designing and operating infrastructure across multiple cloud regions, including workload isolation and cost-performance trade-offs.
How We Take Care of You:
  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup: One-time USD $500
  • Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

Recruitment Privacy Policy

Similar Jobs

3 Days Ago
In-Office or Remote
USA
111K-173K Annually
Mid level
111K-173K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Own readiness and enablement programs for SDR teams, including onboarding, sales training, prospecting, qualification, product knowledge, tool adoption, AI workflows, and manager coaching. Facilitate workshops and role-plays, develop learning content and playbooks, partner with sales, marketing, operations, and systems teams, and measure impact through ramp time, conversion, pipeline, proficiency, and adoption metrics.
Top Skills: Artificial IntelligenceConversation Intelligence ToolsCRMGongLinkedin Sales NavigatorOutreachSales Engagement ToolsSalesforceSalesloftZoominfo
3 Days Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead a small, hands-on engineering team responsible for analytics infrastructure and member growth. Own technical strategy for ClickHouse-powered analytics, data visualizations, and LLM-enabled data experiences, while guiding onboarding and activation roadmaps. Write and review code, design experiments, partner with product and design, make architectural decisions, and hire, mentor, and develop engineers. The role requires strong web application experience, product judgment, communication skills, and expertise across Ruby on Rails, databases, ReactJS, and TypeScript.
Top Skills: A/B TestingClickhouseLlmsMySQLPostgresReactRuby On RailsStripeTypescript
3 Days Ago
Remote or Hybrid
USA
15-20 Hourly
Entry level
15-20 Hourly
Entry level
eCommerce • Fashion • Retail • Sales • Wearables • Design
Provides personalized styling advice and product recommendations, builds customer relationships, supports purchase decisions, and drives sales results. Maintains product knowledge, stockroom organization, POS transactions, and operational standards while collaborating with the retail team. Requires a flexible schedule, customer-focused communication, retail experience, and ability to perform physical store and stockroom duties, including lifting up to 50 pounds occasionally.
Top Skills: Omni-Channel/Virtual Selling PlatformsPoint-Of-Sale (Pos) Systems

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account