Senior Software Engineer, Big Data Infrastructure
About the team
The HubSpot Data Infrastructure HBase team is responsible for all of HubSpot's HBase databases and Hadoop infrastructure. We aim to provide 99.99% reliability for our HBase clusters, as well as patching our HBase distribution and providing HubSpot developers with libraries to improve HBase ease of use & monitoring.
We spend a lot of time building automation, tooling, and monitoring to equip developers to understand and optimize their datastore usage and minimize the impact of any operational issues on customers and developers alike. For example, we’ve built database clients to make monitoring and analysis of usage patterns easier for HubSpot teams and are working to commit these changes back to the community to better support and monitor in a multi-tenant environment.
We’re also operationally responsible for a huge volume of traffic to and from these datastores. Our HBase clusters serve over 3 million requests/second across 220+ tables, while our ElasticSearch clusters serve over 20k searches/second and 50k indexes/second to 90+ billion documents. Streaming that data to and from applications amounts to more than 3 GB/sec of data through our Kafka clusters, with hundreds of producers and consumers
What we’re looking for
- Experienced with some or most of our datastores (HBase, Hadoop) as a user and/or operationally
- Excited to build great tools for developers so they can work faster and more reliably
- Interested in working with and supporting infrastructure at scale
- Eager to learn and grow
Confidence can sometimes hold us back from applying for a job. But we'll let you in on a secret: there's no such thing as the 'perfect' candidate. HubSpot is a place where everyone can grow. So however you identify and whatever background you bring with you, please apply if this is a role that would make you excited to come into work every day.
HubSpot helps millions of organizations grow better, and we’d love to grow better with you. Our business builds the software and systems that power the world’s small to medium-sized businesses. Our company culture builds connections, careers, and employee growth. How? By creating a workplace that values flexibility, autonomy, and transparency. If that sounds like something you’d like to be part of, we’d love to hear from you.
You can find out more about our company culture in the HubSpot Culture Code, which has more than 3M views, and learn about our commitment to creating a diverse and inclusive workplace, too. Thanks to the work of every HubSpotter globally who has helped build our remarkable culture, HubSpot has been named a top workplace by Glassdoor, Fortune, Entrepreneur, and more.
HubSpot was founded in 2006. We’re headquartered in Cambridge, Massachusetts, and we have offices in Dublin (Ireland), Sydney (Australia), New Hampshire, Singapore, Tokyo (Japan), Berlin (Germany), and Bogotá (Colombia).
By submitting your application, you agree that HubSpot may collect your personal data for recruiting, global organization planning, and related purposes. HubSpot's Recruiting Privacy Notice explains what personal information we may process, where we may process your personal information, our purposes for processing your personal information, and the rights you can exercise over HubSpot’s use of your personal information.