Data Engineer II at Rapid7
At Rapid7, you'll join a world class team of thinkers and problem solvers who prioritize individual growth and team collaboration over ego and attitude, while conducting research and building products that solve the world's toughest security challenges.
You will work with Data Scientists, Security Researchers, Threat Analysts and Software engineers to bring security research ideas from conception through to deployment in our products or publication in the community. You will participate in every aspect of research from design and planning, through implementation and testing, to deployment and support.
What you will do
You will be instrumental in helping our research team move as quickly as possible to solve challenging security problems. You will help design, plan, and implement data analysis tools and systems with peers in small teams, and be part of a larger team working collaboratively to support our research goals: improving our products and supporting the security community by publishing interesting findings and presenting at conferences.
Successful candidates aren't just good at writing code or designing systems, but have a demonstrated focus on helping the rest of the team be as successful as possible. You should love being challenged by your work, with a desire to ship and iterate on tools, infrastructure and POCs, as well as an emphasis on collaboration, communication, and growth. Our entire team (Data Science, Security Research, Threat Intelligence, Engineering, Product Management) works together closely to ensure the success of our research projects as well as our products, and we're looking for someone who revels in exposure to the entire process of how research tools are planned, built, deployed, used, and supported.
We value attitude and willingness to learn over ego and experience, and want someone who is looking to grow with the team as we continue to grow our product.
Python / R / Scala
Jupyter / R notebooks
You need to be...
Focused on shipping solutions to problems, not just code
A strong communicator, able to explain your work at varying levels of detail depending on the audience
Able to read and write Python code
Committed to developing high quality tools and systems within reasonable timeframes
Experienced with AWS data processing and transformation services
Comfortable with foundational AWS services (S3, SQS, EC2)
Able to help distill research requirements into technical details, including to organize and plan epics, and help others understand the priorities and needs of that work
Someone with a “grab a shovel” attitude, where you're excited to dig in and get your hands dirty working with your peers.
Able to initiate and drive projects to completion with minimal guidance
Willing to learn, and willing to teach. Everyone brings something new to the team, and we want to learn from you as much as we want to grow you as an engineer and a team member.
Someone with around 4 or more years of experience that encompasses the above. We're flexible, and are looking for the right candidate - not just someone who hits a number.
It would be great if you...
Know how to use git and GitHub, and understand basic branching strategies and pull requests
Are familiar with interacting with REST endpoints
Know your way around distributed processing coding tools (spark, pyspark) and concepts (MapReduce, message queueing)
Have used Terraform to build up and modify cloud deployments
Have experience with Numpy and Pandas
Know how to read (or even write) R, Scala, Java, bash
Want to learn more about Data Science and Security Research