Recorded Future Logo

Recorded Future

Senior Data Engineer

Reposted 5 Days Ago
In-Office
Boston, MA
30K-300K
Senior level
In-Office
Boston, MA
30K-300K
Senior level
As a Senior Data Engineer, you will enhance the Security Intelligence Graph by building data pipelines, analyzing data, and collaborating with teams to implement effective solutions.
The summary above was generated by AI

With 1,000 intelligence professionals, over $300M in sales, and serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

Senior Data Engineer, Graph Quality 

Recorded Future combats cyber security threats by delivering actionable intelligence from the Security Intelligence Graph. 

We are looking for a Data Engineer to improve the Security Intelligence Graph. As a Data Engineer, you will build production-grade pipelines to drive data convergence from various sources within the graph, ensure that Indicators of Compromise (IOCs) are properly attributed, and improve the quality of the graph at scale.

What You'll Do: 

  • Work with the Graph Quality team to align, analyze, and ingest asset maps into the Security Intelligence Graph
  • Develop, productize, monitor, and maintain data pipelines to analyze and ingest data at scale
  • Build tools and APIs to facilitate access to data and analytics developed from the intelligence graph
  • Analyze and explain patterns in data to drive business-critical decisions
  • Create technical project plans and drive the successful execution of projects, with input from our Product team and other developers on the team
  • Collaborate with Data Scientists, Data Engineers, and business leaders to develop and refine technical solutions
  • Onboard and guide junior members of the team
  • Assist in setting team goals, planning sprints, and leading Agile scrum meetings
What You'll Bring: 
  • 4+ years of Python programming
  • 2+ years of experience with cloud computing tools, e.g. from AWS, Azure, or Google Cloud
  • Experience writing scalable, production-grade applications and ETL/ELT pipelines
  • Efficient & accurate problem solving skills, including the ability to debug both software and data 
  • Proven ability to analyze data and apply statistical techniques to draw accurate, impactful conclusions
  • Proven success in delivering projects from design and implementation to release
  • Excellent attention to detail & ability to work independently while delivering high-quality results
  • Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation 
  • Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
Preferred Qualifications:
  • Familiarity with both batch and streaming pipelines
  • Familiarity with any of the following: message buses (e.g. Kafka, RabbitMQ), NoSQL databases (e.g. MongoDB, AWS Neptune, Neo4j), ElasticSearch 
  • Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
  • Exposure to ML approaches, including experience productizing ML models
  • Experience with developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
  • Leadership experience, with a track record of presenting information to stakeholders with varying levels of technical expertise

Why should you join Recorded Future?
Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.8-star user rating from Gartner and more than 45 of the Fortune 100 companies as clients.

Want more info? 
Blog & Podcast: Learn everything you want to know (and maybe some things you’d rather not know) about the world of cyber threat intelligence
Linkedin, Instagram & Twitter: What’s happening at Recorded Future
The Record: The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field
Timeline: History of Recorded Future
Recognition: Check out our awards and announcements

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles.  By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.
If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [email protected] 

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.
Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

Notice to Agency and Search Firm Representatives:
Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

Top Skills

AWS
Aws Neptune
Azure
Django
Elasticsearch
Fastapi
Flask
GCP
Kafka
MongoDB
Neo4J
Python
RabbitMQ
HQ

Recorded Future Somerville, Massachusetts, USA Office

363 Highland Avenue,, Somerville, MA, United States, 2144

Similar Jobs

Yesterday
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
Senior level
Senior level
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Lead the design, build, and deployment of data pipelines, ensuring data integration and customer support while maintaining high data quality standards.
Top Skills: AirflowSparkAWSDagsterDatabricksLinuxPrefectPysparkPythonSnowflakeSQL
5 Days Ago
Hybrid
3 Locations
144K-181K Annually
Mid level
144K-181K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Senior Data Engineer at Capital One, you'll design, develop, and implement data solutions while collaborating with Agile teams on cloud-based applications. Responsibilities include using Python, SQL, and big data technologies to build data pipelines and support a transformation in Finance Tech.
Top Skills: AWSDatabricksKafkaLinuxNoSQLOpen Source RdbmsPysparkPythonRedshiftSnowflakeSparkSQLUnix
Yesterday
In-Office or Remote
4 Locations
Senior level
Senior level
Big Data • Fitness • Healthtech • Software • Analytics • Energy
The Senior Data Engineer will develop solution architecture, automate data pipelines, and support integrations for healthcare clients, ensuring effective data management.
Top Skills: AWSCloud ArchitectureDatabase ArchitectureJavaKafkaNifiNosql DatabasesPythonSparkSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account