Recorded Future Logo

Recorded Future

Principal Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Boston, MA, USA
152K-229K Annually
Senior level
In-Office
Boston, MA, USA
152K-229K Annually
Senior level
Lead design and delivery of scalable data pipelines and APIs for Digital Risk Protection. Mentor engineers, align and ingest multiple data streams (including graph data), productize analytics and LLM outputs, and drive DRP technical projects with stakeholders to enable data-driven intelligence.
The summary above was generated by AI

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

Recorded Future combats cyber security threats by delivering actionable intelligence from our various Digital Risk Protection data streams. We are looking for a Principal Data Engineer to drive improvements in the Digital Risk Protection department. 

What You'll Do:
  • Identify, scope, and own technical solutions necessary to achieve data convergence across Digital Risk Protection systems and data streams
  • Mentor direct reports to bring out the best in all members of the team
  • Work with the Malicious Sites, Identity, and Surface Web teams to align, analyze, and ingest digital risk data streams into Digital Risk Protection systems and the Intelligence Graph
  • Develop, productize, monitor, and maintain DRP-focused data pipelines to analyze and ingest data at scale
  • Build tools and APIs to facilitate access to data and analytics developed from Digital Risk Protection systems and the Intelligence Graph
  • Analyze and explain patterns in digital risk data to drive business-critical decisions
  • Create technical project plans and drive the successful execution of DRP initiatives, with input from our Product team and other developers on your team
What You'll Bring:
  • 5+ years of Python programming
  • 3+ years of experience with 
    • Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch 
    • Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect
    • AI approaches and productizing flagship LLM output
    • Developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
    • Architecting and delivering production-grade applications and ETL/ELT pipelines
    • Applying statistical techniques to draw accurate, impactful conclusions
  • Leadership experience
    • Ability to present information to stakeholders with varying levels of technical expertise
    • Experience engaging with technical leaders across geographies and divisions/companies
    • Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation 
    • Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
  • Proven success in architecting, leading, and delivering high-impact projects 
  • Efficient & accurate problem solving skills, including the ability to debug both software and data 
  • Excellent attention to detail & ability to work independently while delivering high-quality results
  • Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience

The base salary range for this full-time position is $152,000- $228,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job-related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

Why should you join Recorded Future?
Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

Want more info? 
Blog & Podcast: Learn everything you want to know (and maybe some things you’d rather not know) about the world of cyber threat intelligence
Linkedin, Instagram & Twitter: What’s happening at Recorded Future
The Record: The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field
Timeline: History of Recorded Future
Recognition: Check out our awards and announcements

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles.  By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.
If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [email protected] 

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.
Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

Recorded Future maintains a drug-free workplace.

Note: Our interview process for all final-round candidates requires a mandatory in-person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.

Notice to Agency and Search Firm Representatives: Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. Recorded Future will not be liable for any fees related to unsolicited resumes.

Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions made without such agreements and authorization will not be accepted and no fees will be paid.

HQ

Recorded Future Somerville, Massachusetts, USA Office

363 Highland Avenue,, Somerville, MA, United States, 2144

Similar Jobs

6 Days Ago
In-Office or Remote
16 Locations
Expert/Leader
Expert/Leader
Industrial • Automation
Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.
Top Skills: Azure SynapseBitbucketCi/CdData LakehouseData Vault 2.0DatabricksDbtDbt CloudDbt CoreEltETLGitInfrastructure As CodeJIRANoSQLPythonSnowflakeSQL
10 Days Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
244K-366K Annually
Expert/Leader
244K-366K Annually
Expert/Leader
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Lead design and delivery of Klaviyo's scalable data platform (streaming, batch, lakehouse, governance). Define SLOs, author ADRs/RFCs, implement ingestion/CDC, processing, storage, catalog/lineage and access controls. Optimize performance/cost, apply ML/GenAI to data workflows, partner with product/analytics, contribute code/reviews, and mentor senior engineers to enable reliable, multi‑tenant data at scale.
Top Skills: Apache AirflowApache BeamApache FlinkApache HudiApache IcebergSparkBatch OrchestrationBigQueryCdcDagsterData Quality (Dq)Delta LakeFinopsGoogle Pub/SubKafkaLakehouseMl/GenaiObject StorageSemantic Catalog/SearchSnowflakeStream Processing
16 Days Ago
In-Office
Cambridge, MA, USA
95K-245K Annually
Senior level
95K-245K Annually
Senior level
Aerospace • Information Technology • Software • Biotech • Cybersecurity • Quantum Computing • Defense
Design, architect, integrate, verify, and validate system-level simulations and real-time software for aerospace and defense systems. Develop CONOPs, requirements, interfaces, tests, and hardware/software integrations. Support digital capabilities (digital twins/threads), data integration, visualization, and life-cycle model-based systems engineering. Communicate with stakeholders and may lead small teams.
Top Skills: 3D Visualization ToolsCC++ContainerizationDigital ThreadDigital TwinMatlabModel Based Systems Engineering (Mbse)PythonReal-Time Software FrameworksSimulink

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account