Datadog Logo

Datadog

Staff AI Engineer - Notebooks

Posted 3 Hours Ago
Be an Early Applicant
Easy Apply
Hybrid
New York, NY
234K-300K Annually
Expert/Leader
Easy Apply
Hybrid
New York, NY
234K-300K Annually
Expert/Leader
Technical leader building AI-driven features for Datadog Notebooks: design, prototype, deploy, and scale ML workflows (agents, retrieval, prompt management), run experiments, define metrics, and coordinate cross-team product integration.
The summary above was generated by AI

We're looking for a Staff Software Engineer with deep experience in AI/ML to join the Notebooks team. Datadog Notebooks provide a flexible tool for ad-hoc data analysis, collaborative investigations, and technical documentation. Its fluidity makes it an ideal surface for agents and humans to interact. The Notebook team is building AI-driven workflows for natural-language data analysis, assisted graph generation, automated investigations, and more. You will act as a technical leader in this domain, focused on building industry-leader AI-powered features. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.


What You’ll Do:

  • Spearhead AI initiatives within Notebooks, serving as the technical owner for the design, development, and deployment of ML/AI-driven features.
  • Shape the long-term technical direction and strategy for AI workflows within Notebooks and related products.
  • Champion the full development cycle: from rapid prototyping and defining success metrics/evaluations to running experiments, iterating, and achieving production-ready scale and reliability.
  • Drive product direction with a strong user focus, always advocating for the best end-user experience.
  • Coordinate with other leaders and product teams interested in leveraging Notebooks in their AI-powered workflows.
  • Develop robust agent systems, including tools, retrieval and planning strategies, guardrails, prompt management/evaluations, fallbacks, and human-in-the-loop processes.
  • Stay up to date with industry trends, guiding the adoption of new technologies and evolving best-practices.

Who You Are:

  • You have a BS/MS/PhD in a scientific field or equivalent experience
  • 10+ years of relevant engineering experience, as well as experience acting as a technical lead
  • Proven track record of leading large-scale AI/ML initiatives in a product-driven environment
  • You have significant experience in model deployment, development, training, fine-tuning, and evaluation
  • You are passionate about mentoring others and cultivating a high-performing engineering culture.
  • You’re excited about leveraging AI tools to enhance how you code, solve problems, and build

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.


Benefits and Growth:

  • Generous and competitive benefits package
  • New hire stock equity (RSUs) and employee stock purchase plan
  • Continuous career development and pathing opportunities
  • Employee-focused best in class onboarding
  • Internal mentor and cross-departmental buddy program
  • Friendly and inclusive workplace culture

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.


#LI-Hybrid

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is:
$234,000$300,000 USD

About Datadog: 

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. 

Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. 

Privacy and AI Guidelines:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.

Top Skills

Agent Systems
Ai/Ml
Datadog Notebooks
Human-In-The-Loop
Model Deployment
Model Evaluation
Model Fine-Tuning
Model Training
Prompt Engineering
Retrieval Systems

Datadog Boston, Massachusetts, USA Office

We are located steps away from Post Office Square. When we aren't eating locally catered lunches, food trucks & other restaurants are easily accessible!

Similar Jobs at Datadog

3 Hours Ago
Easy Apply
Hybrid
2 Locations
Easy Apply
234K-300K Annually
Senior level
234K-300K Annually
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Lead design and implementation of LLM observability features: prototype and scale product capabilities for tracing, evaluating, and debugging generative AI systems. Work cross-functionally to influence architecture, mentor engineers, prioritize customer pain points, and drive product and engineering decisions for reliable, high-performance AI observability.
Top Skills: Large Language Models (Llms),Generative Ai,Inference Pipelines,Prompt Engineering,Observability Tools/Platforms,Distributed Systems,Scalable Backend Architectures
3 Hours Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
187K-240K Annually
Senior level
187K-240K Annually
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Lead a team building production systems for code understanding and automated code changes. Drive technical direction, partner cross-functionally, maintain evaluation/monitoring pipelines, ensure production readiness (on-call, SLIs/SLOs, postmortems), own hiring and career growth, and uphold engineering rigor for data pipelines, model inputs, reproducibility, and CI/CD.
Top Skills: Python,Go,Llms,Machine Learning,Model Serving,Ci/Cd,Telemetry Ingestion,Parsers,Pr Automation,Slis/Slos,Sre
5 Hours Ago
Easy Apply
Hybrid
2 Locations
Easy Apply
135K-150K Annually
Senior level
135K-150K Annually
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
The Strategic Account Executive will prospect into large State, Local, and Education organizations, build relationships, negotiate pricing, and meet sales targets while maintaining customer satisfaction.

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account