BJAK Logo

BJAK

LLM Application Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Design, build, and ship LLM-powered applications and agent workflows. Integrate models with tools, databases, and services; develop prompting, tool-calling, retrieval, and evaluation systems; improve model behavior, reliability, latency, and cost; and establish observability, experimentation, and production practices for continuous improvement.
The summary above was generated by AI

About ActAI

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. We believe products will greatly reduce hallucinations.

Our objective is to organise anyone's life, allowing us all to spend time on valuable and meaningful things.

About the Role

As an LLM Application Engineer, you will build the intelligence layer that powers ActAI's AI experiences.

You will work at the intersection of LLMs, software engineering, and product - designing agent workflows, improving model behaviour, and turning AI capabilities into reliable user experiences.

You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation system and continuously improving AI behaviour in production.

Focus

  • Build and ship LLM-powered applications and AI agent workflows

  • Design systems for reasoning, planning, memory, tool uuse and multi-step execution

  • Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions

  • Integrate LLMs with APIs, databases, search, internal services, and external tools.

  • Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behaviour

  • Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions

  • Debug AI systems across the entire stack—from model behaviour and prompts to orchestration, backend services, and product UX

  • Optimise AI systems for quality, latency, and cost

  • Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions

  • Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement

Tech Stack

  • Python

  • LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models

  • Agent frameworks and orchestration systems

  • Vector databases and retrieval systems

  • Backend services, APIs, and distributed systems

  • PyTorch / JAX

Ideal Experience

  • Strong software engineering fundamentals with experience building AI-powered applications

  • Hands-on experience with LLMs, generative AI, or agent-based systems

  • Experience designing prompts, workflows, evaluations, or AI behaviour

  • Ability to write clean, production-quality code

  • Comfortable working across abstraction layers (model → system → product)

  • Strong problem-solving skills in ambiguous, fast-moving environments

  • Bias toward shipping, iteration, and continuous improvement

Outcomes

  • AI features reach production quickly and deliver measurable user impact

  • LLM-powered workflows are reliable, scalable, observable, and maintainable

  • AI quality improves through systematic evaluation, experimentation, and iteration

  • AI workflows become increasingly predictable, efficient, and cost-effective

  • Complex AI capabilities are translated into simple, intuitive user experiences

Similar Jobs

One Month Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Software • Cybersecurity • Automation
The Principal LLM Application Engineer will develop and optimize Large Language Models, lead projects, evaluate performance, and collaborate across teams to enhance AI capabilities in cybersecurity.
Top Skills: Cloud-Based InfrastructureDeep Learning FrameworksDevOpsLlmopsMlopsPythonR
25 Minutes Ago
Remote or Hybrid
130K-234K Annually
Mid level
130K-234K Annually
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Own the full outbound sales cycle for mid-market merchants, including prospecting, pipeline development, discovery, demonstrations, negotiations, and closing. Develop tailored multi-product solutions, acquire new logos, collaborate with business development and cross-functional teams, maintain accurate Salesforce forecasting, and consistently achieve revenue targets.
Top Skills: Salesforce
26 Minutes Ago
Remote or Hybrid
39K-233K Annually
Mid level
39K-233K Annually
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Own a local territory through intensive field sales, conducting 50–60 weekly business visits, generating pipeline, delivering product demos, and closing full-cycle deals. Build relationships with local sellers, develop referral partnerships, support onboarding, and sell Square’s commerce software, hardware, and financial services across restaurant, retail, and service verticals. Maintain Salesforce pipeline discipline, forecast accurately, meet quotas, and continuously improve performance.
Top Skills: Loyalty TechnologyPayment Processing TechnologyPayroll TechnologySalesforceTime Management Technology

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account