CoreStory Logo

CoreStory

AI Engineer

Reposted 2 Months Ago
Remote
Hiring Remotely in US
Mid level
Remote
Hiring Remotely in US
Mid level
As an AI Engineer, you will develop and optimize AI systems, focusing on LLM integration, vector databases, and RAG pipelines, collaborating with various teams to ensure cutting-edge performance.
The summary above was generated by AI
About CoreStory

CoreStory unlocks the hidden intelligence in your legacy code. By using AI to surface business logic and technical insights, we give enterprises the clarity to modernize faster, maintain apps smarter, and reduce the risk of costly failures.

We’re looking for an AI Engineer who is passionate about building intelligent systems that blend large language models, retrieval architectures, and conversational agents into cohesive, scalable products. This role is critical to the core AI engine powering the CoreStory Platform.

Role Overview

As an AI Engineer, you’ll play a central role in developing and optimizing the AI components that power CoreStory’s narrative intelligence platform. You’ll work across LLM integration, vector search systems, prompt orchestration, agentic systems, and retrieval-augmented generation (RAG) pipelines.

You’ll collaborate closely with the product, data, and infrastructure teams to prototype, productionize, and continuously evolve our AI stack — ensuring that our systems are accurate, explainable, efficient, and on the cutting edge of modern AI capabilities.

Key Responsibilities
  • Design, implement, and optimize LLM-powered systems (e.g., RAG, chat agents, summarizers, knowledge graph integration).
  • Build and manage data indexing and retrieval pipelines using LlamaIndex, LangChain, or similar frameworks.
  • Implement and maintain vector databases (e.g., Pinecone, Neo4j, Weaviate, Chroma, or Azure Cognitive Search).
  • Integrate open-source and proprietary LLMs (e.g., GPT, Claude, Llama) into the CoreStory Platform.
  • Develop and refine AI-driven features — including generative insights, automated summarization, and narrative analytics.
  • Collaborate with DevOps and backend teams to deploy scalable AI services within CoreStory’s cloud infrastructure.
  • Continuously benchmark model performance, latency, and cost, identifying opportunities for optimization.
  • Stay current with advancements in AI — from model architectures to emerging frameworks — and propose innovative applications aligned with CoreStory’s mission.
  • Contribute to internal documentation, experimentation frameworks, and evaluation methodologies.
Qualifications

Required Skills:

  • 7+ years of overall engineering experience with at least 3+ years of experience in AI engineering, machine learning, or applied NLP.
  • Strong hands-on experience with LlamaIndex, LangChain, or similar orchestration frameworks.
  • Experience designing and implementing vector database solutions (e.g., Pinecone, Neo4j, FAISS, Milvus, Weaviate).
  • Solid understanding of LLM APIs (OpenAI, Anthropic, Mistral, Hugging Face, etc.).
  • Proficiency in Python, with experience in libraries such as FastAPI, Pandas, or NumPy.
  • Understanding of retrieval-augmented generation (RAG) patterns, embeddings, and tokenization.
  • Familiarity with prompt engineering, tool calling, and chat agent architectures.
  • Strong problem-solving and analytical mindset, with attention to performance and scalability.
  • Demonstrated interest in staying up-to-date with the fast-evolving AI landscape.

Preferred:

  • Experience deploying AI services in production (e.g., using Docker, Azure, or AWS).
  • Exposure to LangGraph, semantic search, or hybrid RAG systems.
  • Familiarity with knowledge graphs, document intelligence, or multimodal AI.
  • Previous experience in SaaS or early-stage startup environments.
What We Offer
  • Competitive compensation and equity.
  • Flexible, remote-first work environment.
  • Opportunities to define and build the AI roadmap of a fast-growing technology company.
  • Collaborative, learning-oriented culture.
  • Access to cutting-edge AI models, research, and infrastructure.

Similar Jobs

2 Days Ago
Remote or Hybrid
District of Columbia, USA
Senior level
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Designs and delivers trustworthy AI, machine-learning, data, and software solutions from problem definition through production operation. Responsibilities include predictive and generative AI development, data and feature engineering, application and API delivery, evaluation, monitoring, responsible AI governance, and technical leadership. The role requires production-quality Python and SQL, large-scale data platform experience, cloud and AI tooling, and the ability to guide cross-functional teams in deploying secure, maintainable AI capabilities.
Top Skills: SparkAzureAzure AiAzure Ai FoundryCi/CdDatabricksEmbeddingsGitGleanLarge Language ModelsMlflowNumpyPandasPysparkPythonPyTorchRest ApisRetrieval-Augmented GenerationScikit-LearnSQLTensorFlowVector Search
3 Days Ago
Remote
United States
150K-190K Annually
Expert/Leader
150K-190K Annually
Expert/Leader
Software
Designs and deploys AI-powered features and scalable AI/ML services across SaaS products. Responsibilities include translating business problems into AI solutions, integrating large language models, preparing data, evaluating model performance, writing Python, building secure deployment infrastructure, and collaborating with product, data, and cloud operations teams. The role requires production AI/ML experience, scalable data infrastructure expertise, AWS familiarity, and modern DevOps practices.
Top Skills: Ai/Ml Evaluation ToolingAWSDevOpsLarge Language Models (Llms)Llm FrameworksPythonSaaS
3 Days Ago
In-Office or Remote
99K-176K Annually
Mid level
99K-176K Annually
Mid level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads development of production-grade AI/ML solutions, including generative AI, RAG, agentic workflows, conversational AI, and predictive models. Designs, evaluates, deploys, and improves secure, scalable services while implementing responsible AI controls, observability, testing, and CI/CD practices. Integrates AI with enterprise data, APIs, cloud platforms, and digital channels; mentors engineers and drives initiatives from proof of concept through production.
Top Skills: Agentic AiAPIsChatbotsCi/CdCloud-Native ArchitectureContainersConversational AiEmbeddingsEvent-Driven ServicesGenerative AiInfrastructure-As-CodeJavaKubernetesLlmopsMachine LearningMcpMlopsModel MonitoringNatural Language Processing (Nlp)Predictive ModelingPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)Semantic SearchStrands AgentsVector DatabasesVector Stores

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account