Responsible for developing AI search agents and RAG pipelines, optimizing performance, and monitoring production environments while ensuring accuracy and efficiency.
Job Responsibilities
1. Building AI search agents- including ReAct, planning, and multi-agent architectures via custom implementation or frameworks like LangGraph, Dify, or CrewAI.
2. Building end-to-end RAG pipelines from ingestion, chunking, embeddings, and hybrid vector search, ideally using Opensearch.
3. Operating and monitoring vector/hybrid indexes (e.g. OpenSearch) in production environments.
4. Implement grounding and citation to link generated answers back to their exact source passages.
5. Automate evaluation using synthetic QA, retrieval-hit-rate tracking, and model-critique loops to continuously measure accuracy and detect drift.
6. Orchestrating external tools or knowledge bases and monitoring latency and cost at production scale.
Qualifications
1. Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
2. 3+ years of experience in developing AI systems, with a focus on retrieval-augmented generation (RAG).
3. Proven track record in building and optimizing end-to-end RAG pipelines.
4. Experience with AI search agent development using frameworks like ReAct, LangGraph, Dify, or CrewAI.
5. Hands-on experience with OpenSearch or similar vector search technologies.
6. Proficiency in Python and relevant machine learning frameworks (e.g., PyTorch, TensorFlow).
7. Strong understanding of data ingestion, chunking, embeddings, and hybrid vector search techniques.
8. Experience with monitoring and managing production environments.
9. Knowledge of grounding and citation techniques in AI-generated content.
10. Familiarity with synthetic QA datasets and evaluation metrics.
Top Skills
Crewai
Dify
Langgraph
Opensearch
Python
PyTorch
TensorFlow
Similar Jobs
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Software Engineer will build integrations, support feature delivery, solve technical problems, and participate in design and code reviews within an Agile team.
Top Skills:
ConfluenceGoJavaJIRAPostgresReactTypescript
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The role involves mentoring a team, developing device lifecycle frameworks, and collaborating across teams to enhance product features, all while ensuring reliability and performance of systems.
Top Skills:
GoGraphQLPythonReactReact NativeTypescript
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Design and implement machine learning models to prevent fraud and mitigate risk in Cash App, collaborating across teams to ensure effective solutions.
Top Skills:
AWSGCPMySQLNumpyPandasPythonPyTorchSklearnSnowflakeTableauTensorFlowXgboost
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories