Design, build, govern, and own an enterprise AI data platform that ingests, transforms, stores, and serves data for AI consumers. Define multi-domain data models, data contracts, pipelines, vector and retrieval infrastructure, observability for agentic behavior, and evaluation frameworks. Establish architecture standards, CI/CD, and infrastructure-as-code to enable production AI/ML and LLM applications.
3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI.
AI Data Architect
We are looking for an AI Data Architect to design, build, govern, and evolve the single source of truth that powers every AI initiative in our organization.
This platform will serve as the foundational nervous system for conversational AI assistants, dashboard intelligence, autonomous AI agents, RAG-powered applications, predictive ML models, and any AI product we build today or in the future. The resource will architect the system, drive implementation, own the data contracts that agents and AI applications depend on, enforce security and access governance for both human and agent consumers, and continuously monitor and improve the accuracy and reliability of AI outputs that flow from this platform.
AI Data Architect
We are looking for an AI Data Architect to design, build, govern, and evolve the single source of truth that powers every AI initiative in our organization.
This platform will serve as the foundational nervous system for conversational AI assistants, dashboard intelligence, autonomous AI agents, RAG-powered applications, predictive ML models, and any AI product we build today or in the future. The resource will architect the system, drive implementation, own the data contracts that agents and AI applications depend on, enforce security and access governance for both human and agent consumers, and continuously monitor and improve the accuracy and reliability of AI outputs that flow from this platform.
Requirements:
Architect and own the enterprise AI data platform — the unified, governed layer that ingests, transforms, stores, and serves all data consumed by AI systems across the organisation.
Design multi-domain data models (lakehouse, data mesh, event-driven) that are structured from day one to serve AI workloads: clean lineage, versioned schemas, well-documented contracts, and low-latency serving APIs.
Strong exposure to different Data architectures, data lake & data warehouse
Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboard & report and create insights
Design multi-domain data models (lakehouse, data mesh, event-driven) that are structured from day one to serve AI workloads: clean lineage, versioned schemas, well-documented contracts, and low-latency serving APIs.
Strong exposure to different Data architectures, data lake & data warehouse
Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboard & report and create insights
Responsibilities
- 15+ years of hands-on data engineering and architecture experience, alongside building production AI/ML and LLM-era data infrastructure.
- Strong Experience with either Databricks or Snowflake; experience with both is desirable.
- Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures
- Expertise in designing and writing ETL processes in Python / Java / Scala
- Own the full data stack: real-time streaming (Kafka, Spark Structured Streaming), batch processing (Databricks, PySpark, Delta Lake), cloud storage and compute (AWS, Azure), and data quality /metadata management.
- Drive modernisation of legacy pipelines (on-prem ETL, batch DWH) to cloud-native, AI-ready architectures with measurable improvements in cost, latency, and delivery velocity.
- Proven experience designing enterprise-scale AI data platforms that serve multiple AI consumers —not just one application or pipeline.
- Hands-on experience with vector stores, semantic models, knowledge graphs, and retrieval infrastructure in production environments.
- Working knowledge of LLMOps: model serving pipelines, MLflow, CI/CD for AI, automated evaluation, and production monitoring.
Technical Skills
Primary Skills: Python, SQL, Snowflake/Databricks, AWS (S3, Glue, EKS, Bedrock, Kinesis, Redshift), Docker, Kubernetes, Terraform, GitHub Actions, LangChain, LlamaIndex, LLM APIs (OpenAI, AWS Bedrock, Claude, HuggingFace), (Pinecone, FAISS, ChromaDB, OpenSearch), knowledge graphs (Neo4j).
Secondary Skills: MLflow, FastAPI, CI/CD pipelines, observability tooling (CloudWatch, Grafana, or equivalent), data lineage and metadata management platforms.
Primary Skills: Python, SQL, Snowflake/Databricks, AWS (S3, Glue, EKS, Bedrock, Kinesis, Redshift), Docker, Kubernetes, Terraform, GitHub Actions, LangChain, LlamaIndex, LLM APIs (OpenAI, AWS Bedrock, Claude, HuggingFace), (Pinecone, FAISS, ChromaDB, OpenSearch), knowledge graphs (Neo4j).
Secondary Skills: MLflow, FastAPI, CI/CD pipelines, observability tooling (CloudWatch, Grafana, or equivalent), data lineage and metadata management platforms.
AI Experience
RAG, Vector & Retrieval Infrastructure
Design the retrieval infrastructure that powers RAG-based AI applications: embedding pipelines, vector stores (Pinecone, FAISS, ChromaDB, OpenSearch), chunking strategies, and hybrid retrieval layers combining semantic search with structured queries.
Agentic Behaviour Observability & Output Accuracy
Own the observability stack for AI agent behaviour: instrument agents to capture inputs, retrieved context, tool calls, reasoning traces, and outputs — creating a complete audit trail of every agentic action driven by platform data.
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success— across all AI consumers of the platform.
Architecture Standards & Engineering Enablement
Define and maintain the reference architecture for the AI data platform — documenting design patterns, data contracts, integration standards, and decision records (ADRs) that all engineering teams follow.
Establish data engineering standards: pipeline testing frameworks, code review practices, CI/CD automation, infrastructure-as-code (Terraform), reusable component libraries, and observability instrumentation.
Design the retrieval infrastructure that powers RAG-based AI applications: embedding pipelines, vector stores (Pinecone, FAISS, ChromaDB, OpenSearch), chunking strategies, and hybrid retrieval layers combining semantic search with structured queries.
Agentic Behaviour Observability & Output Accuracy
Own the observability stack for AI agent behaviour: instrument agents to capture inputs, retrieved context, tool calls, reasoning traces, and outputs — creating a complete audit trail of every agentic action driven by platform data.
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success— across all AI consumers of the platform.
Architecture Standards & Engineering Enablement
Define and maintain the reference architecture for the AI data platform — documenting design patterns, data contracts, integration standards, and decision records (ADRs) that all engineering teams follow.
Establish data engineering standards: pipeline testing frameworks, code review practices, CI/CD automation, infrastructure-as-code (Terraform), reusable component libraries, and observability instrumentation.
Benefits
Medical Insurance benefits as per company policy.
Dental insurance as per company policy.
Vision insurance as per company policy.
Employer paid Disability, Life, and AD&D insurance
Unlimited PTO
Paid parental leave
401K
Flexible work policy
12 Paid Holidays
Similar Jobs
Information Technology • Database • Consulting
Leads enterprise Data, AI, and digital transformation solution architecture and client pursuits. Designs scalable cloud, data, analytics, AI/ML, GenAI, and Agentic AI architectures; leads workshops, RFP responses, executive presentations, commercial closure, account expansion, and transition into delivery. Partners with engineering and delivery teams, mentors architects, and develops transformation roadmaps, business cases, accelerators, and industry thought leadership, particularly for Insurance and Financial Services clients.
Top Skills:
Agentic AiAi/MlAWSAzureDatabricksGenerative AiMicrosoft FabricSnowflake
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Leads enterprise-scale AI, data, and cloud architecture initiatives for federal customers. Advises executives, designs Azure-based generative AI and agent solutions, modernizes document-intensive workflows, and governs secure, compliant, scalable architectures. Drives customer adoption, technical strategy, pre-sales opportunities, value realization, risk management, reusable intellectual property, and architectural community development. Mentors technical teams and ensures production solutions incorporate evaluation, observability, traceability, security, and human review controls.
Top Skills:
Application InsightsAutogenAzure Ai Content SafetyAzure Ai Document IntelligenceAzure Ai FoundryAzure Ai SearchAzure Ai ServicesAzure Api ManagementAzure Application GatewayAzure Container AppsAzure DevopsAzure Front DoorAzure FunctionsAzure GovernmentAzure Key VaultAzure Kubernetes ServiceAzure Machine LearningAzure OpenaiAzure StorageBicepCopilotCopilot StudioCosmos DbDurable FunctionsFedramp HighGithub ActionsIl4Il5Managed IdentityAzurePrivate EndpointsRagSemantic KernelTerraformVnet
Information Technology
Advise enterprise clients on AI and data strategies, transformation roadmaps, operating models, governance, privacy, technology rationalization, and business cases. Lead discovery workshops, executive engagements, and art-of-the-possible sessions; prioritize use cases and connect technical recommendations to business outcomes. Build the advisory practice, develop offerings, manage multidisciplinary teams, mentor staff, strengthen client and partner relationships, and support successful distributed project delivery.
Top Skills:
Anthropic ClaudeAWSAzureCcpaCloud ComputingData GovernanceData PlatformsDataikuDbtFivetranGdprGleanKnimeMachine LearningSnowflake
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
