Credence Logo

Credence

Senior Data Engineer

Posted 14 Days Ago
In-Office
Boston, MA, USA
115K-155K Annually
Senior level
In-Office
Boston, MA, USA
115K-155K Annually
Senior level
Designs and deploys cloud-native data and AI solutions for federal missions. Builds pipelines for generative AI and LLMs, engineers data lakes and warehouses, manages SQL and NoSQL systems, and develops vector database and RAG capabilities. Collaborates on agentic AI systems, automates deployment with IaC and CI/CD, monitors production performance, and documents reliable, scalable implementations. The role also requires staying current with AI technologies and supporting technical growth through collaboration and mentorship.
The summary above was generated by AI

Overview

Join a team where innovation meets mission. Our AI, cloud, cyber, and modernization solutions save agencies thousands of hours, safeguard national security, and strengthen health and humanitarian missions worldwide. With 1,700+ team members, 1,500+ AI/data experts, and 100+ prime contracts, we deliver at scale and with purpose.

We’ve been recognized as a Top Workplace by the Washington Post for six straight years and named to the Inc. 5000 Fastest Growing Private Companies 13 of the past 14 years. Credence is a welcoming home for those looking to grow and contribute to positive change. We encourage all employees to expand beyond their boundaries, dive into important world-changing Federal challenges.

Position Summary

Credence has an immediate need for a Senior AI Data Engineer to join our growing AI and Automation practice. You will be a technical anchor in our AI and Automation practice. You’ll apply advanced AI and data engineering expertise to design, build, and deploy data-driven solutions. You’ll drive agentic AI development lifecycles and collaborate across engineering, data, and stakeholder teams to deliver high-impact, cloud-native AI capabilities that advance federal missions.

Responsibilities include, but are not limited to the duties listed below

  • Data Integrations for Generative AI & LLM Usage
    Build and optimize data pipelines that prepare, clean, and structure data for generative AI and LLM usage.
  • Data Lake & Warehouse Engineering 
    Manage and organize large datasets across cloud platforms (e.g., AWS, Azure, GCP) using data lake and warehouse technologies. Implement medallion architecture (Bronze/Silver/Gold layers) to ensure data quality, lineage, and accessibility.
  • Database Management & Performance
    Work with both SQL and NoSQL systems to model, query, and load large-scale datasets. Monitor, tune, and maintain high-performance data stores supporting analytics and reporting.
  • Collaborative Engineering
    Work alongside data engineers, software engineers, and data scientists to develop operational agentic AI systems.
  • Cloud Enablement
    Help automate model deployment workflows using Infrastructure as Code (IaC), CI/CD pipelines, and container orchestration tools.
  • Production Monitoring & Optimization
    Monitor AI systems post-deployment, perform performance tuning, and apply best practices for reliability and scalability.
  • Technical Rigor & Documentation
    Write clean, well-documented code following industry and federal guidelines, support reproducible development.
  • Professional Growth
    Stay current on AI/ML trends and tools and actively learn from senior team members through mentorship and technical design reviews.

Requirements
  • U.S. Citizenship with eligibility for DoD Secret clearance.
  • Bachelor’s or Master’s in Computer Science, Data/AI/ML, or a related field.
  • 7+ years of hands-on experience delivering Data/AI/ML solutions.
  • Strong understanding of ETL, ELT, and other similar data pipeline processes, as well as Enterprise Data and Storage Systems, such as experience with OpenSearch/Elastic Search, Kafka, Bedrock, Glue, DataBricks, Snowflake, AWS S3, RDS, EBS, or Glacier
  • Experience with vector databases, embeddings, and their affiliated data structures, file formats, services, APIs, etc (e.g. FAISS, PGVector, OpenSearch/Elasticsearch, Hugging face with Pinecone, Bedrock Knowledge Base)
  • Experience in generative AI, working with LLMs, adding tool calls (MCP) and agents (A2A).
  • Understanding of leading AI APIs such as OpenAI, Anthropic, Gemini, Bedrock, Vertex for use with LLMs and RAG search.
  • Familiarity with CI/CD pipelines (GitLab/GitHub/Jenkins)
  • Experience with VS Code and AI extensions such as Cline and Claude Code.
  • Strong communication skills and client-oriented mindset.

Preferred

  • Curious and experimental about the latest innovations in AI with an orientation toward the relentless pursuit of delivering mission impact.
  • Python proficiency and familiarity with libraries and frameworks (Pyspark, Pandas, uv, Pydantic, FastAPI, CrewAI, LangChain, LangGraph, Unstructured).
  • Experience with IaC tools such as Terraform, Open Tofu, AWS CDK, or CloudFormation to deploy cloud native applications.
  • Experience with agentic frameworks such as Agent2Agent Protocol, AWS Bedrock Agents, Mastra, CrewAI, Strands, or AgentCore.
  • Exposure to adjacent skillsets such as data science, UI/UX, cloud engineering, and platform engineering to understand the entire software ecosystem.
  • Knowledge of federal cybersecurity, RMF, FedRAMP, or regulatory frameworks.

Why This Role Matters

  • Real-World Impact — Your work will support defense and health agencies where AI solutions directly contribute to national security and public well-being.
  • Growth-Oriented Environment — Learn from technical leaders, innovate within Agentic AI, and mentor those around you in AI best practices.
  • Culture of Empowerment — You’ll be part of a team that values innovation, trust, collaboration, and mission success.

Salary Range: $115,000 - $155,000 annually. Actual compensation will be determined based on the selected candidate's experience, education, certifications, skills, and overall qualifications.


Benefits
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
  • Wellness Resources

Similar Jobs

3 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
150K-250K Annually
Senior level
150K-250K Annually
Senior level
Fintech • Software • Financial Services
Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.
Top Skills: AirflowArgo WorkflowsChange Data CaptureDatadogDbtFivetranKubernetesPythonReverse EtlSegmentSnowflakeSQL
7 Days Ago
In-Office
180K-225K Annually
Senior level
180K-225K Annually
Senior level
eCommerce • Fintech • Payments • Software • Financial Services
Build and operate the Global Card team’s data foundation, including pipelines, schemas, data marts, feature pipelines, quality monitoring, and data contracts. Lead architecture and technical direction, partner with product, analytics, and data science teams, contribute to backend services, establish engineering standards, mentor colleagues, and ensure reliable, secure, scalable data systems.
Top Skills: AWSCi/CdData ModelingData PipelinesDimensional ModelingDistributed ProcessingEmrGoJavaPythonScalaSparkSQLStreamingTrino
13 Days Ago
In-Office or Remote
US
136K-220K Annually
Senior level
136K-220K Annually
Senior level
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.
Top Skills: Ai Coding AgentsAmazon Web ServicesAPIsCdcCi/CdClaude CodeDbtEstuaryGitGoogle BigqueryGoogle Cloud PlatformHevoLakehouseMcpOpen Table FormatsPythonSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account