Designs, maintains, and optimizes SQL Server databases, ETL/ELT workflows, and enterprise data pipelines supporting a federal multi-cloud analytics platform. Integrates structured and unstructured data using Azure, Databricks, Starburst, and data lakes; troubleshoots failures, tunes performance, applies data-quality and governance controls, and supports analytics, reporting, and machine-learning use cases. Translates business requirements into technical solutions and documents data products, pipelines, and operational procedures.
Description
About the Role
We are seeking an experienced SQL Developer / Database Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. In this role, you will design, maintain, integrate, and optimize SQL database structures, transformation logic, and data pipelines that ingest, condition, curate, and deliver multi-source data as secure, reusable enterprise data products. You will use SQL Server, Azure Data Factory, Synapse Pipelines, Databricks, Starburst, and Azure Data Lake Service to improve data reliability, performance, and interoperability across ATLAS and connected source platforms. You will troubleshoot discrepancies and ETL/ELT failures, translate business requirements into technical solutions, and help provide consistent access to trusted data that supports analytics, evidence-based decisions, and better outcomes for Veterans and their families.
Key Responsibilities
- Design, install, configure, maintain, and optimize SQL database systems and related data structures supporting ATLAS.
- Develop, maintain, monitor, and troubleshoot ETL/ELT workflows and data pipelines using Azure Data Factory and Synapse Pipelines.
- Integrate structured and unstructured data from databases, APIs, cloud platforms, and other enterprise sources into Azure Data Lake Service.
- Create and optimize complex SQL queries, stored procedures, database objects, and transformation logic for data conditioning and curation.
- Use Databricks and Starburst to query, transform, and integrate distributed data across lakehouse and enterprise data sources.
- Investigate data discrepancies, pipeline failures, and performance issues; perform root-cause analysis and implement durable fixes.
- Apply data-quality controls and support metadata management and data cataloging using Collibra.
- Monitor database and pipeline performance; perform query tuning, indexing, backup, recovery, patching, and reliability improvements.
- Support secure, consistent, and compliant access to enterprise data through appropriate identity, authorization, and data-protection controls.
- Collaborate with data engineers, analysts, data scientists, and product teams to create consumable data products and enable Azure ML/AI services.
- Support reporting and visualization needs using Pyramid Analytics and Power BI, including validation of underlying data structures and accuracy.
- Translate business requirements into technical specifications and communicate solutions clearly to technical and non-technical stakeholders.
- Document database structures, data mappings, pipelines, operational procedures, and technical decisions.
- Participate actively in Agile/Scrum ceremonies and support continuous improvement of ATLAS data services.
Minimum Qualifications
- Minimum five (5) years of experience in database development, administration, and maintenance.
- Strong experience with Microsoft SQL Server, including complex SQL queries, stored procedures, database design, indexing, optimization, and performance tuning.
- Experience developing and troubleshooting data integrations, ETL/ELT processes, and SSIS packages.
- Hands-on experience creating, updating, monitoring, and troubleshooting Azure Data Factory and Synapse Pipelines.
- Experience with Databricks, Starburst, Azure Data Lake Service, and distributed or large-scale datasets.
- Experience with Collibra for data cataloging, metadata management, or data governance.
- Experience supporting Azure ML/AI services and preparing reliable data for analytics or machine-learning use cases.
- Experience supporting Pyramid Analytics and Power BI visualization solutions and validating source data.
- Excellent troubleshooting and root-cause analysis skills.
- Ability to understand business requirements and translate them into technical specifications.
- Ability to communicate technical details to non-technical users and stakeholders, with excellent written and verbal communication skills.
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.
Preferred Qualifications
- Experience supporting federal agencies, the Department of Veterans Affairs, or other regulated environments.
- Experience with enterprise data lakes, lakehouses, Delta Lake, Parquet, and multi-cloud data integration.
- Experience working independently and collaboratively within Agile data-product teams.
Similar Jobs
Legal Tech
Own and scale the PostgreSQL and AWS Aurora database layer for a high-volume legal-services platform. Responsibilities include schema and migration review, query and index tuning, production issue diagnosis, lock and replication troubleshooting, database maintenance automation, backup and restore support, access control, and collaboration with infrastructure, software development, and data science teams. The role also supports reporting, billing, PII-sensitive data, and ERP-related data flows.
Top Skills:
Amazon Rds Performance InsightsAws Aurora PostgresqlAws CloudwatchBashBoomiClaudeCodexCronErpIpaasJavaLinuxMetabaseMybatisNetSuitePg_Stat_StatementsPgadminPostgisPostgresSpringSQL
Healthtech • Information Technology • Consulting
Maintain and administer Microsoft SQL Server databases supporting healthcare research administration, compliance, reporting, and operations. Design schemas and tables; develop and optimize stored procedures, queries, scripts, utilities, and reports; manage scheduled jobs; monitor performance, security, backups, recovery, and data integrity; troubleshoot database and application issues; coordinate with web developers; document solutions; and provide technical recommendations to research leaders.
Top Skills:
Coldfusion/CfmlHTMLJavaJavaScriptMicrosoft AccessMicrosoft Sql ServerOlapSQLSql Server Reporting Services (Ssrs)XML
Software
Administer and modernize enterprise Microsoft SQL Server platforms supporting downtime-sensitive semiconductor and telecommunications manufacturing. Responsibilities include advanced T-SQL and SSIS development, performance tuning, backup and disaster recovery, high availability, security, automation, migrations, cloud adoption, capacity planning, incident response, and database architecture. The role provides technical leadership, mentoring, documentation, and cross-functional guidance in 24/7 production environments.
Top Skills:
AzureCi/CdClusteringDmvETLMariadbMicrosoft Sql ServerOracle 19CPostgresPowershellQuery StoreReplicationSource ControlSql AgentSsisSsisdbT-SqlTempdb
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
