540 Logo

540

Lead Data Engineer

Posted Yesterday
Be an Early Applicant
Easy Apply
Remote
Hiring Remotely in USA
Expert/Leader
Easy Apply
Remote
Hiring Remotely in USA
Expert/Leader
Lead design and implementation of scalable data pipelines and ETL in AWS, providing guidance and mentorship to engineering teams.
The summary above was generated by AI

540 is seeking a Lead Data Engineer to own the technical direction of mission-critical, cloud-based data platforms supporting high-impact federal missions.

In this role, you’ll lead the architecture and implementation of scalable data pipelines in AWS, set engineering standards, and act as a technical mentor across teams, while remaining deeply hands-on in building and evolving our data infrastructure. This is an opportunity for a senior engineer who thrives at the intersection of architecture, execution, and mentorship and wants to build modern data solutions that matter.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3-4x annually)
Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance
Education Requirement: Bachelor’s Degree in Computer Science or related engineering field (preferred)
540 Internal Thrive Level: Senior Software Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Lead the design and implementation of enterprise-scale data pipelines and ETL processes in AWS environments
  • Provide technical leadership and architectural guidance to cross-functional engineering teams
  • Drive best practices for data modeling, pipeline optimization, and cloud infrastructure design
  • Architect and implement solutions using Python, AWS Lambda, and modern data engineering frameworks
  • Oversee code quality, conduct architectural reviews, and establish engineering standards
  • Collaborate with stakeholders to translate complex business requirements into technical solutions
  • Mentor and develop junior and senior engineers through code reviews and technical guidance
  • Troubleshoot and resolve complex data engineering challenges across the technology stack
  • Stay current with emerging technologies and recommend innovative approaches to data challenges 

REQUIRED SKILLS & EXPERIENCE

  • 9+ years of professional experience in data engineering or related technical roles
  • Demonstrated experience as a technical lead or architect on complex data projects
  • Expert-level proficiency in Python programming and software engineering best practices
  • Deep understanding of AWS services including Lambda, S3, Step Functions, Glue, EMR, Redshift, and related data tools
  • Strong experience with Git version control and collaborative development workflows
  • Proven track record of designing and implementing scalable, high-performance data solutions
  • Experience with data warehousing concepts, dimensional modeling, and analytics platforms
  • Strong understanding of CI/CD pipelines and infrastructure-as-code principles
  • Excellent communication skills with ability to explain complex technical concepts to diverse audiences
  • Currently possess or be able to obtain within 30 days of hire:
    • AWS Cloud Practitioner certification (or higher) 
    • CompTIA Security+ certification (or higher) 

NICE TO HAVE

  • Familiarity with X12/MILS processing
  • AWS certifications (Solutions Architect, Data Analytics, or similar)
  • Background in Agile/Scrum development methodologies
  • Experience with containerization technologies (Docker, ECS, EKS)
  • Familiarity with data governance and security best practices

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Top Skills

AWS
Aws Lambda
Git
Python

Similar Jobs

12 Days Ago
Remote
U.S.
180K-200K Annually
Senior level
180K-200K Annually
Senior level
HR Tech • Payments • Software • Financial Services
As Lead Data Engineer, you will design and build Benepass's data infrastructure, partner with teams to deliver data capabilities, and set the vision for data engineering. You'll ensure data governance and manage pipelines in an AWS environment while preparing for future team growth.
Top Skills: AirflowAWSDagsterDbtKafkaKinesisPythonRdsRedshiftS3SQL
Yesterday
Easy Apply
Remote
USA
Easy Apply
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
3 Days Ago
Easy Apply
Remote
United States
Easy Apply
147K-160K Annually
Senior level
147K-160K Annually
Senior level
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills: AWSAzureETLGCPHadoopPythonSparkSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account