540 Logo

540

Senior Data Engineer

Posted 11 Hours Ago
Easy Apply
Remote
Hiring Remotely in USA
Senior level
Easy Apply
Remote
Hiring Remotely in USA
Senior level
The Senior Data Engineer designs and builds AWS-based data pipelines, collaborates with stakeholders, optimizes performance and mentors junior engineers.
The summary above was generated by AI

540 is seeking a Senior Data Engineer to design, build, and optimize cloud-based data pipelines supporting high-impact federal missions. In this role, you’ll contribute hands-on to the development of scalable data pipelines in AWS while collaborating closely with technical leads and stakeholders to deliver robust solutions that drive meaningful business insights.

This position is ideal for an experienced data engineer who enjoys solving complex data challenges, writing production-quality code, and mentoring junior team members while continuing to grow their own technical impact.

Location: Remote within the continental United States. Core collaboration hours align with Eastern Time, with flexibility. Occasional travel (3-4x annually)
Citizenship & Clearance Requirement: per client requirements, must be a U.S. Citizen with the ability to obtain a DoD Secret clearance
Education Requirement: Bachelor’s Degree in Computer Science or related engineering field (preferred)
540 Internal Thrive Level: Software Engineer III or Senior

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Design, develop, and maintain scalable data pipelines and ETL processes using Python and AWS services
  • Build and deploy serverless functions using AWS Lambda for data processing and automation
  • Implement data integration solutions connecting diverse source systems to analytics platforms 
  • Mentor junior data engineers through pair programming, code reviews, and technical coaching
  • Collaborate with data analysts and business stakeholders to understand requirements and deliver solutions
  • Optimize data pipeline performance, reliability, and cost efficiency in AWS environments 
  • Develop and maintain comprehensive documentation for data systems and processes
  • Participate in on-call rotation to support production data infrastructure
  • Contribute to the establishment of team coding standards and engineering best practices 
  • Work with Git for version control and participate in collaborative development workflows

REQUIRED SKILLS & EXPERIENCE

  • 6+ years of experience in data engineering or related technical roles
  • Strong proficiency in Python programming with experience building production data applications
  • Solid understanding of AWS architecture and services (Lambda, S3, Glue, RDS, Redshift, etc.)
  • Experience with Git version control and branching strategies
  • Knowledge of SQL and relational database design principles
  • Familiarity with data modeling techniques and data warehouse concepts
  • Experience with RESTful APIs and data integration patterns
  • Strong problem-solving skills and attention to detail
  • Excellent communication skills and demonstrated ability to mentor others
  • Currently possess or be able to obtain within 30 days of hire:
    • AWS Cloud Practitioner certification (or higher) 
    • CompTIA Security+ certification (or higher) 

NICE TO HAVE

  • Familiarity with X12/MILS processing
  • Experience with Apache Spark, Kafka, or other distributed processing frameworks
  • Knowledge of data orchestration tools (Apache Airflow, AWS Step Functions)
  • Exposure to Infrastructure-as-Code tools (Terraform, CloudFormation)
  • Understanding of DevOps practices and CI/CD pipelines
  • AWS certifications (Solutions Architect, Data Analytics, or similar)

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Top Skills

Apache Airflow
Spark
AWS
CloudFormation
Git
Kafka
Python
Restful Apis
SQL
Terraform

Similar Jobs

5 Days Ago
Remote
United States
Senior level
Senior level
Blockchain • Fintech • Financial Services • Cryptocurrency
The Senior Data Engineer at Unchained will design and implement data pipelines, integrate APIs, ensure data governance, and mentor team members while focusing on accuracy and security.
Top Skills: AWSDagsterDbtDockerKubernetesPostgresPythonSQLTerraform
6 Days Ago
Remote or Hybrid
United States
100K-150K Annually
Senior level
100K-150K Annually
Senior level
Artificial Intelligence • Big Data • Consumer Web • Digital Media • Marketing Tech
The Senior Data Engineer will manage data infrastructure, build data pipelines, develop dashboards for analytics, and ensure data quality while collaborating with various teams.
Top Skills: AirflowBigQueryDbtFivetranLookerPower BIPythonRRedshiftSnowflakeSQLTableau
13 Days Ago
Easy Apply
Remote
USA
Easy Apply
174K-211K Annually
Senior level
174K-211K Annually
Senior level
Fintech • Social Impact • Software
The Senior Data Engineer II will build and maintain data pipelines, support ML workflows, and enhance data architecture within the Data Department, contributing to the integration of ActBlue's internal data platform with user applications.
Top Skills: DatadogDbtFivetranPostgresPytestPythonRedshiftSagemakerVertex Ai

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account