SOUTHWORKS Logo

SOUTHWORKS

(Contract) Data Platform Engineer (AWS & Data Pipelines)

Posted 18 Days Ago
In-Office or Remote
Hiring Remotely in Bellevue, Washington
Senior level
In-Office or Remote
Hiring Remotely in Bellevue, Washington
Senior level
Design, build, and operate scalable data pipelines and cloud solutions, focusing on monitoring and automation while working with AWS services.
The summary above was generated by AI

Type: Contract, per-project.
Location:
Remote — within LATAM with ET ±1 hour
Availability:
Contractor (40 hours per week)

Job Title: Data / Platform Engineer (AWS & Data Pipelines)

We are looking for a highly motivated Data / Platform Engineer to join our team and help design, build and operate scalable data pipelines and cloud-based solutions.

In this role, you will work closely with engineering and product teams to build both streaming and batch data pipelines, contribute to system design, and help drive automation and monitoring across our data platform.

Key Responsibilities

  • Design, build, maintain and primarily operate scalable streaming and batch data pipelines, with a strong focus on maintenance, monitoring, troubleshooting and continuous improvement of existing pipelines.

  • Work with AWS services, including Redshift, EMR and ECS, to support data processing and analytics workloads.

  • Develop and maintain data workflows using Python and SQL.

  • Orchestrate and monitor pipelines using Apache Airflow.

  • Build and deploy containerized applications using Docker and Kubernetes.

  • Break down high-level system designs into well-defined, deliverable tasks with realistic estimates.

  • Collaborate with cross-functional teams in a fast-paced and distributed environment across the US and Europe.

  • Drive automation, observability and monitoring to improve reliability, performance and operational efficiency.

  • Support knowledge transfer and ownership handover as part of the planned transition to the consuming team.

Required Qualifications

  • Strong professional experience with Python and SQL.

  • Hands-on experience with AWS, specifically Redshift, EMR and ECS. AWS experience is mandatory (other cloud providers are not considered equivalent for this role).

  • Proven experience building and operating both streaming and batch data pipelines.

  • Professional experience with Apache Airflow, Docker and Kubernetes.

  • Ability to translate high-level system designs into actionable technical tasks and realistic estimates.

  • Comfortable working in dynamic and fast-paced environments and in distributed teams.

  • Strong interest in automation and monitoring.

  • Strong hands-on experience with Apache Spark.

  • Senior-level profile with strong autonomy, communication skills and ability to work effectively in distributed teams.

  • Proven ability to transfer knowledge and support ownership handovers.

  • Fluent or professional working proficiency in English (both written and spoken).

Nice to Have

  • Previous experience in the telecom industry.

  • Experience with machine learning systems and/or event-driven architectures.

  • Experience with Apache Iceberg.
    (*) SOUTHWORKS only hires individuals from countries that are not blocked or sanctioned by the United States, including those identified on the United States Office of Foreign Asset Control (OFAC).

Similar Jobs

12 Hours Ago
Remote or Hybrid
300K-300K Annually
Senior level
300K-300K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
As a Senior Software Engineer on the Productivity team, you'll enhance developer productivity, optimize CI/CD pipelines, and build internal tooling, all while influencing engineering velocity and code quality with a focus on AI-driven automation and collaboration across engineering teams.
Top Skills: Alibaba CloudAWSCi/CdDockerGCPGoJavaKotlinKubernetesNode.jsPythonRustTerraform
12 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead the architecture and improvement of developer tooling and infrastructure at Airwallex, optimizing CI/CD processes and fostering productivity with AI-driven solutions across engineering teams.
Top Skills: Ai/MlAWSCi/CdDatadogDockerElk StackGCPGoGrafanaJavaKafkaKotlinKubernetesNode.jsPrometheusPythonRustTerraform
12 Hours Ago
Easy Apply
Remote
United States
Easy Apply
150K-185K Annually
Senior level
150K-185K Annually
Senior level
Artificial Intelligence • Healthtech • Information Technology • Software • Conversational AI • Generative AI • Automation
The Founding Product Marketing Manager will develop product positioning, lead go-to-market strategies, create customer assets, and drive customer advocacy in a fast-paced healthcare tech environment.
Top Skills: AIB2B SaasSales Enablement Tools

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account