SoHo Dragon Logo

SoHo Dragon

Data Engineer

Posted 10 Days Ago
In-Office
Boston, MA
Mid level
In-Office
Boston, MA
Mid level
The Data Engineer will design and maintain data systems, build data pipelines, collaborate within Agile teams, and enhance data-driven decision-making.
The summary above was generated by AI

Position: Data Engineer
Location: Boston, MA(Hybrid 3x in office)
Employment Type:Contract-to-hire

Contract Duration: 1-2 years

The data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineer will work with a multidisciplinary Agile team to build high-quality data pipelines, generate insights from connected data, and advance the company's data-driven decision-making capabilities.

Responsibilities:

Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to ELT principles and business goals.
Solves complex data problems to delivers insights that helps business achieve its goals.
Creates data products for engineer, analyst, and data scientist team members to accelerate their productivity.
Engineer effective features for modelling in close collaboration with data scientists and businesses.
Leads the evaluation, implementation and deployment of emerging tools and process for analytics data engineering in order to improve productivity as a team and quality.
Partners with machine learning engineers, BI, and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
Fosters a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
Advises, consults, mentors, and coach other data and analytic professionals on data standards and practices.
Develops and delivers communication and education plans on analytic data engineering capabilities, standards, and processes.
Learns about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics as necessary to carry out role effectively.

Key Skills:

  • Experience in building data pipelines and deploying/maintaining them following modern DE best practices -target tech stack: Python OSS Data Ecosystem (PySpark, pandas, Dash); knowledge of SQL, DBT is a plus
  • Experience with designing and maintaining data warehouses and/or data lakes with big data technologies such as Spark/Databricks, or distributed databases, like Redshift and Snowflake, and experience with housing,accessing, and transforming data in a variety of relational databases 
  • Strong understanding of agile methodologies and experience as a Data Engineer on a cross-functional agile
    team preferred
  • Software Engineering fundamentals and software development tooling (e.g., Git, CI/CD, JIRA) and familiarity
    with the Linux operating system and the Bash/Z shell
  • Experience with cloud database technologies (e.g., Azure) and developing solutions on cloud computing
    services and infrastructure in the data and analytics space 
  • Basic familiarity with BI tools (e.g., Alteryx, Tableau, Power BI, Looker)
  • Experience working in data engineering or data architect role

Qualifications &Technical Skills

  • Bachelor’s degree in computer science, statistics, engineering, or a related field
  • 3+ years experience as a Data Engineer, preferably in a large organization

Interpersonal Mindset & Behaviors

  • Focused on agile delivery with a “fail-fast, succeed early” mindset and measurable outcomes
  • Flexibility to changes in work direction as the project develops according to highest-priority business needs
  • Strong work ethic; ability to work at an abstract level and gain consensus 
  • Exemplary organizational skills with attention to detail, access, and quality assurance
  • Excellent communication and listening skills, collaborating closely with multidisciplinary team members
  • Have a “can do” attitude and thrive on a “test and learn” mentality

Top Skills

Alteryx
Azure
Ci/Cd
Dash
Databricks
Dbt
Git
Looker
Pandas
Power BI
Pyspark
Python
Redshift
Snowflake
Spark
SQL
Tableau

Similar Jobs

7 Days Ago
In-Office
Boston, MA, USA
148K-195K Annually
Mid level
148K-195K Annually
Mid level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
As a Data Engineer II/Senior Data Engineer, you will manage data pipelines and warehouses for blockchain analytics, ensuring data accuracy and efficiency while collaborating with data teams to support product decisions.
Top Skills: AirflowAWSAzureBigQueryDagsterDatabricksDbtGCPJavaPythonScalaSnowflakeSQL
6 Days Ago
In-Office
Quincy, MA, USA
21-37
Internship
21-37
Internship
AdTech • eCommerce • Food • Marketing Tech • Retail
The Data Engineer Co-op will support the Data Engineering team by working with AI technologies, developing data pipelines, and writing APIs. The role offers exposure to web data feeds and operational processes in a hybrid work environment.
Top Skills: Azure AiChatgpt AiPythonSQL
Yesterday
Hybrid
Boston, MA, USA
200K-368K Annually
Senior level
200K-368K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead the design and evolution of Mastercard's enterprise data architecture, focusing on modernization, governance, and cross-functional leadership in data solutions.
Top Skills: SparkAWSAzureCloudera/HadoopDatabricksDelta LakeFlinkGCPKafkaNifiRedshiftSnowflake

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account