Senior Data Engineer, Engineering Productivity

| Greater Boston Area
Sorry, this job was removed at 11:06 a.m. (EST) on Thursday, August 29, 2019
Find out who's hiring remotely in Greater Boston Area.
See all Remote Data + Analytics jobs in Greater Boston Area
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

DataRobot is looking for an experienced software engineer to join our team working on Big Data problems. As a team member, you will work on building a data processing framework that allows the DataRobot application to scale to new heights. The ideal candidate should have experience in distributed computing and storage architectures and be able to think at scale.

Main Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field
  • 5+ years experience building large scale, highly available, distributed computing systems
  • 3+ years experience in Scala or Java (Scala is prefered)
  • 2+ years experience working in the Hadoop stack (HDFS, Yarn, ZooKeeper, etc.)
  • 1+ years experience in Python.
  • Fundamental knowledge of data structures, algorithms, and complexity analysis
  • Ability to expertly design and produce high quality, high performance code ready to ship
  • Hands on experience with Big Data technologies (e.g. Hadoop MapReduce, Spark, Hive, Vertica, Netezza, Greenplum, Aster)
  • Familiarity with internals of distributed data processing engines such as Spark
  • Ability to evaluate and optimize performance and scalability in the context of big data processing and storage.
  • Experience working in GNU/Linux environments
  • Understanding of software design principles and best practices (test driven development, source control management,,
  • Open minded, curious, and thorough.
  • Proficient in English

Desired Skills

  • PhD or Master’s degree in Computer Science, Engineering, or related field
  • Past experience designing and building scalable ETL systems / data pipelines
  • General Data Science knowledge (basic AI + Machine learning concepts)
  • Familiar with the following tools: Git, Docker, Jenkins,
  • Experience in performance optimization and implementing high performance code
  • Developing fault tolerant systems
  • Knowledge of cloud infrastructure (e.g ec2, s3)
Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

1 International Place 5th Floor, Boston, MA 02110

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about DataRobotFind similar jobs