Hadoop Platform Software Engineer

| Greater Boston Area

Responsibilities:

  • Integrates existing products with Hadoop and supports existing Hadoop infrastructure.
  • Provides automation for testing of existing products with different Hadoop distributions (such as Cloudera & Hortonworks).
  • Creates software for integration of existing products with different Hadoop distributions.
  • Creates plans for further improvements to DataRobot’s Hadoop experience.
  • Confirms that clients’ systems and infrastructures are acceptable for running DataRobot on Hadoop.
  • Makes sure existing automation is reliable and extends existing automation with Hadoop related pipelines.
  • Makes sure new application releases are tested properly with Hadoop.
  • Checks for new versions of Hadoop and verifies that application works with these versions of Hadoop.
  • Makes sure Hadoop portion of the application meets standards of Hadoop providers.
  • Provides documentation and tests for new software.
  • Improves job knowledge by studying architecture of different distributed computing frameworks and Hadoop ecosystem.
  • Participates in educational opportunities and reads professional publications.
  • Contributes to team effort by accomplishing related results as needed.

Main Requirements:

  • Bachelor’s degree in Computer Information Systems, Project Management, Engineering, Physics, or related
  • 3 years of experience as a Software Engineer or related occupation
  • 3 years supporting Hadoop customer integrations and administering enterprise production Hadoop clusters.
  • 3 years Linux system configuration and administration.
  • 3 years of experience with each of the following:
    • Hadoop ecosystem security technologies such as Kerberos, LDAP, and Active Directory.
    • Core Hadoop architecture components (HDFS, YARN, ZooKeeper).
    • Cloud technologies such as AWS.
    • Configuration management tools such as Ansible, Puppet, Chef.
    • Java or Scala and scripting in Python and Bash.
    • Multiple Hadoop distributions (Cloudera, Hortonworks, etc.).
  • 3 years of experience with Docker.
  • Hadoop certification from Cloudera or Hortonworks.

Individuals seeking employment at DataRobot are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation.

Read Full Job Description

Technology we use

  • Engineering
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • D3JSLibraries
    • FluxLibraries
    • jQuery UILibraries
    • ReactLibraries
    • AngularJSFrameworks
    • DjangoFrameworks
    • FlaskFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • TensorFlowFrameworks
    • NumPyFrameworks
    • PandasFrameworks
    • Scikit-learnFrameworks
    • HiveDatabases
    • MongoDBDatabases
    • MySQLDatabases
    • PostgreSQLDatabases
    • RedisDatabases
    • DockerDatabases
    • RabbitMQDatabases
    • WordpressCMS
    • HubSpotCRM
    • SalesforceCRM
    • MarketoLead Gen

Location

1 International Place 5th Floor, Boston, MA 02110

What are DataRobot Perks + Benefits

More Jobs at DataRobot38 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
HR
Marketing
Operations
Product
Project Mgmt
Sales
Content
Sales
new
Boston
Developer
new
Boston
Project Mgmt
new
Boston
Content
new
Boston
Project Mgmt
new
Boston
Developer
new
Boston
Developer
new
Boston
Content
new
Boston
Data + Analytics
new
Boston
Developer
new
Boston
Marketing
new
Boston
Marketing
new
Boston
Project Mgmt
new
Boston
Operations
new
Boston
Developer
new
Boston
HR
new
Boston
Sales
new
Boston
Marketing
new
Boston
Operations
new
Boston
Operations
new
Boston
Operations
new
Boston
Operations
new
Boston