Software Engineer – Data Automation

The Software Engineer – Data Automation is responsible for the design and implementation of new data processing, API, and dashboard/visualization capabilities in an agile development environment with product engineers, product management, quality engineers, OSS data collectors, and IT staff to expand the depth and breadth of data Black Duck publishes in the Knowledge Base. 

The ideal candidate has a SQL, Python, Java and web programming (Javascript, JQuery, Bootstrap,...) background in a Linux environment, practices agile software development and is a strong verbal and interpersonal communicator with all levels and groups within an organization.

Responsibilities include, but are not limited to:

• Develop new automated data collection capabilities
• Develop dashboards to enable curating of collected data
• Develop and integrate analytical jobs into the KB production workflow
• Develop rich set of REST APIs to access / update KB data
• Monitor automated and manual data collection and publishing processes

  Requirements:

• Bachelors degree
• 4+ years of relevant experience (or 2+ years small company experience)
• Strong SQL programming skills
• Strong Python or perl scripting skills
• Strong Java programming skills
• Experience implementing crawlers, scrapers, parsers, ETL
• Experience with REST APIs
• Experience creating web front-ends (Django, Javascript, JQuery, Bootstrap...)
• Experience with Open Source development processes, licenses, projects and repositories (e.g. github, SourceForge, Apache, Eclipse, OSI)
• Experience working in Linux environment
• Experience with test automation
• Experience working with large datasets
• Experience with some/all of the following is a plus: Postgres, Solr, Machine Learning, Hadoop

  About Black Duck Software

  Organizations worldwide use Black Duck Software’s industry-leading products to secure and manage open source software, eliminating the pain related to security vulnerabilities, compliance and operational risk. Black Duck is headquartered in Burlington, MA, and has offices in San Jose, CA, Vancouver, London, Belfast, Frankfurt, Hong Kong, Tokyo, Seoul and Beijing.