Devo, the cloud-native logging and security analytics company, empowers security and operations teams to maximize the value of all their data. Only the Devo platform delivers the powerful combination of real-time visibility, high-performance analytics, scalability, multitenancy, and low TCO crucial for monitoring and securing business operations as enterprises accelerate their shift to the cloud. Headquartered in Cambridge, Mass., Devo is backed by Insight Partners, Georgian, and Bessemer Venture Partners. Learn more at www.devo.com.

A Security Content QA Engineer at Devo teams with our security researchers, data scientists, and product management to assess, advise, and assure that the security content we crate for the Devo platform is both effective and of the highest quality before it reaches our customers.

As a proven subject matter expert in software quality excellence, a security content QA engineer applies their deep knowledge, hands-on experience, and attention to detail to the complexities of modern threat detection development. As the bastion of trustworthiness for the efficacy and performance of security content, our QA engineers are masters of testing classic query-based content, pre-trained ML classifiers, and evolving AI learning systems.

When not evaluating new security content and safeguarding our customers from harm, a security content QA engineer can expect to work with our security researchers and data scientists on new automation systems to continuously monitor and evaluate the efficacy of fielded content, and guide content and platform developers in cutting-edge performance engineering practices.
Responsibilities:

• Our security content QA engineers are not pure black box testers, they are able to understand software internals, debug problems using log files, and write automated tests with scripting tools and/or user-level automated tools.
• Understand the product domain, define test strategy and test plans, develop and drive test case execution and drive best practices to release high quality security content to our customers.
• Team with experts in machine learning and artificial intelligence to innovate threat detection and automated response solutions and to understand features and technical implementation.
• Work with groups such as Product Management, and in-house SOC to understand customer usage models and develop test plans and suites that approximate real-world environments and regression tests driving the security content development process toward quality-centric methodologies.
• Help acquire, vet, and triage security datasets used by data science teams and help train new machine learning and behavioral anomaly detection systems.
• Develop automated tests to help fasten testing cycles and release faster to our customers.
• Advise Devo and customer SOC teams with alert integration and usage and help formulate future requirements for additional alerts.
• Harness your deep QA knowledge to preemptively identify potential weaknesses in the Devo platform.
• Collaborate remotely with global security research, data science, and content engineering team members.

Qualifications:

• 6+ year of experience working as a Quality Assurance Engineer
• Knowledge of QA methodology and industry-standard testing and bug tracking tools
• Experience in both automation and manual testing
• Experience in one or more Scripting/Programming Languages including Python and JavaScript
• Experience with Continuous Integration systems and codebase management, and driving quality through process, instrumentation, requirements and testing
• Develop Automation test strategies for complex programs, automation strategies, test plans and test cases
• Ability to investigate, debug and triage difficult problems in automation, and independently work towards results
• Interpret and report testing results and be a vocal proponent for quality in every phase of the content development process
• Experience communicating cross-functionally and across management levels in formal and informal settings
• Ability to adapt to a fast-paced, changing environment
• Demonstrate excellent presentation & time management skills and must be a great team player
• Demonstrate outstanding analytical skills with ability to recognize and articulate deviations and participate in the excellence of on-going process improvements
• Strong problem solving, troubleshooting and analysis skills
• Excellent written and verbal communication skills
• Excellent inter-personal and teamwork skills - experienced working with team members in different time zones around the world
• Proactive, hard-working team player that is self-driven and able to efficiently work remotely without close supervision
• Ability to communicate deep technical issues or concerns to a non-security audience

Preferred Qualifications:

• Automation experience with testing methodologies; UI, Continuous Integration, Functional, Performance, and Regression
• Previous experience within the cybersecurity domain and automated testing of malware and threat detection content, or intrusion detection rules and vulnerability scanning checks
• Familiarity with managing compliance standards and documentation for external industry standard audits
• Maintain and scale automation suites
• Ability to deliver solid work on tight schedules and proven ability to dive in and learn complex systems quickly
• Familiar with Machine Learning and analytics technologies and experience working with engineering or data science teams
• Expertise building test strategies, automation strategies for complex programs
• Knowledgeable in network and application protocols, including traffic analysis proficiency with network forensics tools
• Knowledge and experience with workflow and collaboration tooling such as Atlassian, Jira and Confluence