Software Testing Frameworks

This post features software testing frameworks or software testing tools.

To check software testing tools focused on information security, you can read more about:

Do not confuse software testing tools with automation software like browser automation tools and robotic process automation (RPA) tools.

Software Testing Standards

Software testing standards featured on this post:

  • ISO/IEC/IEEE 29119

ISO/IEC/IEEE 29119

ISO/IEC/IEEE 29119 is a standard for software testing.

It is composed of parts:

  1. ISO/IEC/IEEE 29119-1:2013, Part 1: Concepts and definitions
  2. ISO/IEC/IEEE 29119-2:2013, Part 2: Test processes
  3. ISO/IEC/IEEE 29119-3:2013, Part 3: Test documentation
  4. ISO/IEC/IEEE 29119-4:2015, Part 4: Test techniques
  5. ISO/IEC/IEEE 29119-5:2016, Part 5: Keyword-driven testing

ISO/IEC/IEEEE 29119-1:2013 was published in September 2013.

ISO/IEC/IEEE 29119-2:2013, about test processes, was published in September 2013.

ISO/IEC/IEEE 29119-3:2013, about test documentation, was published in September 2013.

It contains the following documents:

Organizational Test Process Documentation:
– Test Policy
– Organizational Test Strategy
Test Management Process Documentation:
– Test Plan (including a Test Strategy)
– Test Status
– Test Completion
Dynamic Test Process Documentation:
– Test Design Specification
– Test Case Specification
– Test Procedure Specification
– Test Data Requirements
– Test Data Readiness Report
– Test Environment Requirements
– Test Environment Readiness Report
– Actual Results
– Test Result
– Test Execution Log
– Test Incident Report

ISO/IEC/IEEE 29119-4:2015 was published in December 2015.

ISO/IEC/IEEE 29119-5:2016 was published in November 2016.

ISO/IEC/IEEE 29119 at Wikipedia

Software Testing Maturity

This section is about software testing maturity.

Software Testing Maturity Frameworks

Software testing maturity frameworks:

  • TMMI

TMMI

Testing Maturity Model (TMMi) assign maturity levels to software testing.

Software Testing Tools

List of tools for software frameworks or tools:

  • Java
    • JUnit
  • JavaScript
    • Cypress
    • Jasmine
    • MochaJS
  • PHP
    • PHPUnit
  • Microsoft .NET
    • MS Test
  • SAP ABAP
    • ABAP Unit
    • Tricentis Tosca
  • Web
    • Apache Jmeter
    • WatIN
    • Capybara
  • Mobile
    • Appium
  • OCR
    • SikuliX
  • Gherkin
    • Cucumber
  • Multilanguage
    • Playwright

JUnit / TestNG, PHPUnit, MSTest / NUnit, Pytest and ABAP Unit are specific to unit test (unit testing frameworks).

Cypress, Jamine, MochaJS and Tricentis Tosca are more general testing frameworks.

Apache Jmeter is specific for load testing.

Cypress

Cypress is a JavaScript end-to-end testing framework that focuses on making easy to write and understand tests.

Cypress official webiste

WatIN

WatIN is a web application testing framework for automating Internet Explorer (IE) browsers. It is part of the Test Studio suite by Telerik.

Uses C# or VB.NET for scripting.

It is proprietary.

Capybara

Capybara is a web application testing framekwork.

It uses Ruby for scripting.

Appium

Appium is used mainly on mobile phone testing.

It is FOSS.

Cucumber

Cucumber is a testing tool that supports behavior-driven development (BDD) and enables test creation.

The test scripts are done based on natural language following a set of rules to ensure that they are understandable by Cucumber.

Gherkin is the set of rules or grammar used on Cucumber.

Cucumber official website

SikuliX

SikuliX uses optical recognition to automate testing.

It is FOSS.

SikuliX official website

SikuliX official repository

TestLink

TestLink is a web-based test management tool.

It does not seem that TestLink run automatic tests, and it is only used to manage them.

It is FOSS under a GPL license.

It is developed by company Teamtest.

You might also be interested in…

External Resources

Leave a Reply

Your email address will not be published. Required fields are marked *