UMTG

Automatic generation of system test cases from use case specifications in natural language


hi

1. Overview

In safety critical domains, software engineers must ensure traceability between requirements and system test cases to comply with safety standards, e.g. ISO-26262. Requirements management tools like IBM Doors are commonly adopted in industry, but these tools provide support for only the maintenance of traceability links. Software engineers thus have both to manually derive system test cases from functional requirements written in natural language and establish traceability links between requirements and their corresponding test cases.

UMTG is a toolset for automatically generating executable and traceable system test cases from use case specifications and domain model. In order to extract behavioral information from use case specifications and enable test automation, UMTG employs Natural Language Processing (NLP), a restricted form of use case specifications, and constraint solving.

UMTG is integrated with two tools, IBM Doors and IBM Rational Rhapsody that are widely adopted in industry to manage requirements and design systems. UMTG has been successfully evaluated on two industrial case studies. UMTG integrates a component for the automated generation of OCL constraints from sentences in natural language, OCLGen, which is available from the fllowing link.

UMTG has been depevoled in a project in collaboration with IEE.

2. Download & Installation

2.1 Eclipse plug-in

2.1.a System Requirements

The UMTG Eclipse plug-in has been tested on Windows 7 with:

  1. Java Development Kit (JDK) 1.7.0 and above
  2. Telelogic DOORS 8.3
  3. IBM Rational Rhapsody 8.0.3
  4. GATE Framework version 7.1 Download

A version of UTMG that does not require Telelogic DOORS will be released soon.

2.1.b Installation

  1. Download the Installation Package from the following link : UMTG Distribution.zip.
  2. To install UMTG, please follow the UMTG User Manual : UMTG_Manual.pdf.

2.2 Replicability package and command line toolset

2.2.a System Requirements

The UMTG command line toolset works with Unix-like systems with Bash shell.

2.2.b Generation of OCL constraints (OCLgen)

A reusable replicability package for the OCL generation technique is available from the following URL https://drive.google.com/open?id=1Jbg_DdschJpYDmiPkQiloBBgBdWfMNW_

The package includes also the sources of OCLgen and all its dependencies.

2.2.c Use Case Test Models and Test Cases Generation

The use case specifications provided by our industry partner cannot be released because covered by NDA. We are working on a solution to provide a sanitized version of the generated test models.

3. Publications

Chunhui Wang, Fabrizio Pastore, Arda Goknil, Lionel Briand. Automatic Generation of System Test Cases from Use Case Specifications: an NLP-based Approach. 2019. Submitted. download

C. Wang, F. Pastore and L. Briand, “Automated Generation of Constraints from Use Case Specifications to Support System Testing,” 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), Vasteras, 2018, pp. 23-33. doi: 10.1109/ICST.2018.00013 download

Chunhui Wang, Fabrizio Pastore, Arda Goknil, Lionel C. Briand, and Zohaib Iqbal. 2015. UMTG: a toolset to automatically generate system test cases from use case specifications. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2015). ACM, New York, NY, USA, 942-945. DOI: https://doi.org/10.1145/2786805.2803187 download

Chunhui Wang, Fabrizio Pastore, Arda Goknil, Lionel Briand, and Zohaib Iqbal. 2015. Automatic generation of system test cases from use case specifications. In Proceedings of the 2015 International Symposium on Software Testing and Analysis (ISSTA 2015). ACM, New York, NY, USA, 385-396. DOI: http://dx.doi.org/10.1145/2771783.2771812 download