A lab for comparing test sequence generation algorithms
| Author: | Sylvain Hallé | | Contact: | firstname.lastname@example.org | | Version: | 1.0 | | Date: | 2017-02-03 |
This lab contains a set of experiments that compare a test sequence generation library against data found in related works. The lab consists of two parts:
In the first part, test sequences are generated from a set of finite-state machines. Some of these FSMs are extracted from past literature, while others are original to this work. You can see the complete list of all the FSMs included in the lab, along with the source files and pictures for each.
In the second part, test sequences are generated from a set of Linear Temporal Logic formulae.
Instructions on using this archive
This archive contains an instance of LabPal, an environment for running experiments on a computer and collecting their results in a user-friendly way. The author of this archive has set up a set of experiments, which typically involve running scripts on input data, processing their results and displaying them in tables and plots. LabPal is a library that wraps around these experiments and displays them in an easy-to-use web interface. The principle behind LabPal is that all the necessary code, libraries and input data should be bundled within a single self-contained JAR file, such that anyone can download and easily reproduce someone else's experiments. Detailed instructions can be found on the LabPal website, [https://liflab.github.io/labpal]
In order to run LabPal, you need to have Java properly installed. Java can be
freely downloaded and installation instructions are easy to find on the web.
If you want to see any plots associated to the experiments, you need to have
GnuPlot installed and available from the command line
This archive should contain a single runnable JAR file; suppose it is called
MyLab.jar. To start the lab and use its web interface, type at the command
java -jar MyLab.jar
You should see something like this:
LabPal v2.7 (C) 2014-2017 Laboratoire d'informatique formelle Université du Québec à Chicoutimi, Canada Please visit http://localhost:21212/index to run this lab
Open your web browser, and type
http://localhost:21212/index in the address
bar. This should lead you to the main page of LabMate's web control panel.
(Note that the machine running LabPal does not need to have a web browser.
You can open a browser in another machine, and replace
localhost by the IP
address of the former.)
Using the web interface
The main page should give you more details about the actual experiments that this lab contains. Here is how you typically use the LabPal web interface.
- Go to the Experiments page.
- Select some experiments in the list by clicking on the corresponding checkbox.
- Click on the "Add to assistant" button to queue these experiments
- Go to the Assistant page
- Click on the "Start" button. This will launch the execution of each experiment one after the other.
- At any point, you can look at the results of the experiments that have run so far. You can do so by: - Going to the Plots or the Tables page and see the plots and tables created for this lab being updated in real time - Going back to the list of experiments, clicking on one of them and get the detailed description and data points that this experiment has generated
- Once the assistant is done, you can export any of the plots and tables to a file, or the raw data points by using the Export button in the Status page.
Please refer to the LabPal website or to the Help page within the web interface for more information about LabPal's functionalities.
The LabPal library was written by Sylvain Hallé, Associate Professor at Université du Québec à Chicoutimi, Canada. However, the experiments contained in this specific lab instance and the results they produce are the sole responsibility of their author.
<!-- :maxLineLen=80: -->