Assessing the stability of process discovery techniques based on log-perturbations and process similarity metrics.About ----- Traditionally, process discovery techniques have been evaluated based on concepts such as accuracy and comprehensibility. We argue a third dimension should be added to this perspective, based on the stability of the process discovery technique, that canan supplement these dimensions. Our framework is implemented as an experimental plugin and includes multiple log-perturbation strategies, similarity metrics and discovery techniques for evaluation. References ---------- The framework is detailed thoroughly in the following publication: * De Koninck P., De Weerdt, J. (2016). A Stability Assessment Framework for Process Discovery Techniques; Business Process Management, LNCS 9850 p57-72, DOI 10.1007/978-3-319-45348-4_4 Implementation -------------- The stability framework is implemented as a [ProM 6](http://www.promtools.org/) plugin. The following JAR file contains the plugin: * [Version of 2016-06-07](downloads/PD-Stability-07062016.jar) You will need to make sure that ProM can find the downloaded JAR in its classpath. To do so, you can create a folder 'plugins' in the ProM installation directory, place the downloaded JAR file in this directory, and start ProM with the following command (Windows example): java -classpath ./plugins/*;./lib/*;./* -Djava.util.Arrays.useLegacyMergeSort=true -Djava.library.path=./lib -ea -Xmx2g -XX:MaxPermSize=512m -XX:+UseCompressedOops org.processmining.contexts.uitopia.UI The implementation contains two plugins: "Assess stability of process discovery techniques (Defaults)" and "Assess stability of process discovery techniques (Wizard)". In the default setting, the stability is tested using Heuristics miner, with noise induction and resampling percentages of 10%. In the wizard version, the user is able to select multiple process discovery techniques to evaluate, with a configuration of his/her preference. The results are presented in a basic table. A small demonstration video is available [here](installation/PoC_StabilityPlugin.mp4). Contact ------- Contact the authors at: * [Pieter De Koninck](mailto:pieter.dekoninck@kuleuven.be) (corresponding author)
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium * [Jochen De Weerdt](mailto:jochen.deweerdt@kuleuven.be) (corresponding author)
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium Screenshots and instructions ---------------------------- [
](#img01)
[
](#img02)
[
](#img03)
[
](#iimg01)
[
](#iimg02)
[
](#iimg03)
[
](#iimg04)