Blazingly fast and precise conformance checking using negative events. For recall, precision, and generalization assessments.About ----- Process mining encompasses the research area which is concerned with knowledge discovery from event logs. One common process mining task focuses on conformance checking, comparing discovered or designed process models with actual real-life behavior as captured in event logs in order to assess the “goodness” of the process model. This work introduces a novel conformance checking method to measure how well a process model performs in terms of precision and generalization with respect to the actual executions of a process as recorded in an event log. Our approach differs from related work in the sense that we apply the concept of so-called weighted artificial negative events towards conformance checking, leading to more robust results, especially when dealing with less complete event logs that only contain a subset of all possible process execution behavior. In addition, our technique offers a novel way to estimate a process model’s ability to generalize. Existing literature has focused mainly on the fitness (recall) and precision (appropriateness) of process models, whereas generalization has been much more difficult to estimate. The described algorithms are implemented in a number of ProM plugins, and a Petri net conformance checking tool is offered to inspect process model conformance in a visual manner as well. References ---------- Please cite the following reference if you apply the conformance checking framework in your work: * vanden Broucke, S., De Weerdt, J., Vanthienen, J., Baesens, B. (2014). Determining process model precision and generalization with weighted artificial negative events. IEEE Transactions on Knowledge and Data Engineering, 26 (8), 1877-1889. Implementation -------------- The conformance checking framework is implemented as a [ProM 6](http://www.promtools.org/) plugin. The following JAR file contains the plugin: * [Version of 2015-07-08](downloads/neconformance-2015-07-08.jar) * [Outdated legacy version](downloads/waneconformance-20130517.jar) (expert users only, not recommended) You will need to make sure that ProM can find the downloaded JAR in its classpath. To do so, you can create a folder “plugins” in the ProM installation directory, place the downloaded JAR file in this directory, and start ProM with the following command (Windows example): java -classpath ./plugins/*;./ProM651_lib/*;./* -Djava.util.Arrays.useLegacyMergeSort=true -Djava.library.path=./ProM651_lib -ea -Xmx2g -XX:MaxPermSize=512m -XX:+UseCompressedOops org.processmining.contexts.uitopia.UI Packaged source code can be retrieved from: * [Packaged source at 2015-07-08](downloads/neconformance-2015-07-08.src.zip) Contact ------- Contact the authors at: * [Seppe vanden Broucke](mailto:seppe.vandenbroucke@kuleuven.be) (corresponding author)
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium * [Jochen De Weerdt](mailto:jochen.deweerdt@kuleuven.be)
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium * Jan Vanthienen
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium * Bart Baesens
Department of Decision Sciences and Information Management, KU Leuven
Naamsestraat 69, B-3000 Leuven, Belgium Screenshots -----------
