Activity Recommendation for Business Process Modeling with Pre-trained Language Models

Diana Sola, Han van der Aa, Christian Meilicke, Heiner Stuckenschmidt

Veröffentlichungen: Beitrag in BuchBeitrag in KonferenzbandPeer Reviewed


Activity recommendation in business process modeling is concerned with suggesting suitable labels for a new activity inserted by a modeler in a process model under development. Recently, it has been proposed to represent process model repositories as knowledge graphs, which makes it possible to address the activity-recommendation problem as a knowledge graph completion task. However, existing recommendation approaches are entirely dependent on the knowledge contained in the model repository used for training. This makes them rigid in general and even inapplicable in situations where a process model consists of unseen activities, which were not part of the repository used for training. In this paper, we avoid these issues by recognizing that the semantics contained in process models can be used to instead pose the activity-recommendation problem as a set of textual sequence-to-sequence tasks. This enables the application of transfer-learning techniques from natural language processing, which allows for recommendations that go beyond the activities contained in an available repository. We operationalize this with an activity-recommendation approach that employs a pre-trained language model at its core, and uses the representations of process knowledge as structured graphs combined with the natural-language-based semantics of process models. In an experimental evaluation, we show that our approach considerably outperforms the state of the art in terms of semantic accuracy of the recommendations and that it is able to recommend and handle activity labels that go beyond the vocabulary of the model repository used during training.

TitelThe Semantic Web - 20th International Conference, ESWC 2023, Proceedings
Redakteure*innenCatia Pesquita, Daniel Faria, Ernesto Jimenez-Ruiz, Jamie McCusker, Mauro Dragoni, Anastasia Dimou, Raphael Troncy, Sven Hertling
Herausgeber (Verlag)Springer Science and Business Media Deutschland GmbH
ISBN (Print)9783031334542
PublikationsstatusVeröffentlicht - 2023
Veranstaltung20th International Conference on The Semantic Web, ESWC 2023 - Hersonissos, Griechenland
Dauer: 28 Mai 20231 Juni 2023


ReiheLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band13870 LNCS


Konferenz20th International Conference on The Semantic Web, ESWC 2023

ÖFOS 2012

  • 102015 Informationssysteme