TY - GEN
T1 - Skill Learning Using Process Mining for Large Language Model Plan Generation
AU - Redis, Andrei Cosmin
AU - Sani, Mohammadreza Fani
AU - Zarrin, Bahram
AU - Burattin, Andrea
PY - 2025
Y1 - 2025
N2 - Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is crucial for improving the efficiency and interpretability of plan generation as LLMs become more central to automation and decision-making. We introduce a novel approach to skill learning in LLMs by integrating process mining techniques, leveraging process discovery for skill acquisition, process models for skill storage, and conformance checking for skill retrieval. Our methods enhance text-based plan generation by enabling flexible skill discovery, parallel execution, and improved interpretability. Experimental results suggest the effectiveness of our approach, with our skill retrieval method surpassing state-of-the-art accuracy baselines under specific conditions.
AB - Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is crucial for improving the efficiency and interpretability of plan generation as LLMs become more central to automation and decision-making. We introduce a novel approach to skill learning in LLMs by integrating process mining techniques, leveraging process discovery for skill acquisition, process models for skill storage, and conformance checking for skill retrieval. Our methods enhance text-based plan generation by enabling flexible skill discovery, parallel execution, and improved interpretability. Experimental results suggest the effectiveness of our approach, with our skill retrieval method surpassing state-of-the-art accuracy baselines under specific conditions.
KW - Agentic Context Retrieval
KW - Large Language Model
KW - Plan Generation
KW - Process Mining
KW - Skill Learning
U2 - 10.1007/978-3-031-82225-4_48
DO - 10.1007/978-3-031-82225-4_48
M3 - Article in proceedings
SN - 978-3-031-82224-7
VL - 533
T3 - Lecture Notes in Business Information Processing
SP - 650
EP - 662
BT - Proceedings of the 6th International Conference on Process Mining, ICPM 2024
PB - Springer
T2 - 6th International Conference on Process Mining
Y2 - 14 October 2024 through 18 October 2024
ER -