Zur Hauptnavigation wechseln Zur Suche wechseln Zum Hauptinhalt wechseln

EDSVM: A Novel Approach for Environment Drift Detection in Reinforcement Learning Using Synthetic Drifted Examples

Veröffentlichungen: Beitrag in BuchBeitrag in KonferenzbandPeer Reviewed

Abstract

In Reinforcement Learning (RL) environments, detecting environment drift is essential for maintaining robust policy performance in production systems, particularly within the context of MLOps. This paper proposes EDSVM, a novel environment drift detection method, which trains Support Vector Machines on undrifted and synthetic drifted examples generated by altering transition dynamics. By using decision function values as drift indicators, our method achieves competitive results compared to state-of-the-art baselines for the area-under-the-curve (AUC) metric. Additionally, we evaluate the performance of EDSVM when integrated with various Change Point Detection algorithms in terms of delay and false alarms, highlighting its potential for automating the monitoring of RL policies and supporting adaptive updates to production pipelines in MLOps workflows.
OriginalspracheEnglisch
TitelECAI 2025
Untertitel28th European Conference on Artificial Intelligence, 25-30 October 2025, Bologna, Italy – Including 14th Conference on Prestigious Applications of Intelligent Systems (PAIS 2025), Proceedings
Redakteure*innenInes Lynce, Nello Murano, Mauro Vallati, Serena Villata, Federico Chesani, Michela Milano, Andrea Omicini, Mehdi Dastani
VerlagIOS Press
Seiten2410-2417
Seitenumfang18
ISBN (elektronisch)978-1-64368-631-8
DOIs
PublikationsstatusVeröffentlicht - Okt. 2025
Veranstaltung28th European Conference on Artificial Intelligence - Bologna, Italien
Dauer: 25 Okt. 202530 Okt. 2025
https://ecai2025.org/

Publikationsreihe

ReiheFrontiers in Artificial Intelligence and Applications
Band413
ISSN0922-6389

Konferenz

Konferenz28th European Conference on Artificial Intelligence
KurztitelECAI 2025
Land/GebietItalien
OrtBologna
Zeitraum25/10/2530/10/25
Internetadresse

Fördermittel

TrägerTrägernummer
Österreichische Forschungsförderungsgesellschaft mbH (FFG)FO999895431

    ÖFOS 2012

    • 102022 Softwareentwicklung

    Fingerprint

    Untersuchen Sie die Forschungsthemen von „EDSVM: A Novel Approach for Environment Drift Detection in Reinforcement Learning Using Synthetic Drifted Examples“. Zusammen bilden sie einen einzigartigen Fingerprint.

    Zitationsweisen