F-Measure Optimisation and Label Regularisation for Energy-Based Neural Dialogue State Tracking Models
Citation:
Trinh, A.D. and Ross, R.J. and Kelleher, J.D., F-Measure Optimisation and Label Regularisation for Energy-Based Neural Dialogue State Tracking Models, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12397 LNCS, 2020, 798-810Abstract:
In recent years many multi-label classification methods have exploited label dependencies to improve performance of classification tasks in various domains, hence casting the tasks to structured prediction problems. We argue that multi-label predictions do not always satisfy domain constraint restrictions. For example when the dialogue state tracking task in task-oriented dialogue domains is solved with multi-label classification approaches, slot-value constraint rules should be enforced following real conversation scenarios.
To address these issues we propose an energy-based neural model to solve the dialogue state tracking task as a structured prediction problem. Furthermore we propose two improvements over previous methods with respect to dialogue slot-value constraint rules: (i) redefining the estimation conditions for the energy network; (ii) regularising label predictions following the dialogue slot-value constraint rules. In our results we find that our extended energy-based neural dialogue state tracker yields better overall performance in term of prediction accuracy, and also behaves more naturally with respect to the conversational rules.
Sponsor
Grant Number
Science Foundation Ireland (SFI)
Author's Homepage:
http://people.tcd.ie/kellehjd
Author: Kelleher, John
Sponsor:
Science Foundation Ireland (SFI)Type of material:
Journal ArticleCollections
Series/Report no:
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics);12397 LNCS;
Availability:
Full text availableKeywords:
dialogue slot-value constraint rules, multi-label classification methods, real conversation scenarios, Dialogue processing, Multi-label classification, Label regularisation, F-measure optimisation, Energy-based learning, Neural dialogue state trackingDOI:
http://dx.doi.org/10.1007/978-3-030-61616-8_64Metadata
Show full item recordLicences: