New Horizons of Legal Judgement Predication via Multi-Task Learning and LoRA

Ren Der Sun, Chia Hui Chang, Kuo Chun Chien

研究成果: 書貢獻/報告類型會議論文篇章同行評審

摘要

Legal Judgment Prediction (LJP) aims to predict the judgement results (such as legal article, charge and penalty) based on the criminal facts of the case. Most previous research in this field was based on criminal statements from court verdicts. However, each verdict actually is based on the content from indictments. For prosecutors, will the case be dismissed or processed? If the case is accepted, is the penalty a jail sentence or a fine? What is the charge and article violated? In this study, we therefore define three novel LJP tasks for prosecutors, including prosecution outcome prediction (LJP#1), imprison prediction (LJP#2) and fine prediction (LJP#3). We explore various multi-task learning (MTL) framework based on Word2Vec and BERT language model (LM) with either topology-based or message-passing mechanism. Moreover, we employed the LoRA (Low-Rank Adaptation) technique to save both computation time and resources during fine-tuning. Experimental results demonstrated that Word2Vec-based model combined with message passing architecture still has the potential to outperform large LM like BERT, while BERT-based models with a simple parallel architecture generally performed well. Finally, using LoRA for fine-tuning not only reduced training time (by 45%) but also improved performance (2.5% F1) in some LJP tasks.

原文???core.languages.en_GB???
主出版物標題Legal Knowledge and Information Systems - JURIX 2023
主出版物子標題36th Annual Conference
編輯Giovanni Sileno, Jerry Spanakis, Gijs van Dijck
發行者IOS Press BV
頁面207-216
頁數10
ISBN(電子)9781643684727
DOIs
出版狀態已出版 - 7 12月 2023
事件36th International Conference on Legal Knowledge and Information Systems, JURIX 2023 - Maastricht, Netherlands
持續時間: 18 12月 202320 12月 2023

出版系列

名字Frontiers in Artificial Intelligence and Applications
379
ISSN(列印)0922-6389
ISSN(電子)1879-8314

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???36th International Conference on Legal Knowledge and Information Systems, JURIX 2023
國家/地區Netherlands
城市Maastricht
期間18/12/2320/12/23

指紋

深入研究「New Horizons of Legal Judgement Predication via Multi-Task Learning and LoRA」主題。共同形成了獨特的指紋。

引用此