Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications

Yuh Shyang Wang; Chao Yi Chen; Lung Hao Lee

Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications

Yuh Shyang Wang, Chao Yi Chen, Lung Hao Lee

電機工程學系

研究成果: 書貢獻/報告類型 › 會議論文篇章 › 同行評審

摘要

We propose the mixed-attention-based Generative Adversarial Network (named maGAN), and apply it for citation intent classification in scientific publication. We select domain-specific training data, propose a mixed attention mechanism, and employ generative adversarial network architecture for pre-training language model and fine-tuning to the downstream multi-class classification task. Experiments were conducted on the SciCite datasets to compare model performance. Our proposed maGAN model achieved the best Macro-F1 of 0.8532.

原文	???core.languages.en_GB???
主出版物標題	ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing
編輯	Lung-Hao Lee, Chia-Hui Chang, Kuan-Yu Chen
發行者	The Association for Computational Linguistics and Chinese Language Processing (ACLCLP)
頁面	280-285
頁數	6
ISBN（電子）	9789869576949
出版狀態	已出版 - 2021
事件	33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021 - Taoyuan, Taiwan 持續時間: 15 10月 2021 → 16 10月 2021

出版系列

名字	ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???	33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021
國家/地區	Taiwan
城市	Taoyuan
期間	15/10/21 → 16/10/21

中文醫療健康照護知識庫建置與應用(2/3)
Lee, L.-H. (PI)
1/05/20 → 30/04/21
研究計畫: Research

引用此

Wang, Y. S., Chen, C. Y., & Lee, L. H. (2021). Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. 於 L.-H. Lee, C.-H. Chang, & K.-Y. Chen (編輯), ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing (頁 280-285). (ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing). The Association for Computational Linguistics and Chinese Language Processing (ACLCLP).

Wang, Yuh Shyang ; Chen, Chao Yi ; Lee, Lung Hao. / Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. 編輯 / Lung-Hao Lee ; Chia-Hui Chang ; Kuan-Yu Chen. The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), 2021. 頁 280-285 (ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing).

@inproceedings{31a897bc650344fda5c5d5af38e9c321,

title = "Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications",

abstract = "We propose the mixed-attention-based Generative Adversarial Network (named maGAN), and apply it for citation intent classification in scientific publication. We select domain-specific training data, propose a mixed attention mechanism, and employ generative adversarial network architecture for pre-training language model and fine-tuning to the downstream multi-class classification task. Experiments were conducted on the SciCite datasets to compare model performance. Our proposed maGAN model achieved the best Macro-F1 of 0.8532.",

keywords = "Attentions, Citation intents, Pretrained language models, Scientific publications",

author = "Wang, {Yuh Shyang} and Chen, {Chao Yi} and Lee, {Lung Hao}",

note = "Publisher Copyright: {\textcopyright} 2021 ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. All rights reserved.; 33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021 ; Conference date: 15-10-2021 Through 16-10-2021",

year = "2021",

language = "???core.languages.en_GB???",

series = "ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing",

publisher = "The Association for Computational Linguistics and Chinese Language Processing (ACLCLP)",

pages = "280--285",

editor = "Lung-Hao Lee and Chia-Hui Chang and Kuan-Yu Chen",

booktitle = "ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing",

}

Wang, YS, Chen, CY & Lee, LH 2021, Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. 於 L-H Lee, C-H Chang & K-Y Chen (編輯), ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing, The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), 頁 280-285, 33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021, Taoyuan, Taiwan, 15/10/21.

Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. / Wang, Yuh Shyang; Chen, Chao Yi; Lee, Lung Hao.
ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. 編輯 / Lung-Hao Lee; Chia-Hui Chang; Kuan-Yu Chen. The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), 2021. p. 280-285 (ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing).

研究成果: 書貢獻/報告類型 › 會議論文篇章 › 同行評審

TY - GEN

T1 - Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications

AU - Wang, Yuh Shyang

AU - Chen, Chao Yi

AU - Lee, Lung Hao

PY - 2021

Y1 - 2021

N2 - We propose the mixed-attention-based Generative Adversarial Network (named maGAN), and apply it for citation intent classification in scientific publication. We select domain-specific training data, propose a mixed attention mechanism, and employ generative adversarial network architecture for pre-training language model and fine-tuning to the downstream multi-class classification task. Experiments were conducted on the SciCite datasets to compare model performance. Our proposed maGAN model achieved the best Macro-F1 of 0.8532.

AB - We propose the mixed-attention-based Generative Adversarial Network (named maGAN), and apply it for citation intent classification in scientific publication. We select domain-specific training data, propose a mixed attention mechanism, and employ generative adversarial network architecture for pre-training language model and fine-tuning to the downstream multi-class classification task. Experiments were conducted on the SciCite datasets to compare model performance. Our proposed maGAN model achieved the best Macro-F1 of 0.8532.

KW - Attentions

KW - Citation intents

KW - Pretrained language models

KW - Scientific publications

UR - http://www.scopus.com/inward/record.url?scp=85127430967&partnerID=8YFLogxK

M3 - 會議論文篇章

AN - SCOPUS:85127430967

T3 - ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing

SP - 280

EP - 285

BT - ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing

A2 - Lee, Lung-Hao

A2 - Chang, Chia-Hui

A2 - Chen, Kuan-Yu

PB - The Association for Computational Linguistics and Chinese Language Processing (ACLCLP)

T2 - 33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021

Y2 - 15 October 2021 through 16 October 2021

ER -

Wang YS, Chen CY, Lee LH. Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications. 於 Lee LH, Chang CH, Chen KY, 編輯, ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. The Association for Computational Linguistics and Chinese Language Processing (ACLCLP). 2021. p. 280-285. (ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing).

Generative Adversarial Networks based on Mixed-Attentions for Citation Intent Classification in Scientific Publications

摘要

出版系列

???event.eventtypes.event.conference???

指紋

專案

中文醫療健康照護知識庫建置與應用(2/3)

引用此