Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers

Lung Hao Lee; Man Chen Hung; Chao Yi Chen; Rou An Chen; Yuen Hsien Tseng

Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers

Lung Hao Lee, Man Chen Hung, Chao Yi Chen, Rou An Chen, Yuen Hsien Tseng

Department of Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

We explore transformer-based neural networks for Chinese grammatical error detection. The TOCFL learner corpus is used to measure the model capability of indicating whether a sentence contains errors or not. Experimental results show that ELECTRA transformers which take into account both transformer architecture and adversarial learning technique can achieve promising effectiveness with an improvement of F1-score.

Original language	English
Title of host publication	29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings
Editors	Maria Mercedes T. Rodrigo, Sridhar Iyer, Antonija Mitrovic, Hercy N. H. Cheng, Dan Kohen-Vacs, Camillia Matuk, Agnieszka Palalas, Ramkumar Rajenran, Kazuhisa Seta, Jingyun Wang
Publisher	Asia-Pacific Society for Computers in Education
Pages	111-113
Number of pages	3
ISBN (Electronic)	9789869721479
State	Published - 22 Nov 2021
Event	29th International Conference on Computers in Education Conference, ICCE 2021 - Virtual, Online Duration: 22 Nov 2021 → 26 Nov 2021

Publication series

Name	29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings
Volume	1

Conference

Conference	29th International Conference on Computers in Education Conference, ICCE 2021
City	Virtual, Online
Period	22/11/21 → 26/11/21

Keywords

Grammatical error diagnosis
adversarial learning
neural networks
transformers

Chinese Knowledge Base Construction and Applications for Medical Healthcare Domain(3/3)
Lee, L.-H. (PI)
1/05/21 → 31/07/22
Project: Research

Cite this

Lee, L. H., Hung, M. C., Chen, C. Y., Chen, R. A., & Tseng, Y. H. (2021). Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers. In M. M. T. Rodrigo, S. Iyer, A. Mitrovic, H. N. H. Cheng, D. Kohen-Vacs, C. Matuk, A. Palalas, R. Rajenran, K. Seta, & J. Wang (Eds.), 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings (pp. 111-113). (29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings; Vol. 1). Asia-Pacific Society for Computers in Education.

Lee, Lung Hao ; Hung, Man Chen ; Chen, Chao Yi et al. / Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers. 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings. editor / Maria Mercedes T. Rodrigo ; Sridhar Iyer ; Antonija Mitrovic ; Hercy N. H. Cheng ; Dan Kohen-Vacs ; Camillia Matuk ; Agnieszka Palalas ; Ramkumar Rajenran ; Kazuhisa Seta ; Jingyun Wang. Asia-Pacific Society for Computers in Education, 2021. pp. 111-113 (29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings).

@inproceedings{340687bd46354248a33e7db1fa52cffb,

title = "Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers",

abstract = "We explore transformer-based neural networks for Chinese grammatical error detection. The TOCFL learner corpus is used to measure the model capability of indicating whether a sentence contains errors or not. Experimental results show that ELECTRA transformers which take into account both transformer architecture and adversarial learning technique can achieve promising effectiveness with an improvement of F1-score.",

keywords = "Grammatical error diagnosis, adversarial learning, neural networks, transformers",

author = "Lee, {Lung Hao} and Hung, {Man Chen} and Chen, {Chao Yi} and Chen, {Rou An} and Tseng, {Yuen Hsien}",

note = "Publisher Copyright: {\textcopyright} 2021 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings. All rights reserved; 29th International Conference on Computers in Education Conference, ICCE 2021 ; Conference date: 22-11-2021 Through 26-11-2021",

year = "2021",

month = nov,

day = "22",

language = "???core.languages.en_GB???",

series = "29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings",

publisher = "Asia-Pacific Society for Computers in Education",

pages = "111--113",

editor = "Rodrigo, {Maria Mercedes T.} and Sridhar Iyer and Antonija Mitrovic and Cheng, {Hercy N. H.} and Dan Kohen-Vacs and Camillia Matuk and Agnieszka Palalas and Ramkumar Rajenran and Kazuhisa Seta and Jingyun Wang",

booktitle = "29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings",

}

Lee, LH, Hung, MC, Chen, CY, Chen, RA & Tseng, YH 2021, Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers. in MMT Rodrigo, S Iyer, A Mitrovic, HNH Cheng, D Kohen-Vacs, C Matuk, A Palalas, R Rajenran, K Seta & J Wang (eds), 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings. 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings, vol. 1, Asia-Pacific Society for Computers in Education, pp. 111-113, 29th International Conference on Computers in Education Conference, ICCE 2021, Virtual, Online, 22/11/21.

Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers. / Lee, Lung Hao; Hung, Man Chen; Chen, Chao Yi et al.
29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings. ed. / Maria Mercedes T. Rodrigo; Sridhar Iyer; Antonija Mitrovic; Hercy N. H. Cheng; Dan Kohen-Vacs; Camillia Matuk; Agnieszka Palalas; Ramkumar Rajenran; Kazuhisa Seta; Jingyun Wang. Asia-Pacific Society for Computers in Education, 2021. p. 111-113 (29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings; Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers

AU - Lee, Lung Hao

AU - Hung, Man Chen

AU - Chen, Chao Yi

AU - Chen, Rou An

AU - Tseng, Yuen Hsien

PY - 2021/11/22

Y1 - 2021/11/22

N2 - We explore transformer-based neural networks for Chinese grammatical error detection. The TOCFL learner corpus is used to measure the model capability of indicating whether a sentence contains errors or not. Experimental results show that ELECTRA transformers which take into account both transformer architecture and adversarial learning technique can achieve promising effectiveness with an improvement of F1-score.

AB - We explore transformer-based neural networks for Chinese grammatical error detection. The TOCFL learner corpus is used to measure the model capability of indicating whether a sentence contains errors or not. Experimental results show that ELECTRA transformers which take into account both transformer architecture and adversarial learning technique can achieve promising effectiveness with an improvement of F1-score.

KW - Grammatical error diagnosis

KW - adversarial learning

KW - neural networks

KW - transformers

UR - http://www.scopus.com/inward/record.url?scp=85126614130&partnerID=8YFLogxK

M3 - 會議論文篇章

AN - SCOPUS:85126614130

T3 - 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings

SP - 111

EP - 113

BT - 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings

A2 - Rodrigo, Maria Mercedes T.

A2 - Iyer, Sridhar

A2 - Mitrovic, Antonija

A2 - Cheng, Hercy N. H.

A2 - Kohen-Vacs, Dan

A2 - Matuk, Camillia

A2 - Palalas, Agnieszka

A2 - Rajenran, Ramkumar

A2 - Seta, Kazuhisa

A2 - Wang, Jingyun

PB - Asia-Pacific Society for Computers in Education

T2 - 29th International Conference on Computers in Education Conference, ICCE 2021

Y2 - 22 November 2021 through 26 November 2021

ER -

Lee LH, Hung MC, Chen CY, Chen RA, Tseng YH. Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers. In Rodrigo MMT, Iyer S, Mitrovic A, Cheng HNH, Kohen-Vacs D, Matuk C, Palalas A, Rajenran R, Seta K, Wang J, editors, 29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings. Asia-Pacific Society for Computers in Education. 2021. p. 111-113. (29th International Conference on Computers in Education Conference, ICCE 2021 - Proceedings).

Chinese Grammatical Error Detection Using Adversarial ELECTRA Transformers

Abstract

Publication series

Conference

Keywords

Fingerprint

Projects

Chinese Knowledge Base Construction and Applications for Medical Healthcare Domain(3/3)

Cite this