Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee; Man Chen Hung; Chien Huan Lu; Chang Hao Chen; Po Lei Lee; Kuo Kai Shyu

doi:10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee, Man Chen Hung, Chien Huan Lu, Chang Hao Chen, Po Lei Lee, Kuo Kai Shyu

Department of Electrical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

Original language	English
Title of host publication	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks
Editors	Arjun Magge, Ari Z. Klein, Antonio Miranda-Escalada, Mohammed Ali Al-garadi, Ilseyar Alimova, Zulfat Miftahutdinov, Eulalia Farre-Maduell, Salvador Lima Lopez, Ivan Flores, Karen O'Connor, Davy Weissenbacher, Elena Tutubalina, Abeed Sarker, Juan M Banda, Martin Krallinger, Graciela Gonzalez-Hernandez
Publisher	Association for Computational Linguistics (ACL)
Pages	98-101
Number of pages	4
ISBN (Electronic)	9781954085312
DOIs	https://doi.org/10.18653/v1/2021.smm4h-1.18
State	Published - 2021
Event	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 - Mexico City, Mexico Duration: 10 Jun 2021 → …

Publication series

Name	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

Conference

Conference	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021
Country/Territory	Mexico
City	Mexico City
Period	10/06/21 → …

Access to Document

10.18653/v1/2021.smm4h-1.18

Chinese Knowledge Base Construction and Applications for Medical Healthcare Domain(2/3)
Lee, L.-H. (PI)
1/05/20 → 30/04/21
Project: Research
Intelligent Interactive Platform with Applications to Healthcare and Home Care – Development of Artificial Intelligence – Based Brain Computer Interface( II )
Shyu, K.-K. (PI)
1/01/19 → 31/12/19
Project: Research

Cite this

Lee, L. H., Hung, M. C., Lu, C. H., Chen, C. H., Lee, P. L., & Shyu, K. K. (2021). Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. In A. Magge, A. Z. Klein, A. Miranda-Escalada, M. A. Al-garadi, I. Alimova, Z. Miftahutdinov, E. Farre-Maduell, S. L. Lopez, I. Flores, K. O'Connor, D. Weissenbacher, E. Tutubalina, A. Sarker, J. M. Banda, M. Krallinger, & G. Gonzalez-Hernandez (Eds.), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks (pp. 98-101). (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2021.smm4h-1.18

Lee, Lung Hao ; Hung, Man Chen ; Lu, Chien Huan et al. / Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. editor / Arjun Magge ; Ari Z. Klein ; Antonio Miranda-Escalada ; Mohammed Ali Al-garadi ; Ilseyar Alimova ; Zulfat Miftahutdinov ; Eulalia Farre-Maduell ; Salvador Lima Lopez ; Ivan Flores ; Karen O'Connor ; Davy Weissenbacher ; Elena Tutubalina ; Abeed Sarker ; Juan M Banda ; Martin Krallinger ; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. pp. 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

@inproceedings{ff43cc6e04db41ba9d5921ab6dd9b788,

title = "Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers",

abstract = "This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.",

author = "Lee, {Lung Hao} and Hung, {Man Chen} and Lu, {Chien Huan} and Chen, {Chang Hao} and Lee, {Po Lei} and Shyu, {Kuo Kai}",

note = "Publisher Copyright: {\textcopyright} 2021 Association for Computational Linguistics.; 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 ; Conference date: 10-06-2021",

year = "2021",

doi = "10.18653/v1/2021.smm4h-1.18",

language = "???core.languages.en_GB???",

series = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

publisher = "Association for Computational Linguistics (ACL)",

pages = "98--101",

editor = "Arjun Magge and Klein, {Ari Z.} and Antonio Miranda-Escalada and Al-garadi, {Mohammed Ali} and Ilseyar Alimova and Zulfat Miftahutdinov and Eulalia Farre-Maduell and Lopez, {Salvador Lima} and Ivan Flores and Karen O'Connor and Davy Weissenbacher and Elena Tutubalina and Abeed Sarker and Banda, {Juan M} and Martin Krallinger and Graciela Gonzalez-Hernandez",

booktitle = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

}

Lee, LH, Hung, MC, Lu, CH, Chen, CH, Lee, PL & Shyu, KK 2021, Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. in A Magge, AZ Klein, A Miranda-Escalada, MA Al-garadi, I Alimova, Z Miftahutdinov, E Farre-Maduell, SL Lopez, I Flores, K O'Connor, D Weissenbacher, E Tutubalina, A Sarker, JM Banda, M Krallinger & G Gonzalez-Hernandez (eds), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks, Association for Computational Linguistics (ACL), pp. 98-101, 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021, Mexico City, Mexico, 10/06/21. https://doi.org/10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. / Lee, Lung Hao; Hung, Man Chen; Lu, Chien Huan et al.
Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. ed. / Arjun Magge; Ari Z. Klein; Antonio Miranda-Escalada; Mohammed Ali Al-garadi; Ilseyar Alimova; Zulfat Miftahutdinov; Eulalia Farre-Maduell; Salvador Lima Lopez; Ivan Flores; Karen O'Connor; Davy Weissenbacher; Elena Tutubalina; Abeed Sarker; Juan M Banda; Martin Krallinger; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. p. 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

AU - Lee, Lung Hao

AU - Hung, Man Chen

AU - Lu, Chien Huan

AU - Chen, Chang Hao

AU - Lee, Po Lei

AU - Shyu, Kuo Kai

PY - 2021

Y1 - 2021

N2 - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

AB - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

UR - http://www.scopus.com/inward/record.url?scp=85138252374&partnerID=8YFLogxK

U2 - 10.18653/v1/2021.smm4h-1.18

DO - 10.18653/v1/2021.smm4h-1.18

M3 - 會議論文篇章

AN - SCOPUS:85138252374

T3 - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

SP - 98

EP - 101

BT - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

A2 - Magge, Arjun

A2 - Klein, Ari Z.

A2 - Miranda-Escalada, Antonio

A2 - Al-garadi, Mohammed Ali

A2 - Alimova, Ilseyar

A2 - Miftahutdinov, Zulfat

A2 - Farre-Maduell, Eulalia

A2 - Lopez, Salvador Lima

A2 - Flores, Ivan

A2 - O'Connor, Karen

A2 - Weissenbacher, Davy

A2 - Tutubalina, Elena

A2 - Sarker, Abeed

A2 - Banda, Juan M

A2 - Krallinger, Martin

A2 - Gonzalez-Hernandez, Graciela

PB - Association for Computational Linguistics (ACL)

T2 - 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021

Y2 - 10 June 2021

ER -

Lee LH, Hung MC, Lu CH, Chen CH, Lee PL , Shyu KK. Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. In Magge A, Klein AZ, Miranda-Escalada A, Al-garadi MA, Alimova I, Miftahutdinov Z, Farre-Maduell E, Lopez SL, Flores I, O'Connor K, Weissenbacher D, Tutubalina E, Sarker A, Banda JM, Krallinger M, Gonzalez-Hernandez G, editors, Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Association for Computational Linguistics (ACL). 2021. p. 98-101. (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). doi: 10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Abstract

Publication series

Conference

Access to Document

Fingerprint

Projects

Chinese Knowledge Base Construction and Applications for Medical Healthcare Domain(2/3)

Intelligent Interactive Platform with Applications to Healthcare and Home Care – Development of Artificial Intelligence – Based Brain Computer Interface( II )

Cite this