Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee; Man Chen Hung; Chien Huan Lu; Chang Hao Chen; Po Lei Lee; Kuo Kai Shyu

doi:10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

Lung Hao Lee, Man Chen Hung, Chien Huan Lu, Chang Hao Chen, Po Lei Lee, Kuo Kai Shyu

電機工程學系

研究成果: 書貢獻/報告類型 › 會議論文篇章 › 同行評審

4 引文斯高帕斯（Scopus）

摘要

This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

原文	???core.languages.en_GB???
主出版物標題	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks
編輯	Arjun Magge, Ari Z. Klein, Antonio Miranda-Escalada, Mohammed Ali Al-garadi, Ilseyar Alimova, Zulfat Miftahutdinov, Eulalia Farre-Maduell, Salvador Lima Lopez, Ivan Flores, Karen O'Connor, Davy Weissenbacher, Elena Tutubalina, Abeed Sarker, Juan M Banda, Martin Krallinger, Graciela Gonzalez-Hernandez
發行者	Association for Computational Linguistics (ACL)
頁面	98-101
頁數	4
ISBN（電子）	9781954085312
DOIs	https://doi.org/10.18653/v1/2021.smm4h-1.18
出版狀態	已出版 - 2021
事件	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 - Mexico City, Mexico 持續時間: 10 6月 2021 → …

出版系列

名字	Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???	6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021
國家/地區	Mexico
城市	Mexico City
期間	10/06/21 → …

存取文件

10.18653/v1/2021.smm4h-1.18

中文醫療健康照護知識庫建置與應用(2/3)
Lee, L.-H. (PI)
1/05/20 → 30/04/21
研究計畫: Research
應用於居家照護之智慧型互動平台－應用於醫療場域及居家照護之智慧型互動平台- 以人工智慧為核心之腦波人機介面開發(2/4)
Shyu, K.-K. (PI)
1/01/19 → 31/12/19
研究計畫: Research

引用此

Lee, L. H., Hung, M. C., Lu, C. H., Chen, C. H., Lee, P. L., & Shyu, K. K. (2021). Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 A. Magge, A. Z. Klein, A. Miranda-Escalada, M. A. Al-garadi, I. Alimova, Z. Miftahutdinov, E. Farre-Maduell, S. L. Lopez, I. Flores, K. O'Connor, D. Weissenbacher, E. Tutubalina, A. Sarker, J. M. Banda, M. Krallinger, & G. Gonzalez-Hernandez (編輯), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks (頁 98-101). (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2021.smm4h-1.18

Lee, Lung Hao ; Hung, Man Chen ; Lu, Chien Huan 等. / Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. 編輯 / Arjun Magge ; Ari Z. Klein ; Antonio Miranda-Escalada ; Mohammed Ali Al-garadi ; Ilseyar Alimova ; Zulfat Miftahutdinov ; Eulalia Farre-Maduell ; Salvador Lima Lopez ; Ivan Flores ; Karen O'Connor ; Davy Weissenbacher ; Elena Tutubalina ; Abeed Sarker ; Juan M Banda ; Martin Krallinger ; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. 頁 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

@inproceedings{ff43cc6e04db41ba9d5921ab6dd9b788,

title = "Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers",

abstract = "This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.",

author = "Lee, {Lung Hao} and Hung, {Man Chen} and Lu, {Chien Huan} and Chen, {Chang Hao} and Lee, {Po Lei} and Shyu, {Kuo Kai}",

note = "Publisher Copyright: {\textcopyright} 2021 Association for Computational Linguistics.; 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021 ; Conference date: 10-06-2021",

year = "2021",

doi = "10.18653/v1/2021.smm4h-1.18",

language = "???core.languages.en_GB???",

series = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

publisher = "Association for Computational Linguistics (ACL)",

pages = "98--101",

editor = "Arjun Magge and Klein, {Ari Z.} and Antonio Miranda-Escalada and Al-garadi, {Mohammed Ali} and Ilseyar Alimova and Zulfat Miftahutdinov and Eulalia Farre-Maduell and Lopez, {Salvador Lima} and Ivan Flores and Karen O'Connor and Davy Weissenbacher and Elena Tutubalina and Abeed Sarker and Banda, {Juan M} and Martin Krallinger and Graciela Gonzalez-Hernandez",

booktitle = "Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks",

}

Lee, LH, Hung, MC, Lu, CH, Chen, CH, Lee, PL & Shyu, KK 2021, Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 A Magge, AZ Klein, A Miranda-Escalada, MA Al-garadi, I Alimova, Z Miftahutdinov, E Farre-Maduell, SL Lopez, I Flores, K O'Connor, D Weissenbacher, E Tutubalina, A Sarker, JM Banda, M Krallinger & G Gonzalez-Hernandez (編輯), Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks, Association for Computational Linguistics (ACL), 頁 98-101, 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021, Mexico City, Mexico, 10/06/21. https://doi.org/10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. / Lee, Lung Hao; Hung, Man Chen; Lu, Chien Huan 等.
Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. 編輯 / Arjun Magge; Ari Z. Klein; Antonio Miranda-Escalada; Mohammed Ali Al-garadi; Ilseyar Alimova; Zulfat Miftahutdinov; Eulalia Farre-Maduell; Salvador Lima Lopez; Ivan Flores; Karen O'Connor; Davy Weissenbacher; Elena Tutubalina; Abeed Sarker; Juan M Banda; Martin Krallinger; Graciela Gonzalez-Hernandez. Association for Computational Linguistics (ACL), 2021. p. 98-101 (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks).

研究成果: 書貢獻/報告類型 › 會議論文篇章 › 同行評審

TY - GEN

T1 - Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

AU - Lee, Lung Hao

AU - Hung, Man Chen

AU - Lu, Chien Huan

AU - Chen, Chang Hao

AU - Lee, Po Lei

AU - Shyu, Kuo Kai

PY - 2021

Y1 - 2021

N2 - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

AB - This study describes our proposed model design for SMM4H 2021 shared tasks. We fine-tune the language model of RoBERTa transformers and their connecting classifier to complete the classification tasks of tweets for adverse pregnancy outcomes (Task 4) and potential COVID-19 cases (Task 5). The evaluation metric is F1-score of the positive class for both tasks. For Task 4, our best score of 0.93 exceeded the median score of 0.925. For Task 5, our best of 0.75 exceeded the median score of 0.745.

UR - http://www.scopus.com/inward/record.url?scp=85138252374&partnerID=8YFLogxK

U2 - 10.18653/v1/2021.smm4h-1.18

DO - 10.18653/v1/2021.smm4h-1.18

M3 - 會議論文篇章

AN - SCOPUS:85138252374

T3 - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

SP - 98

EP - 101

BT - Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks

A2 - Magge, Arjun

A2 - Klein, Ari Z.

A2 - Miranda-Escalada, Antonio

A2 - Al-garadi, Mohammed Ali

A2 - Alimova, Ilseyar

A2 - Miftahutdinov, Zulfat

A2 - Farre-Maduell, Eulalia

A2 - Lopez, Salvador Lima

A2 - Flores, Ivan

A2 - O'Connor, Karen

A2 - Weissenbacher, Davy

A2 - Tutubalina, Elena

A2 - Sarker, Abeed

A2 - Banda, Juan M

A2 - Krallinger, Martin

A2 - Gonzalez-Hernandez, Graciela

PB - Association for Computational Linguistics (ACL)

T2 - 6th Workshop and Shared Tasks on Social Media Mining for Health, SMM4H 2021

Y2 - 10 June 2021

ER -

Lee LH, Hung MC, Lu CH, Chen CH, Lee PL , Shyu KK. Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers. 於 Magge A, Klein AZ, Miranda-Escalada A, Al-garadi MA, Alimova I, Miftahutdinov Z, Farre-Maduell E, Lopez SL, Flores I, O'Connor K, Weissenbacher D, Tutubalina E, Sarker A, Banda JM, Krallinger M, Gonzalez-Hernandez G, 編輯, Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks. Association for Computational Linguistics (ACL). 2021. p. 98-101. (Social Media Mining for Health, SMM4H 2021 - Proceedings of the 6th Workshop and Shared Tasks). doi: 10.18653/v1/2021.smm4h-1.18

Classification of Tweets Self-reporting Adverse Pregnancy Outcomes and Potential COVID-19 Cases Using RoBERTa Transformers

摘要

出版系列

???event.eventtypes.event.conference???

存取文件

指紋

專案

中文醫療健康照護知識庫建置與應用(2/3)

應用於居家照護之智慧型互動平台－應用於醫療場域及居家照護之智慧 型互動平台- 以人工智慧為核心之腦波人機介面開發(2/4)

引用此

應用於居家照護之智慧型互動平台－應用於醫療場域及居家照護之智慧型互動平台- 以人工智慧為核心之腦波人機介面開發(2/4)