Midoriko chatbot: LSTM-Based emotional 3D avatar

Yu Ting Wan; Cheng Chun Chiu; Kai Wen Liang; Pao Chi Chang

doi:10.1109/GCCE46687.2019.9015303

Midoriko chatbot: LSTM-Based emotional 3D avatar

Yu Ting Wan, Cheng Chun Chiu, Kai Wen Liang, Pao Chi Chang

Department of Communication Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Scopus citations

Abstract

In this work, we developed a new model of chat robot with facial expression interaction. Different from the voice assistant that only interacts with text and voice, we let the chat robot interact with the user with a specific role play. A text-sentiment-analysis network is added to this system to recognize the emotion of the response sentences. Moreover, we created a 3D-constructed anime character 'Midoriko' to have the image of the chat robot more vivid. Our goal is to provide better experience to users. The technical parts of this work is based on neural network techniques.

Original language	English
Title of host publication	2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	937-940
Number of pages	4
ISBN (Electronic)	9781728135755
DOIs	https://doi.org/10.1109/GCCE46687.2019.9015303
State	Published - Oct 2019
Event	8th IEEE Global Conference on Consumer Electronics, GCCE 2019 - Osaka, Japan Duration: 15 Oct 2019 → 18 Oct 2019

Publication series

Name	2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019

Conference

Conference	8th IEEE Global Conference on Consumer Electronics, GCCE 2019
Country/Territory	Japan
City	Osaka
Period	15/10/19 → 18/10/19

Keywords

3D module
Avatar
Chatbot
Companionship
LSTM
Neural Network
Unity

Access to Document

10.1109/GCCE46687.2019.9015303

Deep Intelligence Based Spoken Language Processing( II )
Wang, J.-C. (PI)
1/01/19 → 31/12/19
Project: Research

Cite this

Wan, Y. T., Chiu, C. C., Liang, K. W., & Chang, P. C. (2019). Midoriko chatbot: LSTM-Based emotional 3D avatar. In 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019 (pp. 937-940). Article 9015303 (2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/GCCE46687.2019.9015303

@inproceedings{b27be7c9d4794f5597ede6bd978f6ae9,

title = "Midoriko chatbot: LSTM-Based emotional 3D avatar",

abstract = "In this work, we developed a new model of chat robot with facial expression interaction. Different from the voice assistant that only interacts with text and voice, we let the chat robot interact with the user with a specific role play. A text-sentiment-analysis network is added to this system to recognize the emotion of the response sentences. Moreover, we created a 3D-constructed anime character 'Midoriko' to have the image of the chat robot more vivid. Our goal is to provide better experience to users. The technical parts of this work is based on neural network techniques.",

keywords = "3D module, Avatar, Chatbot, Companionship, LSTM, Neural Network, Unity",

author = "Wan, {Yu Ting} and Chiu, {Cheng Chun} and Liang, {Kai Wen} and Chang, {Pao Chi}",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 8th IEEE Global Conference on Consumer Electronics, GCCE 2019 ; Conference date: 15-10-2019 Through 18-10-2019",

year = "2019",

month = oct,

doi = "10.1109/GCCE46687.2019.9015303",

language = "???core.languages.en_GB???",

series = "2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "937--940",

booktitle = "2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019",

}

Wan, YT, Chiu, CC, Liang, KW & Chang, PC 2019, Midoriko chatbot: LSTM-Based emotional 3D avatar. in 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019., 9015303, 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019, Institute of Electrical and Electronics Engineers Inc., pp. 937-940, 8th IEEE Global Conference on Consumer Electronics, GCCE 2019, Osaka, Japan, 15/10/19. https://doi.org/10.1109/GCCE46687.2019.9015303

Midoriko chatbot: LSTM-Based emotional 3D avatar. / Wan, Yu Ting; Chiu, Cheng Chun; Liang, Kai Wen et al.
2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 937-940 9015303 (2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Midoriko chatbot

T2 - 8th IEEE Global Conference on Consumer Electronics, GCCE 2019

AU - Wan, Yu Ting

AU - Chiu, Cheng Chun

AU - Liang, Kai Wen

AU - Chang, Pao Chi

PY - 2019/10

Y1 - 2019/10

N2 - In this work, we developed a new model of chat robot with facial expression interaction. Different from the voice assistant that only interacts with text and voice, we let the chat robot interact with the user with a specific role play. A text-sentiment-analysis network is added to this system to recognize the emotion of the response sentences. Moreover, we created a 3D-constructed anime character 'Midoriko' to have the image of the chat robot more vivid. Our goal is to provide better experience to users. The technical parts of this work is based on neural network techniques.

AB - In this work, we developed a new model of chat robot with facial expression interaction. Different from the voice assistant that only interacts with text and voice, we let the chat robot interact with the user with a specific role play. A text-sentiment-analysis network is added to this system to recognize the emotion of the response sentences. Moreover, we created a 3D-constructed anime character 'Midoriko' to have the image of the chat robot more vivid. Our goal is to provide better experience to users. The technical parts of this work is based on neural network techniques.

KW - 3D module

KW - Avatar

KW - Chatbot

KW - Companionship

KW - LSTM

KW - Neural Network

KW - Unity

UR - http://www.scopus.com/inward/record.url?scp=85081949346&partnerID=8YFLogxK

U2 - 10.1109/GCCE46687.2019.9015303

DO - 10.1109/GCCE46687.2019.9015303

M3 - 會議論文篇章

AN - SCOPUS:85081949346

T3 - 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019

SP - 937

EP - 940

BT - 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 15 October 2019 through 18 October 2019

ER -

Midoriko chatbot: LSTM-Based emotional 3D avatar

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Projects

Deep Intelligence Based Spoken Language Processing( II )

Cite this