{"id":452,"date":"2023-10-11T21:55:59","date_gmt":"2023-10-11T13:55:59","guid":{"rendered":"http:\/\/140.115.70.194:6417\/?p=452"},"modified":"2024-11-09T19:33:40","modified_gmt":"2024-11-09T11:33:40","slug":"towards-transformer-fusions-for-chinese-sentiment-intensity-prediction-in-valence-arousal-dimensions","status":"publish","type":"post","link":"https:\/\/ainlp.tw\/index.php\/2023\/10\/11\/towards-transformer-fusions-for-chinese-sentiment-intensity-prediction-in-valence-arousal-dimensions\/","title":{"rendered":"Towards Transformer Fusions for Chinese Sentiment Intensity Prediction in Valence-Arousal Dimensions"},"content":{"rendered":"\n<p>Yu-Chih Deng, Yih-Ru Wang, Sin-Horng Chen, Lung-Hao Lee*. <br><strong><em>I<\/em><\/strong><em><strong>EEE Access<\/strong><\/em>, 11, pages 109974-109982.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<p class=\"has-black-color has-text-color has-link-color has-medium-font-size wp-elements-04fae4cf4928dc61b82183e7d17cd66c\"><strong>Abstract<\/strong><\/p>\n\n\n\n<p style=\"font-size:clamp(14px, 0.875rem + ((1vw - 3.2px) * 0.156), 16px);\">BERT (Bidirectional Encoder Representations from Transformers) uses an encoder architecture with an attention mechanism to construct a transformer-based neural network. In this study, we develop a Chinese word-level BERT to learn contextual language representations and propose a transformer fusion framework for Chinese sentiment intensity prediction in the valence-arousal dimensions. Experimental results on the Chinese EmoBank indicate that our transformer-based fusion model outperforms other neural- network-based, regression-based and lexicon-based methods, reflecting the effectiveness of integrating semantic representations in different degrees of linguistic granularity. Our proposed transformer fusion framework is also simple and easy to fine-tune over different downstream tasks.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"537\" src=\"http:\/\/140.115.70.194:6417\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-1024x537.png\" alt=\"\" class=\"wp-image-453\" srcset=\"https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-1024x537.png 1024w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-300x157.png 300w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-768x403.png 768w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-1536x806.png 1536w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u53489.57.20-2048x1075.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Yu-Chih Deng, Yih-Ru Wang, Sin-Horng Chen, Lung-Hao Lee*<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"categories":[6],"tags":[34,43,10],"class_list":["post-452","post","type-post","status-publish","format-standard","hentry","category-achievements","tag-34","tag-emotion","tag-ieee-access"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/452","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/comments?post=452"}],"version-history":[{"count":3,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/452\/revisions"}],"predecessor-version":[{"id":776,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/452\/revisions\/776"}],"wp:attachment":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/media?parent=452"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/categories?post=452"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/tags?post=452"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}