{"id":476,"date":"2023-07-13T23:04:00","date_gmt":"2023-07-13T15:04:00","guid":{"rendered":"http:\/\/140.115.70.194:6417\/?p=476"},"modified":"2024-11-09T19:30:14","modified_gmt":"2024-11-09T11:30:14","slug":"ncuee-nlp-semeval-2023","status":"publish","type":"post","link":"https:\/\/ainlp.tw\/index.php\/2023\/07\/13\/ncuee-nlp-semeval-2023\/","title":{"rendered":"NCUEE-NLP at SemEval-2023 Task 8: Identifying Medical Causal Claims and Extracting PIO Frames Using the Transformer Models"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Lung-Hao Lee, Yuan-Hao Cheng, Jen-Hao Yang, and Kao-Yuan Tien. <br>In\u00a0<em>Proceedings of the 17th International Workshop on Semantic Evaluation<\/em>\u00a0(<em><strong>SemEval&#8217;23<\/strong><\/em>), pages 312-317.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-medium-font-size wp-block-paragraph\"><strong>Abstract<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"font-size:clamp(14px, 0.875rem + ((1vw - 3.2px) * 0.156), 16px);\">This study describes the model design of the NCUEE-NLP system for the SemEval-2023 Task 8. We use the pre-trained transformer models and fine-tune the task datasets to identify medical causal claims and extract population, intervention, and outcome elements in a Reddit post when a claim is given. Our best system submission for the causal claim identification subtask achieved a F1-score of 70.15%. Our best submission for the PIO frame extraction subtask achieved F1-scores of 37.78% for Population class, 43.58% for Intervention class, and 30.67% for Outcome class, resulting in a macro-averaging F1-score of 37.34%. Our system evaluation results ranked second position among all participating teams.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"621\" src=\"http:\/\/140.115.70.194:6417\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-1024x621.png\" alt=\"\" class=\"wp-image-477\" srcset=\"https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-1024x621.png 1024w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-300x182.png 300w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-768x466.png 768w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-1536x931.png 1536w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534811.05.43-2048x1242.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Lung-Hao Lee, Yuan-Hao Cheng, Jen-Hao Yang, and Kao-Yuan Tien<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"categories":[6],"tags":[34,46,17],"class_list":["post-476","post","type-post","status-publish","format-standard","hentry","category-achievements","tag-34","tag-medicine","tag-semeval"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/476","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/comments?post=476"}],"version-history":[{"count":2,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/476\/revisions"}],"predecessor-version":[{"id":778,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/476\/revisions\/778"}],"wp:attachment":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/media?parent=476"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/categories?post=476"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/tags?post=476"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}