{"id":473,"date":"2023-07-13T22:58:00","date_gmt":"2023-07-13T14:58:00","guid":{"rendered":"http:\/\/140.115.70.194:6417\/?p=473"},"modified":"2024-11-09T19:32:07","modified_gmt":"2024-11-09T11:32:07","slug":"ncuee-nlp-at-semeval-2023-task-7","status":"publish","type":"post","link":"https:\/\/ainlp.tw\/index.php\/2023\/07\/13\/ncuee-nlp-at-semeval-2023-task-7\/","title":{"rendered":"NCUEE-NLP at SemEval-2023 Task 7: Ensemble Biomedical LinkBERT Transformers in Multi-evidence Natural Language Inference for Clinical Trial Data"},"content":{"rendered":"\n<p>Chao-Yi Chen, Kao-Yuan Tien, Yuan-Hao Cheng, and Lung-Hao Lee.<\/p>\n\n\n\n<p>In\u00a0<em>Proceedings of the 17th International Workshop on Semantic Evaluation<\/em>\u00a0(<em><strong>SemEval&#8217;23<\/strong><\/em>), pages 776-781.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\"\/>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Abstract<\/strong><\/p>\n\n\n\n<p style=\"font-size:clamp(14px, 0.875rem + ((1vw - 3.2px) * 0.156), 16px);\">This study describes the model design of the NCUEE-NLP system for the SemEval-2023 NLI4CT task that focuses on multi-evidence natural language inference for clinical trial data. We use the LinkBERT transformer in the biomedical domain (denoted as BioLinkBERT) as our main system architecture. First, a set of sentences in clinical trial reports is extracted as evidence for premise-statement inference. This identified evidence is then used to determine the inference relation (i.e., entailment or contradiction). Finally, a soft voting ensemble mechanism is applied to enhance the system performance. For Subtask 1 on textual entailment, our best submission had an F1-score of 0.7091, ranking sixth among all 30 participating teams. For Subtask 2 on evidence retrieval, our best result obtained an F1-score of 0.7940, ranking ninth of 19 submissions.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"883\" src=\"http:\/\/140.115.70.194:6417\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534810.59.44-1024x883.png\" alt=\"\" class=\"wp-image-474\" srcset=\"https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534810.59.44-1024x883.png 1024w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534810.59.44-300x259.png 300w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534810.59.44-768x662.png 768w, https:\/\/ainlp.tw\/wp-content\/uploads\/2023\/12\/\u622a\u5716-2023-12-29-\u4e0b\u534810.59.44.png 1176w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Chao-Yi Chen, Kao-Yuan Tien, Yuan-Hao Cheng, and Lung-Hao Lee<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"categories":[6],"tags":[34,44,17],"class_list":["post-473","post","type-post","status-publish","format-standard","hentry","category-achievements","tag-34","tag-healthcare","tag-semeval"],"blocksy_meta":[],"_links":{"self":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/473","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/comments?post=473"}],"version-history":[{"count":3,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/473\/revisions"}],"predecessor-version":[{"id":780,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/posts\/473\/revisions\/780"}],"wp:attachment":[{"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/media?parent=473"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/categories?post=473"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ainlp.tw\/index.php\/wp-json\/wp\/v2\/tags?post=473"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}