Medication Mention Detection in Tweets Using ELECTRA Transformers and Decision Trees

Lung-Hao Lee, Po-Han Chen, Hao-Chuan Kao, Ting-Chun Hung, Po-Lei Lee and Kuo-Kai Shyu.

In Proceedings of the 5th Social Media Mining for Health Applications (#SMM4H’20) Workshop and Shared Tasks, pages 131-133.


Abstract

This study describes our proposed model design for the SMM4H 2020 Task 1. We fine-tune ELECTRA transformers using our trained SVM filter for data augmentation, along with decision trees to detect medication mentions in tweets. Our best F1-score of 0.7578 exceeded the mean score 0.6646 of all 15 submitting teams.