في هذه الورقة، نصف إدخال نظامنا للمهمة المشتركة 8 في SMM4H-2021، وهو في التصنيف التلقائي لمرورات سرطان الثدي التي تم الإبلاغ عنها على Twitter.في نظامنا، نستخدم نهج ضبط طراز بلغة قائمة على المحولات لتحديد التغريدات تلقائيا في فئة التقارير الذاتية.علاوة على ذلك، فإننا نضمن ضبطا غرامة مقيم تدريجيا لتحسين متانة النموذج العام.حقق نظامنا درجة F1 من 0.8625 على مجموعة التطوير و 0.8501 في مجموعة الاختبار في مهمة مشتركة - 8 من SMM4H-2021.
In this paper, we describe our system entry for Shared Task 8 at SMM4H-2021, which is on automatic classification of self-reported breast cancer posts on Twitter. In our system, we use a transformer-based language model fine-tuning approach to automatically identify tweets in the self-reports category. Furthermore, we involve a Gradient-based Adversarial fine-tuning to improve the overall model's robustness. Our system achieved an F1-score of 0.8625 on the Development set and 0.8501 on the Test set in Shared Task-8 of SMM4H-2021.
References used
https://aclanthology.org/
In this paper, we describe our system used for SemEval 2021 Task 7: HaHackathon: Detecting and Rating Humor and Offense. We used a simple fine-tuning approach using different Pre-trained Language Models (PLMs) to evaluate their performance for humor
This paper describes our submission to SemEval-2021 Task 1: predicting the complexity score for single words. Our model leverages standard morphosyntactic and frequency-based features that proved helpful for Complex Word Identification (a related tas
We study the power of cross-attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross-attention when training from scratch. We conduct a series of experime
This paper discusses different approaches to the Toxic Spans Detection task. The problem posed by the task was to determine which words contribute mostly to recognising a document as toxic. As opposed to binary classification of entire texts, word-le
This paper presents our system for the Quantity span identification, Unit of measurement identification and Value modifier classification subtasks of the MeasEval 2021 task. The purpose of the Quantity span identification task was to locate spans of