Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userGenerating Mammography Reports from Multi-view Mammograms with BERT
توليد تقارير التصوير بالثدي بالأشعة الأمثوية متعددة الرؤية مع بيرت
366
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
يمكن أن يكون كتابة تقارير التصوير الشعاعي للتصوير الشعاعي للثدي عرضة للخططاء وتستغرق وقتا طويلا لأخصائيي الأشعة.في هذه الورقة نقترح طريقة لتوليد تقارير التصوير الشعاعي للثدي المصنوعة من التصوير بالثدي المصنوعة من التصوير بالثديإلى أفضل ما لدينا، يمثل عملنا المحاولة الأولى لإنشاء تقرير التصوير الشعاعي للثدي باستخدام التعلم العميق.نقترح نموذج فك تشفير التشفير الذي يتضمن ترميزا مقصورا ومكيفا محولا.نوضح أن آلية الاهتمام القائمة على المحولات يمكنها الجمع بين المعلومات المرئية والدلية لتوسيع المناطق البارزة على تصوير الثدييات الإدخال وتوليد تقرير تفسير بصريا.تظهر التجارب التي أجريت، بما في ذلك تقييم من قبل عالم الأشعة المعتمدة، فعالية الطريقة المقترحة.
Writing mammography reports can be error-prone and time-consuming for radiologists. In this paper we propose a method to generate mammography reports given four images, corresponding to the four views used in screening mammography. To the best of our knowledge our work represents the first attempt to generate the mammography report using deep-learning. We propose an encoder-decoder model that includes an EfficientNet-based encoder and a Transformer-based decoder. We demonstrate that the Transformer-based attention mechanism can combine visual and semantic information to localize salient regions on the input mammograms and generate a visually interpretable report. The conducted experiments, including an evaluation by a certified radiologist, show the effectiveness of the proposed method.
References used
https://aclanthology.org/
rate research
Read More
We study a new problem of cross-lingual transfer learning for event coreference resolution (ECR) where models trained on data from a source language are adapted for evaluations in different target languages. We introduce the first baseline model for
this task based on XLM-RoBERTa, a state-of-the-art multilingual pre-trained language model. We also explore language adversarial neural networks (LANN) that present language discriminators to distinguish texts from the source and target languages to improve the language generalization for ECR. In addition, we introduce two novel mechanisms to further enhance the general representation learning of LANN, featuring: (i) multi-view alignment to penalize cross coreference-label alignment of examples in the source and target languages, and (ii) optimal transport to select close examples in the source and target languages to provide better training signals for the language discriminators. Finally, we perform extensive experiments for cross-lingual ECR from English to Spanish and Chinese to demonstrate the effectiveness of the proposed methods.
Though word embeddings and topics are complementary representations, several past works have only used pretrained word embeddings in (neural) topic modeling to address data sparsity in short-text or small collection of documents. This work presents a
novel neural topic modeling framework using multi-view embed ding spaces: (1) pretrained topic-embeddings, and (2) pretrained word-embeddings (context-insensitive from Glove and context-sensitive from BERT models) jointly from one or many sources to improve topic quality and better deal with polysemy. In doing so, we first build respective pools of pretrained topic (i.e., TopicPool) and word embeddings (i.e., WordPool). We then identify one or more relevant source domain(s) and transfer knowledge to guide meaningful learning in the sparse target domain. Within neural topic modeling, we quantify the quality of topics and document representations via generalization (perplexity), interpretability (topic coherence) and information retrieval (IR) using short-text, long-text, small and large document collections from news and medical domains. Introducing the multi-source multi-view embedding spaces, we have shown state-of-the-art neural topic modeling using 6 source (high-resource) and 5 target (low-resource) corpora.
We propose the task of automatically generating commentaries for races in a motor racing game, from vision, structured numerical, and textual data. Commentaries provide information to support spectators in understanding events in races. Commentary ge
neration models need to interpret the race situation and generate the correct content at the right moment. We divide the task into two subtasks: utterance timing identification and utterance generation. Because existing datasets do not have such alignments of data in multiple modalities, this setting has not been explored in depth. In this study, we introduce a new large-scale dataset that contains aligned video data, structured numerical data, and transcribed commentaries that consist of 129,226 utterances in 1,389 races in a game. Our analysis reveals that the characteristics of commentaries change over time or from viewpoints. Our experiments on the subtasks show that it is still challenging for a state-of-the-art vision encoder to capture useful information from videos to generate accurate commentaries. We make the dataset and baseline implementation publicly available for further research.
112 patients with suspected breast lesions were investigated using Scintimammography with 99mTc-MIBI, mammography and magnetic resonance to compare the diagnostic accuracy of Scintimammography with that of mammography and magnetic resonance in the d
etecting of primary breast cancer. Excisional biopsy was taken after 7-10 days of Scintimammography. 70 patients were diagnosed with breast cancer; 55 palpable and 15 non-palpable lesions, while 42, 30 palpable and 12 non-palpable were diagnosed as benign lesions. The sensitivity of the three methods were high and approximate (89% by Scintimammography, 90% by mammography and 94% by magnetic resonance), while Scintimammography showed higher specificity (86%) versus 21% for mammography and 50% for magnetic resonance. The high specificity in addition to high positive (91%) and negative (82%) predictive values of Scintimammography resulted in a highly accurate diagnostic (87%) method compared to mammography (64%) and magnetic resonance (78%) procedures. Through the complementary use of Scintimammography it is possible to increase the sensitivity for the detection of breast cancer. In patients in whom the status of a palpable breast mass remains unclear, Scintimammography may help to reduce the amount of unnecessary biopsies.
How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text. However, these extractive exp
lanations are not necessarily concise i.e. not minimally sufficient for answering a question. Instead, we advocate for an abstractive approach, where we propose to generate a question-focused, abstractive summary of input paragraphs and then feed it to an RC system. Given a limited amount of human-annotated abstractive explanations, we train the abstractive explainer in a semi-supervised manner, where we start from the supervised model and then train it further through trial and error maximizing a conciseness-promoted reward function. Our experiments demonstrate that the proposed abstractive explainer can generate more compact explanations than an extractive explainer with limited supervision (only 2k instances) while maintaining sufficiency.
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
