Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userTechnology-Augmented Multilingual Communication Models: New Interaction Paradigms, Shifts in the Language Services Industry, and Implications for Training Programs
نماذج الاتصالات متعددة اللغات المعززة للتكنولوجيا: نماذج تفاعل جديدة، وتحولات في صناعة الخدمات اللغوية، والآثار المترتبة على برامج التدريب
204
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
تستكشف هذه الورقة كيف تؤثر التكنولوجيا، وخاصة الأدوات الرقمية والذكاء الاصطناعي، عمليات نقل اللغة واللغات متعددة اللغات. تقوم تكنولوجيات المعلومات والاتصالات بتمكين أنماط التفاعل الجديدة، مع انتقال أجهزة الكمبيوتر من وسائل الإعلام النقية إلى مولدات اللغة الفعلية، وإعادة تشكيلها عميقا صناعة الخدمات اللغوية، حيث استمرت أهمية بيانات اللغة ومساعدة المحركات في الارتفاع. نظرا لأن هذه التغييرات تؤثر بشدة على نماذج التواصل واللغات بشكل عام، فإنها تحتاج إلى معالجة ليس فقط من منظور تكنولوجيا المعلومات أو عن طريق الشركات التي يحركها الأعمال، ولكن أيضا في مجال الدراسات الترجمة والتفسيرية، في مناقشة أوسع بين العلماء والممارسين وعند إعداد البرامج التعليمية لتدريب المهنيين اللغوي المتخصصين. يتم تخصيص التركيز الخاص لبعض أحدث التطورات في التعرف التلقائي على التعرف على الكلام والترجمة المنطوقة، وكيفية دفع تطبيقاتها في الترجمة الفورية حدود حالات الاستخدام المعزز في العالم الجديد. وبالتالي، فإن هذا العمل --- عند تقاطع التحقيق النظري والممارسة المهنية والتصميم التعليمي --- يهدف إلى تقديم نظرة عامة تمهيدية على المناظر الطبيعية الحالية وتتصور المسارات المحتملة للسيناريوهات القادمة.
This paper explores how technology, particularly digital tools and artificial intelligence, are impacting multilingual communication and language transfer processes. Information and communication technologies are enabling novel interaction patterns, with computers transitioning from pure media to actual language generators, and profoundly reshaping the industry of language services, as the relevance of language data and assisting engines continues to rise. Since these changes deeply affect communication and languages models overall, they need to be addressed not only from the perspective of information technology or by business-driven companies, but also in the field of translation and interpreting studies, in a broader debate among scholars and practitioners, and when preparing educational programs for the training of specialised language professionals. Special focus is devoted to some of the latest advancements in automatic speech recognition and spoken translation, and how their applications in interpreting may push the boundaries of new augmented' real-world use cases. Hence, this work---at the intersection of theoretical investigation, professional practice, and instructional design---aims at offering an introductory overview of the current landscape and envisaging potential paths for forthcoming scenarios.
References used
https://aclanthology.org/
rate research
Read More
Pre-trained multilingual language models have become an important building block in multilingual Natural Language Processing. In the present paper, we investigate a range of such models to find out how well they transfer discourse-level knowledge acr
oss languages. This is done with a systematic evaluation on a broader set of discourse-level tasks than has been previously been assembled. We find that the XLM-RoBERTa family of models consistently show the best performance, by simultaneously being good monolingual models and degrading relatively little in a zero-shot setting. Our results also indicate that model distillation may hurt the ability of cross-lingual transfer of sentence representations, while language dissimilarity at most has a modest effect. We hope that our test suite, covering 5 tasks with a total of 22 languages in 10 distinct families, will serve as a useful evaluation platform for multilingual performance at and beyond the sentence level.
This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextual multilingual multimodal embeddings. Under a zero-s
hot setting, we empirically demonstrate that performance degrades significantly when we query the multilingual text-video model with non-English sentences. To address this problem, we introduce a multilingual multimodal pre-training strategy, and collect a new multilingual instructional video dataset (Multi-HowTo100M) for pre-training. Experiments on VTT show that our method significantly improves video search in non-English languages without additional annotations. Furthermore, when multilingual annotations are available, our method outperforms recent baselines by a large margin in multilingual text-to-video search on VTT and VATEX; as well as in multilingual text-to-image search on Multi30K. Our model and Multi-HowTo100M is available at http://github.com/berniebear/Multi-HT100M.
Transfer learning based on pretraining language models on a large amount of raw data has become a new norm to reach state-of-the-art performance in NLP. Still, it remains unclear how this approach should be applied for unseen languages that are not c
overed by any available large-scale multilingual language model and for which only a small amount of raw data is generally available. In this work, by comparing multilingual and monolingual models, we show that such models behave in multiple ways on unseen languages. Some languages greatly benefit from transfer learning and behave similarly to closely related high resource languages whereas others apparently do not. Focusing on the latter, we show that this failure to transfer is largely related to the impact of the script used to write such languages. We show that transliterating those languages significantly improves the potential of large-scale multilingual language models on downstream tasks. This result provides a promising direction towards making these massively multilingual models useful for a new set of unseen languages.
Pretrained multilingual language models have become a common tool in transferring NLP capabilities to low-resource languages, often with adaptations. In this work, we study the performance, extensibility, and interaction of two such adaptations: voca
bulary augmentation and script transliteration. Our evaluations on part-of-speech tagging, universal dependency parsing, and named entity recognition in nine diverse low-resource languages uphold the viability of these approaches while raising new questions around how to optimally adapt multilingual models to low-resource settings.
We analyze if large language models are able to predict patterns of human reading behavior. We compare the performance of language-specific and multilingual pretrained transformer models to predict reading time measures reflecting natural human sente
nce processing on Dutch, English, German, and Russian texts. This results in accurate models of human reading behavior, which indicates that transformer models implicitly encode relative importance in language in a way that is comparable to human processing mechanisms. We find that BERT and XLM models successfully predict a range of eye tracking features. In a series of experiments, we analyze the cross-domain and cross-language abilities of these models and show how they reflect human sentence processing.
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
