Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userModel-based analysis of brain activity reveals the hierarchy of language in 305 subjects
تحليل نموذجي لنشاط الدماغ يكشف التسلسل الهرمي للغة في 305 مواضيع
218
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
يتكون نهج شعبي لتحلل القواعد العصبية للغة في الارتباط، عبر الأفراد، وردود الدماغ على محفزات مختلفة (مثل الخطاب العادي مقابل الكلمات أو الجمل أو الفقرات). على الرغم من النجاح، إلا أن هذا النهج الخالي من النموذج يستلزم الاستحواذ على مجموعة كبيرة ومكلفة من بيانات الأعصاب. هنا، نوضح أن النهج القائم على النموذج يمكن أن يصل إلى نتائج معادلة داخل الموضوعات المعرضة للمحفزات الطبيعية. نستفيدون في أوجه التشابهات التي اكتشفت مؤخرا بين نماذج اللغة العميقة والدماغ البشري لحساب رسم الخرائط بين ط) ردود الدماغ على الكلام العادي والثاني) تفعيلات نماذج اللغة العميقة التي تم تنشيطها من قبل المحفزات المعدلة (مثل الكلمات المخفوقة أو الجمل أو الفقرات). نهجنا القائم على النموذج بنجاح تكرر الدراسة الفيدرودية ل Lerner et al. (2011)، والتي كشفت التسلسل الهرمي لمناطق اللغة من خلال مقارنة التصوير بالرنين المغناطيسي الوظائف (FMRI) من سبعة مواضيع تستمع إلى 7 دقائق من الروايات العادية والخلطية. نحن كذلك تمديد هذه النتائج ودقيقة لإشارات الدماغ من 305 شخصا يستمعون إلى 4.1 ساعة من القصص الروى. بشكل عام، تمهد هذه الدراسة الطريق لتحليلات فعالة ومرنة لقواعد الدماغ من اللغة.
A popular approach to decompose the neural bases of language consists in correlating, across individuals, the brain responses to different stimuli (e.g. regular speech versus scrambled words, sentences, or paragraphs). Although successful, this model-free' approach necessitates the acquisition of a large and costly set of neuroimaging data. Here, we show that a model-based approach can reach equivalent results within subjects exposed to natural stimuli. We capitalize on the recently-discovered similarities between deep language models and the human brain to compute the mapping between i) the brain responses to regular speech and ii) the activations of deep language models elicited by modified stimuli (e.g. scrambled words, sentences, or paragraphs). Our model-based approach successfully replicates the seminal study of Lerner et al. (2011), which revealed the hierarchy of language areas by comparing the functional-magnetic resonance imaging (fMRI) of seven subjects listening to 7min of both regular and scrambled narratives. We further extend and precise these results to the brain signals of 305 individuals listening to 4.1 hours of narrated stories. Overall, this study paves the way for efficient and flexible analyses of the brain bases of language.
References used
https://aclanthology.org/
rate research
Read More
Discourse segmentation and sentence-level discourse parsing play important roles for various NLP tasks to consider textual coherence. Despite recent achievements in both tasks, there is still room for improvement due to the scarcity of labeled data.
To solve the problem, we propose a language model-based generative classifier (LMGC) for using more information from labels by treating the labels as an input while enhancing label representations by embedding descriptions for each label. Moreover, since this enables LMGC to make ready the representations for labels, unseen in the pre-training step, we can effectively use a pre-trained language model in LMGC. Experimental results on the RST-DT dataset show that our LMGC achieved the state-of-the-art F1 score of 96.72 in discourse segmentation. It further achieved the state-of-the-art relation F1 scores of 84.69 with gold EDU boundaries and 81.18 with automatically segmented boundaries, respectively, in sentence-level discourse parsing.
The Brain Computer Interface (BCI) is considered the latest development of the Human Computer Interface (HCI). Unlike traditional input devices (keyboard, mouse, etc.) BCI reads brain signals from different areas of the human head and translates thes
e signals into commands that can control the computer.
The importance of BCI comes from its many applications such as medical applications, especially to assist people with disabilities to help them deal with computers, and help people with Locked-In Syndrome to communicate with the outside world. and advertising applications to see how much the customer appreciates the product, Security applications, or finding a new way to play games using your brain.
The aim of this research is to demonstrate the most recent solutions to the problems faced by computer-brain interfaces and the algorithms used to classify brain signals. The difficulty of this research is the in extracting and processing the signal.
Deep reinforcement learning provides a promising approach for text-based games in studying natural language communication between humans and artificial agents. However, the generalization still remains a big challenge as the agents depend critically
on the complexity and variety of training tasks. In this paper, we address this problem by introducing a hierarchical framework built upon the knowledge graph-based RL agent. In the high level, a meta-policy is executed to decompose the whole game into a set of subtasks specified by textual goals, and select one of them based on the KG. Then a sub-policy in the low level is executed to conduct goal-conditioned reinforcement learning. We carry out experiments on games with various difficulty levels and show that the proposed method enjoys favorable generalizability.
Exploiting label hierarchies has become a promising approach to tackling the zero-shot multi-label text classification (ZS-MTC) problem. Conventional methods aim to learn a matching model between text and labels, using a graph encoder to incorporate
label hierarchies to obtain effective label representations (Rios and Kavuluru, 2018). More recently, pretrained models like BERT (Devlin et al., 2018) have been used to convert classification tasks into a textual entailment task (Yin et al., 2019). This approach is naturally suitable for the ZS-MTC task. However, pretrained models are underexplored in the existing work because they do not generate individual vector representations for text or labels, making it unintuitive to combine them with conventional graph encoding methods. In this paper, we explore to improve pretrained models with label hierarchies on the ZS-MTC task. We propose a Reinforced Label Hierarchy Reasoning (RLHR) approach to encourage interdependence among labels in the hierarchies during training. Meanwhile, to overcome the weakness of flat predictions, we design a rollback algorithm that can remove logical errors from predictions during inference. Experimental results on three real-life datasets show that our approach achieves better performance and outperforms previous non-pretrained methods on the ZS-MTC task.
Statistical language modeling and translation with transformers have found many successful applications in program understanding and generation tasks, setting high benchmarks for tools in modern software development environments. The finite context w
indow of these neural models means, however, that they will be unable to leverage the entire relevant context of large files and packages for any given task. While there are many efforts to extend the context window, we introduce an architecture-independent approach for leveraging the syntactic hierarchies of source code for incorporating entire file-level context into a fixed-length window. Using concrete syntax trees of each source file we extract syntactic hierarchies and integrate them into context window by selectively removing from view more specific, less relevant scopes for a given task. We evaluate this approach on code generation tasks and joint translation of natural language and source code in Python programming language, achieving a new state-of-the-art in code completion and summarization for Python in the CodeXGLUE benchmark. We also introduce new CodeXGLUE benchmarks for user-experience-motivated tasks: code completion with normalized literals, method body completion/code summarization conditioned on file-level context.
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
