Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userEvent Representation with Sequential, Semi-Supervised Discrete Variables
تمثيل الأحداث بمتغيرات منفصلة متسلسلة وشبه إشراف
269
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
في سياق نمذجة الأحداث والتفاهم، نقترح طريقة جديدة للنمذجة التسلسل العصبية التي تأخذ تسلسلات ملحوظة جزئيا من المعرفة المنفصلة والخارجية في الاعتبار.نقوم بإنشاء AutoNcoder Neal STUITENCODER المتسلسل، والذي يستخدم إعادة تجديد Gumbel-Softmax ضمن تشفير محددة بعناية، للسماح بعملي ناجح خلال التدريب.تتمثل الفكرة الأساسية في السماح بالمعرفة المنفصلة الخارجية شبه الإشراف للتوجيه، ولكن لا تقيد، المعلمات الكامنة المتنوعة أثناء التدريب.تشير تجاربنا إلى أن نهجنا لا يتفوق فقط على خطوط أساسية متعددة وحديث الحديث في تحريض النصي السردي، ولكن أيضا التقارب بسرعة أكبر.
Within the context of event modeling and understanding, we propose a new method for neural sequence modeling that takes partially-observed sequences of discrete, external knowledge into account. We construct a sequential neural variational autoencoder, which uses Gumbel-Softmax reparametrization within a carefully defined encoder, to allow for successful backpropagation during training. The core idea is to allow semi-supervised external discrete knowledge to guide, but not restrict, the variational latent parameters during training. Our experiments indicate that our approach not only outperforms multiple baselines and the state-of-the-art in narrative script induction, but also converges more quickly.
References used
https://aclanthology.org/
rate research
Read More
In this paper, we review related literature
and introduce a new general purpose simulation engine for
distributed discrete event simulation. We implemented optimized
loop CMB algorithms as a conservative algorithm in Akka
framework. The new engin
e is evaluated in terms of performance
and the ability of modeling and simulating discrete systems such
as digital circuits and single server queuing system.
In this paper, we focus on identifying interactive argument pairs from two posts with opposite stances to a certain topic. Considering opinions are exchanged from different perspectives of the discussing topic, we study the discrete representations f
or arguments to capture varying aspects in argumentation languages (e.g., the debate focus and the participant behavior). Moreover, we utilize hierarchical structure to model post-wise information incorporating contextual knowledge. Experimental results on the large-scale dataset collected from CMV show that our proposed framework can significantly outperform the competitive baselines. Further analyses reveal why our model yields superior performance and prove the usefulness of our learned representations.
Despite the recent advances in applying pre-trained language models to generate high-quality texts, generating long passages that maintain long-range coherence is yet challenging for these models. In this paper, we propose DiscoDVT, a discourse-aware
discrete variational Transformer to tackle the incoherence issue. DiscoDVT learns a discrete variable sequence that summarizes the global structure of the text and then applies it to guide the generation process at each decoding step. To further embed discourse-aware information into the discrete latent representations, we introduce an auxiliary objective to model the discourse relations within the text. We conduct extensive experiments on two open story generation datasets and demonstrate that the latent codes learn meaningful correspondence to the discourse structures that guide the model to generate long texts with better long-range coherence.
Relating entities and events in text is a key component of natural language understanding. Cross-document coreference resolution, in particular, is important for the growing interest in multi-document analysis tasks. In this work we propose a new mod
el that extends the efficient sequential prediction paradigm for coreference resolution to cross-document settings and achieves competitive results for both entity and event coreference while providing strong evidence of the efficacy of both sequential models and higher-order inference in cross-document settings. Our model incrementally composes mentions into cluster representations and predicts links between a mention and the already constructed clusters, approximating a higher-order model. In addition, we conduct extensive ablation studies that provide new insights into the importance of various inputs and representation types in coreference.
Automatic summarization aims to extract important information from large amounts of textual data in order to create a shorter version of the original texts while preserving its information. Training traditional extractive summarization models relies
heavily on human-engineered labels such as sentence-level annotations of summary-worthiness. However, in many use cases, such human-engineered labels do not exist and manually annotating thousands of documents for the purpose of training models may not be feasible. On the other hand, indirect signals for summarization are often available, such as agent actions for customer service dialogues, headlines for news articles, diagnosis for Electronic Health Records, etc. In this paper, we develop a general framework that generates extractive summarization as a byproduct of supervised learning tasks for indirect signals via the help of attention mechanism. We test our models on customer service dialogues and experimental results demonstrated that our models can reliably select informative sentences and words for automatic summarization.
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
