Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userExplaining Decision-Tree Predictions by Addressing Potential Conflicts between Predictions and Plausible Expectations
شرح تنبؤات شجرة القرار من خلال معالجة النزاعات المحتملة بين التوقعات والتوقعات المعقولة
177
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
نحن نقدم نهجا لشرح تنبؤات شجرة القرار (DT) من خلال معالجة النزاعات المحتملة بين جوانب هذه التنبؤات والتوقعات المعقولة المرخصة من المعلومات الأساسية.نحن نحدد أربعة أنواع من النزاعات، وتفعيل هويتها، وتحديد مخططات توضيحية تعالجها.ركز تقييمنا البشري على تأثير التفسيرات المتعلقة بفهم المستخدمين لسبب DT واستعدادهم للعمل على تنبؤاتها.تظهر النتائج أن التفسيرات (1) تفسيرات التي تعالج النزاعات المحتملة تعتبر على الأقل جيدة مثل التفسيرات الأساسية التي تتبع مسار DT فقط؛و (2) يتم اعتبار التفسيرات القائمة على النزاعات قيمة خاصة عندما لا توافق توقعات المستخدمين في توقعات DT.
We offer an approach to explain Decision Tree (DT) predictions by addressing potential conflicts between aspects of these predictions and plausible expectations licensed by background information. We define four types of conflicts, operationalize their identification, and specify explanatory schemas that address them. Our human evaluation focused on the effect of explanations on users' understanding of a DT's reasoning and their willingness to act on its predictions. The results show that (1) explanations that address potential conflicts are considered at least as good as baseline explanations that just follow a DT path; and (2) the conflict-based explanations are deemed especially valuable when users' expectations disagree with the DT's predictions.
References used
https://aclanthology.org/
rate research
Read More
Explaining neural network models is important for increasing their trustworthiness in real-world applications. Most existing methods generate post-hoc explanations for neural network models by identifying individual feature attributions or detecting
interactions between adjacent features. However, for models with text pairs as inputs (e.g., paraphrase identification), existing methods are not sufficient to capture feature interactions between two texts and their simple extension of computing all word-pair interactions between two texts is computationally inefficient. In this work, we propose the Group Mask (GMASK) method to implicitly detect word correlations by grouping correlated words from the input text pair together and measure their contribution to the corresponding NLP tasks as a whole. The proposed method is evaluated with two different model architectures (decomposable attention model and BERT) across four datasets, including natural language inference and paraphrase identification tasks. Experiments show the effectiveness of GMASK in providing faithful explanations to these models.
This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we prove that attention weights systematically make alignment errors by rel
ying mainly on uninformative tokens from the source sequence. However, we observe that NMT models assign attention to these tokens to regulate the contribution in the prediction of the two contexts, the source and the prefix of the target sequence. We provide evidence about the influence of wrong alignments on the model behavior, demonstrating that the encoder-decoder attention mechanism is well suited as an interpretability method for NMT. Finally, based on our analysis, we propose methods that largely reduce the word alignment error rate compared to standard induced alignments from attention weights.
To build robust question answering systems, we need the ability to verify whether answers to questions are truly correct, not just good enough'' in the context of imperfect QA datasets. We explore the use of natural language inference (NLI) as a way
to achieve this goal, as NLI inherently requires the premise (document context) to contain all necessary information to support the hypothesis (proposed answer to the question). We leverage large pre-trained models and recent prior datasets to construct powerful question conversion and decontextualization modules, which can reformulate QA instances as premise-hypothesis pairs with very high reliability. Then, by combining standard NLI datasets with NLI examples automatically derived from QA training data, we can train NLI models to evaluate QA models' proposed answers. We show that our approach improves the confidence estimation of a QA model across different domains, evaluated in a selective QA setting. Careful manual analysis over the predictions of our NLI model shows that it can further identify cases where the QA model produces the right answer for the wrong reason, i.e., when the answer sentence cannot address all aspects of the question.
Improving user experience of a dialogue system often requires intensive developer effort to read conversation logs, run statistical analyses, and intuit the relative importance of system shortcomings. This paper presents a novel approach to automated
analysis of conversation logs that learns the relationship between user-system interactions and overall dialogue quality. Unlike prior work on utterance-level quality prediction, our approach learns the impact of each interaction from the overall user rating without utterance-level annotation, allowing resultant model conclusions to be derived on the basis of empirical evidence and at low cost. Our model identifies interactions that have a strong correlation with the overall dialogue quality in a chatbot setting. Experiments show that the automated analysis from our model agrees with expert judgments, making this work the first to show that such weakly-supervised learning of utterance-level quality prediction is highly achievable.
مقدمة إلى الفستق الحلبي
التصنيف النباتي والأصناف
الأنواع البرية للفستق الحلبي المنتشرة في سورية
البطم الأطلسي
البطم التربنتيني
البطم الفلسطيني
البطم العدسي
البطم الأخضر
اهم أصناف الفستق الحلبي المنتشرة في سورية
الوصف المورفولوجي للفستق الحلب
ي
واقع الفستق الحلبي في سورية.
طرق إكثار الفستق الحلبي
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
