Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userKnowledge Router: Learning Disentangled Representations for Knowledge Graphs
جهاز توجيه المعرفة: التعلم من تمثيلات الإعفاء من الرسوم البيانية المعرفة
282
0 0
0.0
(
0
)
Created by
Shamra Editor
Ask ChatGPT about the research
تصميم التمثيلات التعبيرية للكيانات والعلاقات في الرسم البياني المعرفي هو مسعى مهم. في حين أن العديد من الأساليب الحالية تركز بشكل أساسي على التعلم من الأنماط العلائقية والمعلومات الهيكلية، فقد تم تجاهل التعقيد الجوهري لكي كيانات KG أكثر أو أقل. بشكل أكثر ملاءمة، نفترض كيانات KG قد تكون أكثر تعقيدا مما نعتقد، أي، قد يرتدي الكيان العديد من القبعات والأحدث العلائقية قد تشكل بسبب أكثر من سبب واحد. تحقيقا لهذه الغاية، تقترح هذه الورقة التعلم من تمثيلات DESENTANGLED من كيانات كيغ كيغ - وهي طريقة جديدة تقوم بتخفيف الخصائص الكامنة الداخلية لكي كيانات كيغ كيانات. تعمل عملية DESTANGLED الخاصة بنا على مستوى الرسم البياني ويتم الاستفادة من آلية الحي لزيادة الخصائص المخفية لكل كيان. هذا النهج التعلم في التمثيل هذا هو نموذج غير مرجح ومتوافق مع نهج Enonical KG Adgedding. نقوم بإجراء تجارب مكثفة على العديد من مجموعات البيانات القياسية، تجهيز مجموعة متنوعة من النماذج (الإقصاء، بسيطة، والقلق) مع آلية DESTANGLING المقترحة. توضح النتائج التجريبية أن نهجنا المقترح يحسن الأداء بشكل كبير على المقاييس الرئيسية.
The design of expressive representations of entities and relations in a knowledge graph is an important endeavor. While many of the existing approaches have primarily focused on learning from relational patterns and structural information, the intrinsic complexity of KG entities has been more or less overlooked. More concretely, we hypothesize KG entities may be more complex than we think, i.e., an entity may wear many hats and relational triplets may form due to more than a single reason. To this end, this paper proposes to learn disentangled representations of KG entities - a new method that disentangles the inner latent properties of KG entities. Our disentangled process operates at the graph level and a neighborhood mechanism is leveraged to disentangle the hidden properties of each entity. This disentangled representation learning approach is model agnostic and compatible with canonical KG embedding approaches. We conduct extensive experiments on several benchmark datasets, equipping a variety of models (DistMult, SimplE, and QuatE) with our proposed disentangling mechanism. Experimental results demonstrate that our proposed approach substantially improves performance on key metrics.
References used
https://aclanthology.org/
rate research
Read More
Knowledge graphs (KGs) are widely used to store and access information about entities and their relationships. Given a query, the task of entity retrieval from a KG aims at presenting a ranked list of entities relevant to the query. Lately, an increa
sing number of models for entity retrieval have shown a significant improvement over traditional methods. These models, however, were developed for English KGs. In this work, we build on one such system, named KEWER, to propose SERAG (Semantic Entity Retrieval from Arabic knowledge Graphs). Like KEWER, SERAG uses random walks to generate entity embeddings. DBpedia-Entity v2 is considered the standard test collection for entity retrieval. We discuss the challenges of using it for non-English languages in general and Arabic in particular. We provide an Arabic version of this standard collection, and use it to evaluate SERAG. SERAG is shown to significantly outperform the popular BM25 model thanks to its multi-hop reasoning.
Knowledge graph entity typing aims to infer entities' missing types in knowledge graphs which is an important but under-explored issue. This paper proposes a novel method for this task by utilizing entities' contextual information. Specifically, we d
esign two inference mechanisms: i) N2T: independently use each neighbor of an entity to infer its type; ii) Agg2T: aggregate the neighbors of an entity to infer its type. Those mechanisms will produce multiple inference results, and an exponentially weighted pooling method is used to generate the final inference result. Furthermore, we propose a novel loss function to alleviate the false-negative problem during training. Experiments on two real-world KGs demonstrate the effectiveness of our method. The source code and data of this paper can be obtained from https://github.com/CCIIPLab/CET.
With the recent surge in social applications relying on knowledge graphs, the need for techniques to ensure fairness in KG based methods is becoming increasingly evident. Previous works have demonstrated that KGs are prone to various social biases, a
nd have proposed multiple methods for debiasing them. However, in such studies, the focus has been on debiasing techniques, while the relations to be debiased are specified manually by the user. As manual specification is itself susceptible to human cognitive bias, there is a need for a system capable of quantifying and exposing biases, that can support more informed decisions on what to debias. To address this gap in the literature, we describe a framework for identifying biases present in knowledge graph embeddings, based on numerical bias metrics. We illustrate the framework with three different bias measures on the task of profession prediction, and it can be flexibly extended to further bias definitions and applications. The relations flagged as biased can then be handed to decision makers for judgement upon subsequent debiasing.
Interactive machine reading comprehension (iMRC) is machine comprehension tasks where knowledge sources are partially observable. An agent must interact with an environment sequentially to gather necessary knowledge in order to answer a question. We
hypothesize that graph representations are good inductive biases, which can serve as an agent's memory mechanism in iMRC tasks. We explore four different categories of graphs that can capture text information at various levels. We describe methods that dynamically build and update these graphs during information gathering, as well as neural models to encode graph representations in RL agents. Extensive experiments on iSQuAD suggest that graph representations can result in significant performance improvements for RL agents.
Knowledge Graphs (KGs) have become increasingly popular in the recent years. However, as knowledge constantly grows and changes, it is inevitable to extend existing KGs with entities that emerged or became relevant to the scope of the KG after its cr
eation. Research on updating KGs typically relies on extracting named entities and relations from text. However, these approaches cannot infer entities or relations that were not explicitly stated. Alternatively, embedding models exploit implicit structural regularities to predict missing relations, but cannot predict missing entities. In this article, we introduce a novel method to enrich a KG with new entities given their textual description. Our method leverages joint embedding models, hence does not require entities or relations to be named explicitly. We show that our approach can identify new concepts in a document corpus and transfer them into the KG, and we find that the performance of our method improves substantially when extended with techniques from association rule mining, text mining, and active learning.
suggested questions
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
