ReasonBERT: Pre-trained to Reason with Distant Supervision

We present ReasonBert, a pre-training method that augments language models with the ability to reason over long-range relations and multiple, possibly hybrid contexts. Unlike existing pre-training methods that only harvest learning signals from local contexts of naturally occurring texts, we propose a generalized notion of distant supervision to automatically connect multiple pieces of text and tables to create pre-training examples that require long-range reasoning. Different types of reasoning are simulated, including intersecting multiple pieces of evidence, bridging from one piece of evidence to another, and detecting unanswerable cases. We conduct a comprehensive evaluation on a variety of extractive question answering datasets ranging from single-hop to multi-hop and from text-only to table-only to hybrid that require various reasoning capabilities and show that ReasonBert achieves remarkable improvement over an array of strong baselines. Few-shot experiments further demonstrate that our pre-training method substantially improves sample efficiency.

"Saub al- oqual" a poetic concept at Abu-Tammam

This study tackles an important part of Abu-Tammam's vision that considers the poetry outcome of reason. And that is an important shift of the concept of Arabic Poetry , which is charged with lyricism and lack of thought .

The Arab Grammatical Reason of Grammatical Reference until six migration century

The syntax is the spirit of language , the core of its movement, it is living heart. And it is way of interpretation which is a pure mental manner . Taken by Arab Grammarians, so they gave it great effort in order to interpret the syntactic and morphological bases . The following research considers the most important views of the old and modern syntax-specialists as starting point of studying the syntax – interpretations at two levels : the first Level contains concept and approach, It monitors the concept of reasoning in as, and the implications at rules of this term, the statement its motive which is based language in use . and the second level is referential . It demands its elements and the views of Arab syntax in it , and it clears its rules which was established tell the six migration century .