Skim-Attention: Learning to Focus via Document Layout

Transformer-based pre-training techniques of text and layout have proven effective in a number of document understanding tasks. Despite this success, multimodal pre-training models suffer from very high computational and memory costs. Motivated by human reading strategies, this paper presents Skim-Attention, a new attention mechanism that takes advantage of the structure of the document and its layout. Skim-Attention only attends to the 2-dimensional position of the words in a document. Our experiments show that Skim-Attention obtains a lower perplexity than prior works, while being more computationally efficient. Skim-Attention can be further combined with long-range Transformers to efficiently process long documents. We also show how Skim-Attention can be used off-the-shelf as a mask for any Pre-trained Language Model, allowing to improve their performance while restricting attention. Finally, we show the emergence of a document structure representation in Skim-Attention.

A Theoretical Study of X-ray produced by the Plasma Focus device based on Sing Lee model

The Lee code is applied to characterize the plasma focus in two plasma focus devices UNU/ICTP PFF and Amirkabir plasma focus device (APF), and for optimizing the nitrogen soft x-ray yields based on bank, tubes and operating parameters. It is found that the soft x-ray yield increases with changing pressure until it reaches the maximum value for each plasma focus device, with keeping the bank parameters, operational voltage unchanged but systematically changing other parameters.

Instructional Strategies and Its Relationship with Learning Orientation and Mental Focus for Students of Tishreen University A Field Study

The purpose of this study was to determine the level of Learning Orientation and Mental Focus for students of Tishreen University. This study also aimed at investigating affection of many variables on students` Learning Orientation and Mental Focussuch as instructional strategies, gender and specialization. Sample consisted of (672) students from Tishreen University in academic year (2016-2017). The Results Of This Study Showed:  The most preferred strategies by students are interactive Strategies; (57.4%) of students prefer to learn by using of interactive strategies.  Students of Tishreen University have a very good level of Learning Orientation (77.46%) and Acceptable level of Mental Focus (57.98%).  There is no a statistical difference between students` mean scores on scale of Learning Orientation contributed to gender variable, but There is a statistical difference between students` mean scores on scale of Mental Focus contributed to gender variable. This difference is in favor of males.  Learning Orientation are affected by Instructional Strategies; the students who prefer interactive strategies have mental focus more than students who prefer show strategies. The study recommended to continue in investigating for variables that increase with Learning Orientation and Mental Focus.

Numerical study of soft x-ray yield in two dense plasma focus devices based on Lee code, and comparing it with experimental results using neon filling gas

In this work we carried out some numerical experiments on NX2, UNU/ICTP PFF dense plasma focus device with neon filling gas using Lee code version (RADPFV5.15de.c1) and standard parameters of the devices to compare the value of the soft x-ray yield (Ysxr) emitting from each one. Also we studied the influence some factors on the value of (Ysxr).

Theoretical Pulsed Current Measurements in Plasma Focus

The measurement of pulsed current by the Rogowski coil method is described. The current transformer with a large number of turns terminator has good short-time response, necessary for the sharp current dip region

The Effect of The Forward Roll In Gymnastics on The Attention Focus of Students of Ages (10-12)

The research was conducted on a sample of 16 basic education students in the city of Latakia including both genders . Using The Experimental method which is the suitable method for the nature of the search the researcher conducted the pre-test on the sample using Tachiscope test calculating the number of right times and taking performance time in the consideration. After a series of rolls. the research concluded that the forward roll remarkably improves the attention focus by analyzing the pre-test and post-tests results .that confirms the positive effect of rolls on the attention focus. The researcher recommended that it is important to train the school students on the forward roll in the sports class because of its positive effect on the subjects that needs attention focus and mental processes in general

Studying and modeling of the carbon formation process during fuel burning in engines

Hydrocarbon burning nowadays has a great part of the required energy consumed in the world, mainly in the transport vehicle engines, which seems to be the main source in the future. This urges us develop the fuel burning in different internal combustion engines according to the environmental increasing requirements nowadays. The carbon fine-dust produced is the main source of the environmental pollutants, which could be considered as the main cause of cancer. Therefore our present paper deals with the way of carbon fine dust formation during fuel burning in engines and gives a mathematical model describing that complex method, and studying the different function affecting its formation, the aim is to find a way to develop the burning process in engines and increase its working and decrease the pollution produced.