Feed-forward layers constitute two-thirds of a transformer model's parameters, yet their role in the network remains under-explored. We show that feed-forward layers in transformer-based language models operate as key-value memories, where each key c
orrelates with textual patterns in the training examples, and each value induces a distribution over the output vocabulary. Our experiments show that the learned patterns are human-interpretable, and that lower layers tend to capture shallow patterns, while upper layers learn more semantic ones. The values complement the keys' input patterns by inducing output distributions that concentrate probability mass on tokens likely to appear immediately after each pattern, particularly in the upper layers. Finally, we demonstrate that the output of a feed-forward layer is a composition of its memories, which is subsequently refined throughout the model's layers via residual connections to produce the final output distribution.
The study aims to highlight the role of digital marketing in influencing the perceived value of Egyptian Airlines customers, and the extent of differing opinions in the preference of digital marketing tools and the perceived value according to the di
fference of the carrier and the identity of the customer. The SPSS program, the study found a number of results, the most important of which are that: There is a significant correlation between the main dimensions of digital marketing and the perceived value of customers, there is a significant effect of the main dimensions of digital marketing on the perceived value of customers, there are no significant differences in the preference for digital marketing tools according to the different carrier, while That there are these differences according to the identity of the customer, there are significant differences in the perceived value of Egyptian Airlines customers according to the carrier company, and the same differences exist according to the identity of the customer across the emotional and functional value dimensions. The study recommended the necessity of: Paying attention to the dimensions of digital marketing (attraction, engagement, retention, learning, and communication), and maintaining its digital tools (website marketing, social media marketing, e-mail, and telemarketing).
This study aimed to determine the reality of scientific research in Syria compared to Arab Countries, and some developed countries, by comparing the proportion of expenditure on research and development of local output, the number of researchers and
technicians working in research and development, the number of research articles published in international journals, the number of Syrian researchers registered in the Google Scholar search engine, the number of citations to their researches, the number of researches published in Tishreen University, in addition to the number of researches registered and completed for postgraduate students at Tishreen University during the period 2008-2018, the number of Syrian researchers registered in the Researchgate research site, as well as the number of applications for patents for accreditation in the Arab Countries, the value of exports of high technology and the proportion of those exports of transformative exports; and determine the components of scientific research to be available to create added value to the Syrian Universities.
The researcher adopted the survey methodology and distributed the questionnaire to 289 members of the teaching staff at Tishreen University.
The most important result of the study was that, the participation of the Syrian Universities in attracting talent, participation in local, Arab and international conferences, seminars and workshops, providing research labs, modern computers, participation in search engines, research sites, databases and financing of external publications are effective Foundations for creating added value.
Then, some recommendations were presented that would contribute to the creation of added value, the most important of which are: increasing the percentage of expenditure on scientific research, employing researchers, encouraging researchers to publish in international journals, establishing cooperation relations with local, Arab and international research organizations and developing them.
This study deals with one of the most important and most difficult
decisions made by the administration of any company, and which
is reflected in the distribution of profits to shareholders. The aim
of this study is to identify the policies of the
distribution of profits
and their types, highlight the factors affecting these policies, and
show the influence of these factors on the market price of
company shares.
We present in this paper the neutrosophic randomized variables,
which are a generalization of the classical random variables
obtained from the application of the neutrosophic logic (a new nonclassical
logic which was founded by the American philos
opher and
mathematical Florentin Smarandache, which he introduced as a
generalization of fuzzy logic especially the intuitionistic fuzzy logic )
on classical random variables.
In this paper, we present a system design of the photovoltaic
pumping to provide electrical and economic comparison between
two different energy supply systems: the first depends on the PV
panels, and the second depending on the public grid. farm area
study in the eastern countryside of Homs with the aim to supply
water for irrigation and drinking.
In this paper, we develop spline collocation technique for the numerical solution of
general twelfth-order linear boundary value problems (BVPs). This technique based on
polynomial splines from order sixteenth as well as five collocation points at
every
subinterval of BVPs. The method developed not only approximates the solution of BVP,
but its higher order derivatives as well. We show that the spline collocation method is
existent and unique when it is applied into a test problem. Also, its global truncation error
is estimated. Moreover, the purposed spline method when applied to test problems will be
consistent and convergent from sixteenth order. Three numerical examples are given to
illustrate the applicability and efficiency of the new method. Comparisons of our results
with some other methods show that our method is very effective and successful.
In this research, we developed Auto Regressive Moving Average
(ARMA) method for simulation a Rayleigh fading channel with a
Gaussian Doppler spectrum instead of classical Doppler spectrum.
This research aimed to identify the value added and marketing efficiency of Syrian
sheep milk which it utilized in livestock products. The central region of Syria (Homs
and Hama) was selected, it has a comparative advantages of processing sheep mil
k
products, according to a questionnaire of sheep owners sample. The questionnaire
depended upon the type of breeding (resident, semi-nomadic and nomadic) in 2011.
This research talks about the value of sublime being one of the aesthetic values
which underlie aesthetics . The Galilee in one of the manifestations of fear and power -
Based on these two principles- It can be embodied in the image of the hero , B
ecause he
faces his fear ramming it , Impervious to death , This intrusion is based on the principle of
force , So is the manifestation of an individual tournament , Because the hero has a distinct
recipes , Not owned by someone else .
research depends on the selection of the Poetry models Describes the image of the
hero Which becomes solemn Through its potential Which is trying to achieve it , And
while achieved proves itself , And makes it superior to others with , And poets have
legalized the language in these selected models make it sensuous standard And
psychological And mental for al Jalil which the feeling self for a way to prove majesty .
