Do you want to publish a course? Click here

Scrambled Translation Problem: A Problem of Denoising UNMT

مشكلة الترجمة المختبرة: مشكلة Denoising UNMT

496   0   0   0.0 ( 0 )
 Publication date 2021
and research's language is English
 Created by Shamra Editor




Ask ChatGPT about the research

In this paper and we identify an interesting kind of error in the output of Unsupervised Neural Machine Translation (UNMT) systems like Undreamt1. We refer to this error type as Scrambled Translation problem. We observe that UNMT models which use word shuffle noise (as in case of Undreamt) can generate correct words and but fail to stitch them together to form phrases. As a result and words of the translated sentence look scrambled and resulting in decreased BLEU. We hypothesise that the reason behind scrambled translation problem is 'shuffling noise' which is introduced in every input sentence as a denoising strategy. To test our hypothesis and we experiment by retraining UNMT models with a simple retraining strategy. We stop the training of the Denoising UNMT model after a pre-decided number of iterations and resume the training for the remaining iterations- which number is also pre-decided- using original sentence as input without adding any noise. Our proposed solution achieves significant performance improvement UNMT models that train conventionally. We demonstrate these performance gains on four language pairs and viz. and English-French and English-German and English-Spanish and Hindi-Punjabi. Our qualitative and quantitative analysis shows that the retraining strategy helps achieve better alignment as observed by attention heatmap and better phrasal translation and leading to statistically significant improvement in BLEU scores.



References used
https://aclanthology.org/
rate research

Read More

Find sheds light on the problem perhaps more importantly, the total problems that we find in the history of philosophy , and is not a problem of nature Our research is trying to explore the meaning of the nature of the Beginnings, As we will try to, In this research dealt with the nature of the problem of the two sides Systematic and cognitive To find out the key points of the nature of the problem when the philosophers of the seventeenth century To try to adjust the nature of the problem in its historical context As we will try in this research shed light on the relationship between nature and other problems In the philosophy of Hegel, such as the relationship , for example, between nature and logic, nature and absolute idea. Is Hegel was able to solve the problem of nature and its relationship with the various aspects of his philosophy؟ Or is it Al this problem and do so by him Kant There is also in our many other problems discussed by Hegel with nature problem.
We study the problem of generating arithmetic math word problems (MWPs) given a math equation that specifies the mathematical computation and a context that specifies the problem scenario. Existing approaches are prone to generating MWPs that are eit her mathematically invalid or have unsatisfactory language quality. They also either ignore the context or require manual specification of a problem template, which compromises the diversity of the generated MWPs. In this paper, we develop a novel MWP generation approach that leverages i) pre-trained language models and a context keyword selection model to improve the language quality of generated MWPs and ii) an equation consistency constraint for math equations to improve the mathematical validity of the generated MWPs. Extensive quantitative and qualitative experiments on three real-world MWP datasets demonstrate the superior performance of our approach compared to various baselines.
Live video comments, or ''danmu'', are an emerging feature on Asian online video platforms. Danmu are time-synchronous comments that are overlaid on a video playback. These comments uniquely enrich the experience and engagement of their users. These comments have become a determining factor in the popularity of the videos. Similar to the ''cold start problem'' in recommender systems, a video will only start to attract attention when sufficient danmu comments have been posted on it. We study this video cold start problem and examine how new comments can be generated automatically on less-commented videos. We propose to predict the danmu comments by exploiting a multi-modal combination of the video visual content, subtitles, audio signals, and any surrounding comments (when they exist). Our method fuses these multi-modalities in a transformer network which is then trained for different comment density scenarios. We evaluate our proposed system through both a retrieval based evaluation method, as well as human judgement. Results show that our proposed system improves significantly over state-of-the-art methods.
In this research ,we studied the problem of multicollinearity among independent variables in the multiple regression model this matter leads to a mistake in one of the essential conditions of the multiple regression model and getting incorrect res ults. At the beginning we have introduced documented theoretical study of the kinds of the multicollinearity and of the reasons of the problem of the multiple regression model and some methods to discover them. In addition to this we mentioned some methods that treat the cases of multiple regression model then we introduced a new method to treat multicollineartiy and apply it to an example . In this method we have dealt with multicollinearity on the hand and solved the problem of discrepancy between the significant of the regression model and the non-significant of one or more coefficient.
In this paper, we presents a solution for those problems by using (CAN) protocol in ATM networks due to many features such as the priority of access and lose-free bus arbitration. We designed a new application layer for using (CAN) in ATM network. Then we compared this proposal pattern with the current ATM network by using MATLAB.

suggested questions

comments
Fetching comments Fetching comments
Sign in to be able to follow your search criteria
mircosoft-partner

هل ترغب بارسال اشعارات عن اخر التحديثات في شمرا-اكاديميا