Building the Directed Semantic Graph for Coherent Long Text Generation

Generating long text conditionally depending on the short input text has recently attracted more and more research efforts. Most existing approaches focus more on introducing extra knowledge to supplement the short input text, but ignore the coherence issue of the generated texts. To address aforementioned research issue, this paper proposes a novel two-stage approach to generate coherent long text. Particularly, we first build a document-level path for each output text with each sentence embedding as its node, and a revised self-organising map (SOM) is proposed to cluster similar nodes of a family of document-level paths to construct the directed semantic graph. Then, three subgraph alignment methods are proposed to extract the maximum matching paths or subgraphs. These directed subgraphs are considered to well preserve extra but relevant content to the short input text, and then they are decoded by the employed pre-trained model to generate coherent long text. Extensive experiments have been performed on three real-world datasets, and the promising results demonstrate that the proposed approach is superior to the state-of-the-art approaches w.r.t. a number of evaluation criteria.

Hierarchical Heterogeneous Graph Representation Learning for Short Text Classification

Short text classification is a fundamental task in natural language processing. It is hard due to the lack of context information and labeled data in practice. In this paper, we propose a new method called SHINE, which is based on graph neural network (GNN), for short text classification. First, we model the short text dataset as a hierarchical heterogeneous graph consisting of word-level component graphs which introduce more semantic and syntactic information. Then, we dynamically learn a short document graph that facilitates effective label propagation among similar short texts. Thus, comparing with existing GNN-based methods, SHINE can better exploit interactions between nodes of the same types and capture similarities between short texts. Extensive experiments on various benchmark short text datasets show that SHINE consistently outperforms state-of-the-art methods, especially with fewer labels.

LZ1904 at SemEval-2021 Task 5: Bi-LSTM-CRF for Toxic Span Detection using Pretrained Word Embedding

Recurrent Neural Networks (RNN) have been widely used in various Natural Language Processing (NLP) tasks such as text classification, sequence tagging, and machine translation. Long Short Term Memory (LSTM), a special unit of RNN, has the benefit of memorizing past and even future information in a sentence (especially for bidirectional LSTM). In the shared task of detecting spans which make texts toxic, we first apply pretrained word embedding (GloVe) to generate the word vectors after tokenization. And then we construct Bidirectional Long Short Term Memory-Conditional Random Field (Bi-LSTM-CRF) model by Baidu research to predict whether each word in the sentence is toxic or not. We tune hyperparameters of dropout rate, number of LSTM units, embedding size with 10 epochs and choose the best epoch with validation recall. Our model achieves an F1 score of 66.99 percent in test dataset.

SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense

SemEval 2021 Task 7, HaHackathon, was the first shared task to combine the previously separate domains of humor detection and offense detection. We collected 10,000 texts from Twitter and the Kaggle Short Jokes dataset, and had each annotated for humor and offense by 20 annotators aged 18-70. Our subtasks were binary humor detection, prediction of humor and offense ratings, and a novel controversy task: to predict if the variance in the humor ratings was higher than a specific threshold. The subtasks attracted 36-58 submissions, with most of the participants choosing to use pre-trained language models. Many of the highest performing teams also implemented additional optimization techniques, including task-adaptive training and adversarial training. The results suggest that the participating systems are well suited to humor detection, but that humor controversy is a more challenging task. We discuss which models excel in this task, which auxiliary techniques boost their performance, and analyze the errors which were not captured by the best systems.

Implicit Phenomena in Short-answer Scoring Data

Short-answer scoring is the task of assessing the correctness of a short text given as response to a question that can come from a variety of educational scenarios. As only content, not form, is important, the exact wording including the explicitness of an answer should not matter. However, many state-of-the-art scoring models heavily rely on lexical information, be it word embeddings in a neural network or n-grams in an SVM. Thus, the exact wording of an answer might very well make a difference. We therefore quantify to what extent implicit language phenomena occur in short answer datasets and examine the influence they have on automatic scoring performance. We find that the level of implicitness depends on the individual question, and that some phenomena are very frequent. Resolving implicit wording to explicit formulations indeed tends to improve automatic scoring performance.

Improve the rheological properties of asphalt (60-70) by adding polypropylene

Asphalt plays the role of envelope and bonding in asphalt gable, and is exposed to a range of changes that start from the stage of production of asphalt mosses to the stage of investment under the influence of traffic loads and weather factors. The aim of this research is to investigate the possibility of using polypropylene polymer to modify the properties of the asphalt binder and to increase its resistance to high temperatures and different climatic conditions by modifying the asphalt by adding polypropylene by (1, 2, 3, 4, 6, 8%) And perform traditional tests on modified asphalt samples . Using Thin film oven test RTFOT test to perform the short-term Aging on normal and modified asphalt samples, heat loss, residual Penetration and aging index, And conduct a structural composition test to determine asphalt compounds. The results of the study showed that the values of Penetration tend to decrease with the increase of the percentage of addition while the degree of Softening point. The results showed increased resistance of asphalt modified to the thermal conditions. The optimum percentage of polypropylene is 3% Loss on heat at the lowest level.

Using artificial neural networks for short term electrical load forecasting in Tartous province

A reliable and continuous supply of electrical energy is necessary for the functioning of today’s complex society. Because of the increasing consumption and the extension of existing electrical transmission networks and these power systems are operated closer and closer to their limits accordingly the possibilities of overloading, equipment failures and blackout are also increasing, furthermore, we have an additional obstacle which is that electrical energy cannot be stored efficiently, so, electrical energy should be generated only when it's needed. Due to the fact that world is facing a lack of oil reserves and the difficulties related to have alternative sources to generate electrical power, then, electrical load forecasting is considered as a crucial factor in electrical power system either from economical or technical point of view on both planning and operating levels. This research introduces a short term electrical load forecasting system by using artificial neural networks with a simulation in Matlab environment in addition to an interface for the system and all that is depending on previous load data and weather parameters in Tartous province.

The relationship between helicobacter pylori infection and short stature in children

Objective: To study the relationship of H. pylori infection with short stature in children with upper gastrointestinal endoscopy with dudenal biopsy with the clotest test on the antrum biopsy for three years from the beginning of 2011 until the end of 2013 and to study the relationship with Age and sex Methods: The complete records of all children admitted to the pediatric ward at Al- Assad University Hospital and upper gastrointestinal endoscopy was performed for the first time with a dudenal biopsy and a histological study with rapid urease test on the antrum biopsy during the years 2011-2012-2013. Patients were divided into two groups : the infected group and the non-infected group based on the clotest result. The differences in standard deviations of the lengths of the two groups were studied. The mean lengths were not studied because of the age difference between the two groups. Results: The number of patients in the study sample was 180 patients with ages from 6 months to 14 years. Median age was (6) years. The distribution was 95 (52.8%) males and 85 (47.2%) females. Weight loss, short stature and abdominal pain were the main reasons for endoscopy. The rate of helicobacter pyloi infection was 76 children from 180 and the distribution was 51.3% for males and 48.7% for females. There were no statistically significant differences in the distribution of infection by sex. H. pylori infection was higher in older ages. The age groups were (3-6 years) and 6-9 years the biggest. Weight loss and shortness of stature were more pronounced in the group of patients compared to non-infected patients, and there was a statistically significant difference in the standard deviation of lengths in children with H. pylori compared to noninfected patients. There were no significant statistical differences in weight or gender.

تحضیر و توصیف مادة لفح حراري شفافة راداریا

Modified resole resin/short silica fiber composite materials have been prepared. The resole resin was synthesized and then blended with Polyvinylbutyral (PVB) polymer with different weight ratios to reduce its brittleness. The mechanical, thermal and physical properties of Resol- PVB blends were studied to characterize these blends and select the most appropriate mixing ratio of polyvinyl butyral with resole resin, which was identified at 15 phr of polyvinyl butyral for every 100 parts of resole resin.

Association Between Daily Sleep Hours And Overweight in Women

Obesity is a widespread problem in all societies and it is accompanied with short sleep duration on the recent years especially after Media and communication has spanned, so many people will stay awake with TV and internet. For that, many researches were performed to catch evidence about the relation between short sleep duration and overweight .