%0 Journal Article
%T Short text similarity algorithm based on the edit distance and thesaurus
%A Niewiarowski, Artur
%J Technical Transactions
%V 2016
%R 10.4467/2353737XCT.16.149.5760
%N Fundamental Sciences Issue 1-NP 2016
%P 159-173
%K Levenshtein distance algorithm, the edit distance, thesaurus, the measure of texts similarity, plagiarism detection, text mining, Natural Language Processing, Natural Language Understanding, stemming, lemmatization
%@ 0011-4561
%D 2016
%U https://ejournals.eu/en/journal/czasopismo-techniczne/article/short-text-similarity-algorithm-based-on-the-edit-distance-and-thesaurus
%X 
	This paper proposes a method of comparing the short texts using the Levenshtein distance algorithm and thesaurus for analysing terms enclosed in texts instead of popular methods exploiting the grammatical variations glossary. The tested texts contain a variety of nouns and verbs together with grammatical or orthographical mistakes. Based on the proposed new algorithm the similarity of such texts will be estimated. The described technique is compared with methods: Cosine distances, distance Dice and Jaccard distance constructed on the term frequency method. The proposition is competitive against well-known algorithms of stemming and lemmatization.