20.500.12556/DKUM-61990 NADZOROVANO ODKRIVANJE PREDMETA TEKSTOVNIH VSEBIN Z UPORABO SELEKCIJSKIH IN STATISTIČNIH METOD SUPERVISED TOPICS' DETECTION BASED ON FEATURE SELECTION AND STATISTICAL METHODS Cilj diplomske naloge je izdelati preprost kategorizacijski sistem, ki zna nov tekstovni dokument čim natančneje uvrstiti v naprej definirane kategorije. Ena izmed funkcionalnosti sistema je prepoznavanje jezika, ki je bilo testirano na podatkovnih korpusih dokumentov Wikipedije, Europarla in jezikovnih modelov projekta LibTextCat. Kategorizacijski sistem je bil razširjen še na prepoznavanje v naprej definiranih tematikah korpusa 20 Newsgroups in Reuters-21578. Za predstavitev dokumentov smo uporabili n-gramsko tehniko, ki smo jo kombinirali s selekcijskimi in statističnimi metodami. Dosežene rezultate smo analizirali ter dokumentirali. Podrobneje smo predstavili problematiko, lastne izkušnje, lastnosti uporabljenih metod ter obstoječe raziskave. The main goal of diploma work is to develop simple text classification system that is able to automatically classify a document into predefined categories as accurately as possible. One of the functionalities of the system is language detection that has been tested on documents of Wikipedia, Europarl and language models of project LibTextCat. Classification system has been expanded to identify predefine topics of the corpus 20 Newsgroups and Reuters-21578. For document presentation we used n-grams technique, which was combined with feature selection methods and statistical methods. The obtained results were analyzed and documented. We also present text classification problem, our experiences, features of used methods and some existing research. tekstovno kategoriziranje n-grami strojno učenje teorija informacij odmik od najpomembnejšega elementa text classification n-grams machine learning information theory out of place true true false S. Hrnčić Slovenski jezik Angleški jezik Diplomsko delo 2016-08-21 11:04:24 2016-09-16 14:14:59 2022-06-28 03:07:16 2019-07-11 10:55:29 2016 0 [Maribor 0 0000-00-00 NiDoloceno NiDoloceno NiDoloceno 0000-00-00 0000-00-00 0000-00-00 004.05:004.5(043.2) 19991318 URN:SI:UM:DK:GT5AAOMU VS_Hrncic_Saso_2016.pdf VS_Hrncic_Saso_2016.pdf 1 087986506A000E5CC992A3E222C1C702 61f7dedf0fb35831655bd9a443b1ac46f966925f35034fbf70411926bc6f5bc2 1d628523-7c0d-11eb-bb7a-00155d0001ca https://dk.um.si/Dokument.php?lang=slv&id=99968 Fakulteta za elektrotehniko, računalništvo in informatiko 0 0 0