The use of noun phrases in information retrieval: proposing a mechanism for automatic classification

Agnaldo Lopes Martins, Renato Rocha Souza, Heliana Ribeiro De Mello

Resultado de pesquisarevisão de pares

Resumo

This paper presents a research on syntactic structures known as noun phrases (NP) being applied to increase the effectiveness and efficiency of the mechanisms for the document's classification. Our hypothesis is the fact that the NP can be used instead of single words as a semantic aggregator to reduce the number of words that will be used for the classification system without losing its semantic coverage, increasing its efficiency. The experiment divided the documents classification process in three phases: a) NP preprocessing; b) system training; and c) classification experiments. In the first step, a corpus of digitalized texts was submitted to a natural language processing platform1 in which the part-of-speech tagging was done, and them PERL scripts pertaining to the PALAVRAS package were used to extract the Noun Phrases. The preprocessing also involved the tasks of a) removing NP low meaning pre-modifiers, as quantifiers; b) identification of synonyms and corresponding substitution for common hyperonyms; and c) stemming of the relevant words contained in the NP, for similitude checking with other NPs. The first tests with the resulting documents have demonstrated its effectiveness. We have compared the structural similarity of the documents before and after the whole pre-processing steps of phase one. The texts maintained the consistency with the original and have kept the readability. The second phase involves submitting the modified documents to a SVM algorithm to identify clusters and classify the documents. The classification rules are to be established using a machine learning approach. Finally, tests will be conducted to check the effectiveness of the whole process.
Idioma originalEnglish
Título da publicação do anfitriãoKnowledge Organization in the 21st Century
Subtítulo da publicação do anfitriãoBetween Historical Patterns and Future Prospects - Proceedings of the 13th International ISKO Conference
EditoresWieslaw Babik
EditoraInternational Society for Knowledge Organization
Páginas320-326
Número de páginas7
ISBN (eletrónico)9783956500404
Estado da publicaçãoPublicado - 2014
Publicado externamenteSim
Evento13th International Conference of the International Society for Knowledge Organization - Knowledge Organization in the 21st Century: Between Historical Patterns and Future Prospects, ISKO 2014 - Krakow
Duração: 19 mai. 201422 mai. 2014

Série de publicação

NomeAdvances in Knowledge Organization
Volume14
ISSN (impresso)0938-5495

Conferência

Conferência13th International Conference of the International Society for Knowledge Organization - Knowledge Organization in the 21st Century: Between Historical Patterns and Future Prospects, ISKO 2014
País/TerritórioPoland
CidadeKrakow
Período19/05/1422/05/14

Impressão digital

Mergulhe nos tópicos de investigação de “The use of noun phrases in information retrieval: proposing a mechanism for automatic classification“. Em conjunto formam uma impressão digital única.

Citação