Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization

Automatic text summarization aims to produce summaries for one or more texts using machine techniques. In this paper, we propose a novel statistical summarization system for Arabic texts. Our system uses a clustering algorithm and an adapted discriminant analysis method: mRMR (minimum redundancy and...

Full description

Bibliographic Details
Published in:Journal of King Saud University: Computer and Information Sciences
Main Authors: Houda Oufaida, Omar Nouali, Philippe Blache
Format: Article
Language:English
Published: Springer 2014-12-01
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1319157814000329
_version_ 1848652764378300416
author Houda Oufaida
Omar Nouali
Philippe Blache
author_facet Houda Oufaida
Omar Nouali
Philippe Blache
author_sort Houda Oufaida
collection DOAJ
container_title Journal of King Saud University: Computer and Information Sciences
description Automatic text summarization aims to produce summaries for one or more texts using machine techniques. In this paper, we propose a novel statistical summarization system for Arabic texts. Our system uses a clustering algorithm and an adapted discriminant analysis method: mRMR (minimum redundancy and maximum relevance) to score terms. Through mRMR analysis, terms are ranked according to their discriminant and coverage power. Second, we propose a novel sentence extraction algorithm which selects sentences with top ranked terms and maximum diversity. Our system uses minimal language-dependant processing: sentence splitting, tokenization and root extraction. Experimental results on EASC and TAC 2011 MultiLingual datasets showed that our proposed approach is competitive to the state of the art systems.
format Article
id doaj-cd1daade11da4ea19c4f13ffb28abf3f
institution Directory of Open Access Journals
issn 1319-1578
language English
publishDate 2014-12-01
publisher Springer
record_format Article
spelling doaj-cd1daade11da4ea19c4f13ffb28abf3f2025-11-02T22:01:33ZengSpringerJournal of King Saud University: Computer and Information Sciences1319-15782014-12-0126445046110.1016/j.jksuci.2014.06.008Minimum redundancy and maximum relevance for single and multi-document Arabic text summarizationHouda Oufaida0Omar Nouali1Philippe Blache2Ecole Nationale Supérieure d'Informatique (ESI), Algiers, AlgeriaResearch Center on Scientific and Technical Information (CERIST), Algiers, AlgeriaAix Marseille Université, CNRS, LPL UMR 7309, 13604 Aix en Provence, FranceAutomatic text summarization aims to produce summaries for one or more texts using machine techniques. In this paper, we propose a novel statistical summarization system for Arabic texts. Our system uses a clustering algorithm and an adapted discriminant analysis method: mRMR (minimum redundancy and maximum relevance) to score terms. Through mRMR analysis, terms are ranked according to their discriminant and coverage power. Second, we propose a novel sentence extraction algorithm which selects sentences with top ranked terms and maximum diversity. Our system uses minimal language-dependant processing: sentence splitting, tokenization and root extraction. Experimental results on EASC and TAC 2011 MultiLingual datasets showed that our proposed approach is competitive to the state of the art systems.http://www.sciencedirect.com/science/article/pii/S1319157814000329Arabic text summarizationSentence extractionmRMRMinimum redundancyMaximum relevance
spellingShingle Houda Oufaida
Omar Nouali
Philippe Blache
Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
Arabic text summarization
Sentence extraction
mRMR
Minimum redundancy
Maximum relevance
title Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
title_full Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
title_fullStr Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
title_full_unstemmed Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
title_short Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization
title_sort minimum redundancy and maximum relevance for single and multi document arabic text summarization
topic Arabic text summarization
Sentence extraction
mRMR
Minimum redundancy
Maximum relevance
url http://www.sciencedirect.com/science/article/pii/S1319157814000329
work_keys_str_mv AT houdaoufaida minimumredundancyandmaximumrelevanceforsingleandmultidocumentarabictextsummarization
AT omarnouali minimumredundancyandmaximumrelevanceforsingleandmultidocumentarabictextsummarization
AT philippeblache minimumredundancyandmaximumrelevanceforsingleandmultidocumentarabictextsummarization