A novel Web text mining method using the discrete cosine transform

Laurence A.F. Park; Marimuthu Palaniswami; Kotagiri Ramamohanarao

doi:10.1007/3-540-45681-3_32

A novel Web text mining method using the discrete cosine transform

Laurence A.F. Park, Marimuthu Palaniswami, Kotagiri Ramamohanarao

University of Melbourne

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

11 Citations (Scopus)

Abstract

Fourier Domain Scoring (FDS) has been shown to give a 60% improvement in precision over the existing vector space methods, but its index requires a large storage space. We propose a new Web text mining method using the discrete cosine transform (DCT) to extract useful information from text documents and to provide improved document ranking, without having to store excessive data. While the new method preserves the performance of the FDS method, it gives a 40% improvement in precision over the established text mining methods when using only 20% of the storage space required by FDS.

Original language	English
Title of host publication	Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings
Editors	Tapio Elomaa, Heikki Mannila, Hannu Toivonen
Publisher	Springer Verlag
Pages	385-397
Number of pages	13
ISBN (Print)	3540440372, 9783540440376
DOIs	https://doi.org/10.1007/3-540-45681-3_32
Publication status	Published - 2002
Externally published	Yes
Event	6th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2002 - Helsinki, Finland Duration: 19 Aug 2002 → 23 Aug 2002

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	2431 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	6th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2002
Country/Territory	Finland
City	Helsinki
Period	19/08/02 → 23/08/02

Access to Document

10.1007/3-540-45681-3_32

Cite this

Park, L. A. F., Palaniswami, M., & Ramamohanarao, K. (2002). A novel Web text mining method using the discrete cosine transform. In T. Elomaa, H. Mannila, & H. Toivonen (Eds.), Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings (pp. 385-397). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2431 LNAI). Springer Verlag. https://doi.org/10.1007/3-540-45681-3_32

Park, Laurence A.F. ; Palaniswami, Marimuthu ; Ramamohanarao, Kotagiri. / A novel Web text mining method using the discrete cosine transform. Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings. editor / Tapio Elomaa ; Heikki Mannila ; Hannu Toivonen. Springer Verlag, 2002. pp. 385-397 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{32303e8593344c039aa5ebed485f8964,

title = "A novel Web text mining method using the discrete cosine transform",

abstract = "Fourier Domain Scoring (FDS) has been shown to give a 60% improvement in precision over the existing vector space methods, but its index requires a large storage space. We propose a new Web text mining method using the discrete cosine transform (DCT) to extract useful information from text documents and to provide improved document ranking, without having to store excessive data. While the new method preserves the performance of the FDS method, it gives a 40% improvement in precision over the established text mining methods when using only 20% of the storage space required by FDS.",

author = "Park, {Laurence A.F.} and Marimuthu Palaniswami and Kotagiri Ramamohanarao",

year = "2002",

doi = "10.1007/3-540-45681-3_32",

language = "English",

isbn = "3540440372",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "385--397",

editor = "Tapio Elomaa and Heikki Mannila and Hannu Toivonen",

booktitle = "Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings",

note = "6th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2002 ; Conference date: 19-08-2002 Through 23-08-2002",

}

Park, LAF, Palaniswami, M & Ramamohanarao, K 2002, A novel Web text mining method using the discrete cosine transform. in T Elomaa, H Mannila & H Toivonen (eds), Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 2431 LNAI, Springer Verlag, pp. 385-397, 6th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2002, Helsinki, Finland, 19/08/02. https://doi.org/10.1007/3-540-45681-3_32

A novel Web text mining method using the discrete cosine transform. / Park, Laurence A.F.; Palaniswami, Marimuthu; Ramamohanarao, Kotagiri.
Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings. ed. / Tapio Elomaa; Heikki Mannila; Hannu Toivonen. Springer Verlag, 2002. p. 385-397 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 2431 LNAI).

Research output: Chapter in Book / Conference Paper › Conference Paper › peer-review

TY - GEN

T1 - A novel Web text mining method using the discrete cosine transform

AU - Park, Laurence A.F.

AU - Palaniswami, Marimuthu

AU - Ramamohanarao, Kotagiri

PY - 2002

Y1 - 2002

N2 - Fourier Domain Scoring (FDS) has been shown to give a 60% improvement in precision over the existing vector space methods, but its index requires a large storage space. We propose a new Web text mining method using the discrete cosine transform (DCT) to extract useful information from text documents and to provide improved document ranking, without having to store excessive data. While the new method preserves the performance of the FDS method, it gives a 40% improvement in precision over the established text mining methods when using only 20% of the storage space required by FDS.

AB - Fourier Domain Scoring (FDS) has been shown to give a 60% improvement in precision over the existing vector space methods, but its index requires a large storage space. We propose a new Web text mining method using the discrete cosine transform (DCT) to extract useful information from text documents and to provide improved document ranking, without having to store excessive data. While the new method preserves the performance of the FDS method, it gives a 40% improvement in precision over the established text mining methods when using only 20% of the storage space required by FDS.

UR - http://www.scopus.com/inward/record.url?scp=84864834795&partnerID=8YFLogxK

U2 - 10.1007/3-540-45681-3_32

DO - 10.1007/3-540-45681-3_32

M3 - Conference Paper

AN - SCOPUS:84864834795

SN - 3540440372

SN - 9783540440376

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 385

EP - 397

BT - Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings

A2 - Elomaa, Tapio

A2 - Mannila, Heikki

A2 - Toivonen, Hannu

PB - Springer Verlag

T2 - 6th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2002

Y2 - 19 August 2002 through 23 August 2002

ER -

Park LAF, Palaniswami M, Ramamohanarao K. A novel Web text mining method using the discrete cosine transform. In Elomaa T, Mannila H, Toivonen H, editors, Principles of Data Mining and Knowledge Discovery - 6th European Conference, PKDD 2002, Proceedings. Springer Verlag. 2002. p. 385-397. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/3-540-45681-3_32

A novel Web text mining method using the discrete cosine transform

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this