Publication View

CUCS-004-00 Automatic Classification of Text Databases Through Query Probing (2008)

Abstract
Many text databases on the web are “hidden ” behind search interfaces, and their documents are only accessible through querying. Search engines typically ignore the contents of such search-only databases. Recently, Yahoo-like directories have started to manually organize these databases into categories that users can browse to find these valuable resources. We propose a novel strategy to automate the classification of search-only text databases. Our technique starts by training a rule-based document classifier, and then uses the classifier’s rules to generate probing queries. The queries are sent to the text databases, which are then classified based on the number of matches that they produce for each query. We report some initial exploratory experiments that show that our approach is promising to automatically characterize the contents of text databases accessible on the web. 1

Publication details
Download http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.72.7330
Source http://www.cs.columbia.edu/techreports/cucs-004-00.pdf
Contributors CiteSeerX
Repository CiteSeerX - Scientific Literature Digital Library and Search Engine (United States)
Type text
Language English
Relation 10.1.1.50.8204, 10.1.1.21.988, 10.1.1.32.9645, 10.1.1.21.7950, 10.1.1.21.478, 10.1.1.14.8578, 10.1.1.51.8029, 10.1.1.46.7753, 10.1.1.46.8535, 10.1.1.98.4787, 10.1.1.107.2635, 10.1.1.44.1877