INTERACTIVE TERM SUPERVISED TEXT DOCUMENT CLUSTERING
MetadataShow full item record
Text document clustering has broad applications in practice. For instance, a conference chair should place accepted papers into meaningful sessions. Students writing a thesis, or professors writing a proposal or planning a reading course need to organize their reference papers. Organizing documents into folders on a personal computer, or grouping emails into multiple inboxes are other instances of document clustering. Unsupervised document clustering algorithms require no user effort, but the obtained partitionings may be far from what the user intended to generate. User-supervised clustering algorithms involve the user in the clustering process and let her decide on the numb er and topics of document clusters. Generating useful clusters with minimum user effort is the main challenge in this mode. To address this challenge, we propose a user-supervised clustering algorithm, designed in three stages. First, we design a novel unsupervised clustering algorithm that can b e easily extended into a user-supervised algorithm, thanks to its double clustering approach. We evaluate its performance against state-of-the-art clustering algorithms in unsupervised mode. We also extend this algorithm into an ensemble algorithm to incorporate Wikipedia concepts in document representation. We demonstrate that the integration can improve the quality of document clusters even though representing documents by Wikipedia concepts solely, may result in inferior clusterings to bag of words representation. Second, we propose three user-supervised versions for our clusterer based on term supervision (in the form of term labeling), document supervision, and dual supervision. We then demonstrate that with a comparable amount of simulated user effort, our proposed term labeling is more effective than a baseline term selection method. Third, we propose a graphical interface to support our term-supervised clusterer in interaction with human users. We then conduct a user study to evaluate the interface and its underlying clusterer. Analyzing the participants’ opinions and comments reveals the usefulness of the proposed term-supervised clustering algorithm.
Showing items related by title, author, creator and subject.
Cockcroft, Robert; Harris, William E.; Ferguson, Annette M. N.; Huxor, Avon; Ibata, Rodrigo; Irwin, Mike J.; McConnachie, Alan W.; Woodley, Kristin A.; Chapman, Scott C.; Lewis, Geraint F.; Puzia, Thomas H. (2011-01-12)We use CFHT/MegaCam data to search for outer halo star clusters in M33 as part of the Pan-Andromeda Archaeological Survey (PAndAS). This work extends previous studies out to a projected radius of 50 kpc and covers over 40 ...
Star Formation Rate Indicators in the FIRE simulations & SPT2349-56: A Massive and Active Proto-cluster Core Miller, TimothyPart 1) The star formation rate (SFR) is an important diagnostic of the evolutionary stage of the galaxy. The total infrared (IR) luminosity of a galaxy is a commonly used tracer of SFR. A simple radiative transfer model ...
Odebode, AfeesAvailability of large temporal data enabled by improved collection tools and storage devices has posed a new set of challenges in data mining, especially in the area of clustering data into different groups according to ...