External Evaluation Measures for Subspace Clustering

Research output: Contribution to book/anthology/report/proceedingArticle in proceedingsResearchpeer-review

  • Stephan Günnemann, RWTH Aachen University, Germany
  • Ines Färber, RWTH Aachen University, Germany
  • Emmanuel Müller, Karlsruhe Institute of Technology, Germany
  • Ira Assent
  • Thomas Seidl, RWTH Aachen University, Germany
  • Department of Computer Science

Knowledge discovery in databases requires not only development of novel mining techniques but also fair and comparable quality assessment based on objective evaluation measures. Especially in young research areas where no common measures are available, researchers are unable to provide a fair evaluation. Typically, publications glorify the high quality of one approach only justified by an arbitrary evaluation measure. However, such conclusions can only be drawn if the evaluation measures themselves are fully understood. In this paper, we provide the basis for systematic evaluation in the emerging research area of subspace clustering. We formalize general quality criteria for subspace clustering measures not yet addressed in the literature. We compare the existing external evaluation methods based on these criteria and pinpoint limitations. We propose a novel external evaluation measure which meets the requirements in form of quality properties. In thorough experiments we empirically show characteristic properties of evaluation measures. Overall, we provide a set of evaluation measures that fulfill the general quality criteria as recommendation for future evaluations. All measures and datasets are provided on our website and are integrated in our evaluation framework.
Original languageEnglish
Title of host publicationProceedings of the 20th ACM international conference on Information and knowledge management
Number of pages10
PublisherAssociation for Computing Machinery
Publication year2011
ISBN (print)978-1-4503-0717-8
Publication statusPublished - 2011
Event20th ACM Conference on Information and Knowledge Management. CIKM 2011 - Glasgow, United Kingdom
Duration: 24 Oct 201128 Oct 2011


Conference20th ACM Conference on Information and Knowledge Management. CIKM 2011
LandUnited Kingdom

See relations at Aarhus University Citationformats


  • CIKM 2011

    Activity: Participating in or organising an event typesParticipation in or organisation af a conference

ID: 41947540