ActUp: Analyzing and Consolidating tSNE & UMAP

Publikation: Bidrag til bog/antologi/rapport/proceedingKonferencebidrag i proceedingsForskning

Abstract

tSNE and UMAP are popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. Despite their popularity, however, little work has been done to study their full span of differences. We theoretically and experimentally evaluate the space of parameters in both tSNE and UMAP and observe that a single one - the normalization - is responsible for switching between them. This, in turn, implies that a majority of the algorithmic differences can be toggled without affecting the embeddings. We discuss the implications this has on several theoretic claims behind UMAP, as well as how to reconcile them with existing tSNE interpretations. Based on our analysis, we provide a method (GDR) that combines previously incompatible techniques from tSNE and UMAP and can replicate the results of either algorithm. This allows our method to incorporate further improvements, such as an acceleration that obtains either method's outputs faster than UMAP. We release improved versions of tSNE, UMAP, and GDR that are fully plug-and-play with the traditional libraries.

OriginalsprogEngelsk
TitelProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI-23)
Antal sider8
ForlagInternational Joint Conferences on Artificial Intelligence
Publikationsdatoaug. 2023
Sider3651-3658
StatusUdgivet - aug. 2023
Begivenhed32nd International Joint Conference on Artificial Intelligence, IJCAI 2023 - Macao, Kina
Varighed: 19 aug. 202325 aug. 2023

Konference

Konference32nd International Joint Conference on Artificial Intelligence, IJCAI 2023
Land/OmrådeKina
ByMacao
Periode19/08/202325/08/2023
NavnProceedings of the International Joint Conference on Artificial Intelligence
ISSN1045-0823

Fingeraftryk

Dyk ned i forskningsemnerne om 'ActUp: Analyzing and Consolidating tSNE & UMAP'. Sammen danner de et unikt fingeraftryk.

Citationsformater