Quantifying the morphosyntactic content of Brown Clusters

TY - GEN

T1 - Quantifying the morphosyntactic content of Brown Clusters

AU - Ciosici, Manuel Rafael

AU - Derczynski, Leon

AU - Assent, Ira

PY - 2019

Y1 - 2019

N2 - Brown and Exchange word clusters have long been successfully used as word representations in Natural Language Processing (NLP) systems. Their success has been attributed to their seeming ability to represent both semantic and syntactic information. Using corpora representing several language families, we test the hypothesis that Brown and Exchange word clusters are highly effective at encoding morphosyntactic information. Our experiments show that word clusters are highly capable of distinguishing Parts of Speech. We show that increases in Average Mutual Information, the clustering algorithms' optimization goal, are highly correlated with improvements in encoding of morphosyntactic information. Our results provide empirical evidence that downstream NLP systems addressing tasks dependent on morphosyntactic information can benefit from word cluster features.

AB - Brown and Exchange word clusters have long been successfully used as word representations in Natural Language Processing (NLP) systems. Their success has been attributed to their seeming ability to represent both semantic and syntactic information. Using corpora representing several language families, we test the hypothesis that Brown and Exchange word clusters are highly effective at encoding morphosyntactic information. Our experiments show that word clusters are highly capable of distinguishing Parts of Speech. We show that increases in Average Mutual Information, the clustering algorithms' optimization goal, are highly correlated with improvements in encoding of morphosyntactic information. Our results provide empirical evidence that downstream NLP systems addressing tasks dependent on morphosyntactic information can benefit from word cluster features.

UR - https://www.scopus.com/pages/publications/85085582058

M3 - Article in proceedings

SN - 978-1-950737-13-0

VL - 1

SP - 1541

EP - 1550

BT - Long and Short Papers

A2 - Burstein, Jill

A2 - Doran, Christy

A2 - Solorio, Thamar

PB - Association for Computational Linguistics

CY - Stroudsburg, PA

T2 - Annual Conference of the North American Chapter of the Association for Computational Linguistics

Y2 - 3 June 2019 through 5 June 2019

ER -