Aarhus University Seal / Aarhus Universitets segl

The (un)predictability of Text-Based Processing in Machine Learning Art

Research output: Contribution to book/anthology/report/proceedingConference abstract in proceedingsResearchpeer-review

Standard

The (un)predictability of Text-Based Processing in Machine Learning Art. / Soon, Winnie.

Art Machines: International Symposium on Computational Media Art Proceedings. Hong Kong : School of Creative Media City University of Hong Kong, 2019. p. 64-65 (Proceedings of Art Machines: International Symposium on Computational Media Art).

Research output: Contribution to book/anthology/report/proceedingConference abstract in proceedingsResearchpeer-review

Harvard

Soon, W 2019, The (un)predictability of Text-Based Processing in Machine Learning Art. in Art Machines: International Symposium on Computational Media Art Proceedings. School of Creative Media City University of Hong Kong, Hong Kong, Proceedings of Art Machines: International Symposium on Computational Media Art, pp. 64-65, International Symposium on Computational Media Art (ISCMA) 2019, Hong Kong, Hong Kong, 03/01/2019.

APA

Soon, W. (2019). The (un)predictability of Text-Based Processing in Machine Learning Art. In Art Machines: International Symposium on Computational Media Art Proceedings (pp. 64-65). Hong Kong: School of Creative Media City University of Hong Kong. Proceedings of Art Machines: International Symposium on Computational Media Art

CBE

Soon W. 2019. The (un)predictability of Text-Based Processing in Machine Learning Art. In Art Machines: International Symposium on Computational Media Art Proceedings. Hong Kong: School of Creative Media City University of Hong Kong. pp. 64-65. (Proceedings of Art Machines: International Symposium on Computational Media Art).

MLA

Soon, Winnie "The (un)predictability of Text-Based Processing in Machine Learning Art". Art Machines: International Symposium on Computational Media Art Proceedings. Hong Kong: School of Creative Media City University of Hong Kong. (Proceedings of Art Machines: International Symposium on Computational Media Art). 2019, 64-65.

Vancouver

Soon W. The (un)predictability of Text-Based Processing in Machine Learning Art. In Art Machines: International Symposium on Computational Media Art Proceedings. Hong Kong: School of Creative Media City University of Hong Kong. 2019. p. 64-65. (Proceedings of Art Machines: International Symposium on Computational Media Art).

Author

Soon, Winnie. / The (un)predictability of Text-Based Processing in Machine Learning Art. Art Machines: International Symposium on Computational Media Art Proceedings. Hong Kong : School of Creative Media City University of Hong Kong, 2019. pp. 64-65 (Proceedings of Art Machines: International Symposium on Computational Media Art).

Bibtex

@inbook{584ef73ac5d3407e817ab09c5099b847,
title = "The (un)predictability of Text-Based Processing in Machine Learning Art",
abstract = "This article investigates the unpredictable vector of liveness [1] within the context of machine learning art with a focus on text-based processing. It is observed that there are similarities between generative art and machine learning art as both produce unpredictable results. According to Noah Wardrip-Fruin [2], the generative art form, such as Loveletters (1952), can be considered as a system that generates unpredictable outcomes. Loveletters, allegedly the first digital literary work by computer scientist Christopher Strachey, is regarded as an ‘unpredictable manifestation’ of a system [3]. This system generates different variations of love letters, and such unpredictable manifestation is conditioned by two hidden elements: data and processes [3]. The use of random algorithms plays an important role in generative art (Turing’s random algorithm with its’ random number generator was used in Loveletters) to produce autonomous and unpredictable outcomes. However, machine learning emphasizes ‘predictive power’ [4], in which prediction is produced through feeding in a large amount of training data. Additionally, this kind of system employs predictive models and statistical algorithms to accomplish data processing and analysis. Machine Learning Art, such as text/novel generators, is claimed to be able to produce text with the similar writing style of the provided training corpus, but it also produces unpredictable text through setting different control parameters, such as number of epochs, amount of neural network layers and their hidden units, temperature and batch size. This article is the result of the experiment of an open source machine learning library called ml5.js [5], which is built on top of TensorFlow.js, a Javascript framework, for training and deploying machine learning models. ml5.js provides immediate access in the web browser to pretrained models for generating text. A Python training script employs the tensorflow library, which is used in the ml5.js environment to take in a large amount of text, and train a custom dataset as a pretrained model [6]. The study of the javascript libraries and the python script, with a specific focus on next character prediction and recurrent neural networks (RNN), unfolds the machine learning processes from data training to Long Short-Term Memory networks [7][8]. Building upon the notion of generativity [9][10][2], this article discusses the (un)predictable vector by examining the intertwining force between predictability and unpredictability that constitutes the liveness of text-based processing in machine learning art. This paper argues that the (un)predictable vector of liveness helps to build an understanding of the relation between, but not in separation, training and execution processes, as well as the resultant actions that extends the aesthetic and live experience of machine learning art. The article contributes to the border understanding of generativity and liveness in machine learning art that employs generative models.",
author = "Winnie Soon",
year = "2019",
month = "1",
language = "English",
isbn = "978-962-442-421-8",
pages = "64--65",
booktitle = "Art Machines: International Symposium on Computational Media Art Proceedings",
publisher = "School of Creative Media City University of Hong Kong",

}

RIS

TY - ABST

T1 - The (un)predictability of Text-Based Processing in Machine Learning Art

AU - Soon, Winnie

PY - 2019/1

Y1 - 2019/1

N2 - This article investigates the unpredictable vector of liveness [1] within the context of machine learning art with a focus on text-based processing. It is observed that there are similarities between generative art and machine learning art as both produce unpredictable results. According to Noah Wardrip-Fruin [2], the generative art form, such as Loveletters (1952), can be considered as a system that generates unpredictable outcomes. Loveletters, allegedly the first digital literary work by computer scientist Christopher Strachey, is regarded as an ‘unpredictable manifestation’ of a system [3]. This system generates different variations of love letters, and such unpredictable manifestation is conditioned by two hidden elements: data and processes [3]. The use of random algorithms plays an important role in generative art (Turing’s random algorithm with its’ random number generator was used in Loveletters) to produce autonomous and unpredictable outcomes. However, machine learning emphasizes ‘predictive power’ [4], in which prediction is produced through feeding in a large amount of training data. Additionally, this kind of system employs predictive models and statistical algorithms to accomplish data processing and analysis. Machine Learning Art, such as text/novel generators, is claimed to be able to produce text with the similar writing style of the provided training corpus, but it also produces unpredictable text through setting different control parameters, such as number of epochs, amount of neural network layers and their hidden units, temperature and batch size. This article is the result of the experiment of an open source machine learning library called ml5.js [5], which is built on top of TensorFlow.js, a Javascript framework, for training and deploying machine learning models. ml5.js provides immediate access in the web browser to pretrained models for generating text. A Python training script employs the tensorflow library, which is used in the ml5.js environment to take in a large amount of text, and train a custom dataset as a pretrained model [6]. The study of the javascript libraries and the python script, with a specific focus on next character prediction and recurrent neural networks (RNN), unfolds the machine learning processes from data training to Long Short-Term Memory networks [7][8]. Building upon the notion of generativity [9][10][2], this article discusses the (un)predictable vector by examining the intertwining force between predictability and unpredictability that constitutes the liveness of text-based processing in machine learning art. This paper argues that the (un)predictable vector of liveness helps to build an understanding of the relation between, but not in separation, training and execution processes, as well as the resultant actions that extends the aesthetic and live experience of machine learning art. The article contributes to the border understanding of generativity and liveness in machine learning art that employs generative models.

AB - This article investigates the unpredictable vector of liveness [1] within the context of machine learning art with a focus on text-based processing. It is observed that there are similarities between generative art and machine learning art as both produce unpredictable results. According to Noah Wardrip-Fruin [2], the generative art form, such as Loveletters (1952), can be considered as a system that generates unpredictable outcomes. Loveletters, allegedly the first digital literary work by computer scientist Christopher Strachey, is regarded as an ‘unpredictable manifestation’ of a system [3]. This system generates different variations of love letters, and such unpredictable manifestation is conditioned by two hidden elements: data and processes [3]. The use of random algorithms plays an important role in generative art (Turing’s random algorithm with its’ random number generator was used in Loveletters) to produce autonomous and unpredictable outcomes. However, machine learning emphasizes ‘predictive power’ [4], in which prediction is produced through feeding in a large amount of training data. Additionally, this kind of system employs predictive models and statistical algorithms to accomplish data processing and analysis. Machine Learning Art, such as text/novel generators, is claimed to be able to produce text with the similar writing style of the provided training corpus, but it also produces unpredictable text through setting different control parameters, such as number of epochs, amount of neural network layers and their hidden units, temperature and batch size. This article is the result of the experiment of an open source machine learning library called ml5.js [5], which is built on top of TensorFlow.js, a Javascript framework, for training and deploying machine learning models. ml5.js provides immediate access in the web browser to pretrained models for generating text. A Python training script employs the tensorflow library, which is used in the ml5.js environment to take in a large amount of text, and train a custom dataset as a pretrained model [6]. The study of the javascript libraries and the python script, with a specific focus on next character prediction and recurrent neural networks (RNN), unfolds the machine learning processes from data training to Long Short-Term Memory networks [7][8]. Building upon the notion of generativity [9][10][2], this article discusses the (un)predictable vector by examining the intertwining force between predictability and unpredictability that constitutes the liveness of text-based processing in machine learning art. This paper argues that the (un)predictable vector of liveness helps to build an understanding of the relation between, but not in separation, training and execution processes, as well as the resultant actions that extends the aesthetic and live experience of machine learning art. The article contributes to the border understanding of generativity and liveness in machine learning art that employs generative models.

M3 - Conference abstract in proceedings

SN - 978-962-442-421-8

SP - 64

EP - 65

BT - Art Machines: International Symposium on Computational Media Art Proceedings

PB - School of Creative Media City University of Hong Kong

CY - Hong Kong

ER -