KIT | KIT-Bibliothek | Impressum | Datenschutz

Working in Detail: How LSTM Hyperparameter Selection Influences Sentiment Analysis Results

Derra, Nicholas Daniel; Baier, Daniel

Abstract:

Sentiment analysis of written customer reviews is a powerful way to generate knowledge about customer attitudes for future marketing activities. Meanwhile, Deep Learning as the most powerful machine learning method is of particular importance for sentiment analysis tasks. Due to this current relevance, an LSTM network based on a literature review to solve the challenging classification task of the IMDB LargeMovie Dataset is created. Hyperparameters are varied separately from each other to better understand their single influences on the overall model accuracy. Furthermore, we transformed variants with positive impacts into a final model in order to investigate whether the impacts can be cumulated. While preparing the amount of training data and the number of iteration steps resulted in a higher accuracy, pre-trained word vectors and higher network capacity did not work well separately. Even though implementing the variants with positive influences together raised the model´s performance, the improvement was lower than some single variants.


Verlagsausgabe §
DOI: 10.5445/KSP/1000098011/10
Veröffentlicht am 16.07.2020
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Wirtschaftsinformatik und Marketing (IISM)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2020
Sprache Englisch
Identifikator ISSN: 2363-9881
KITopen-ID: 1000121378
Erschienen in Archives of Data Science, Series A
Band 6
Heft 1
Seiten P10, 22 S. online
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page