- Titel
- An Evaluation of a Zero-Shot Approach to Aspect-Based Sentiment Classification in Historic German Stock Market Reports
- Zitierfähige Url:
- https://nbn-resolving.org/urn:nbn:de:bsz:15-qucosa2-923776
- Konferenz
- 18th Conference on Computer Science and Intelligence Systems. Warschau, 17. – 20. Sept. 2023
- Quellenangabe
- Communication Papers of the 18th Conference on Computer Science and Intelligence Systems (ACSIS)
Herausgeber: Ganzha, Maria
Herausgeber: Maciaszek, Leszek A.
Herausgeber: Paprzycki, Marcin
Herausgeber: Ślęzak, Dominik
Titel Schriftenreihe: Annals of Computer Science and Information Systems
Bandnummer Schriftenreihe: 37
Seiten: 51-60 - Erstveröffentlichung
- 2023
- Abstract (EN)
- One critical aspect that remains in the application of state-of-the-art neural networks to text analysis in applied research is the continued requirement for manual data annotation. In computer science research, there is a strong focus on maximizing the data efficiency of fine-tuning language models. This has led to the development of zero-shot text classification methods, which promise to work effectively without requiring fine-tuning for the specific task at hand. In this paper, we conduct an in-depth analysis of aspect-based sentiment analysis in historic German stock market reports to evaluate the reliability of this promise. We present a comparison of a zero-shot approach with a meticulously fine-tuned three-step process of training and applying text classification models. This study aims to empirically assess the reliability of zero-shot text classification and provide justification for the potential benefits it offers in terms of reducing the burden of data labeling and training for analysis purposes. The findings of our study demonstrate a strong correlation between the sentiment time series generated through aspect-based sentiment analysis using the zero-shot approach and those derived from the fine-tuned supervised pipeline, validating the viability of the zero-shot approach. While the zero-shot pipeline exhibits a tendency to underestimate negative examples, the overall trend remains discernible. Additionally, a qualitative analysis of the linguistic patterns reveals no explicit error patterns. Nevertheless, we acknowledge and discuss the practical and epistemological obstacles associated with employing zero-shot algorithms in untested domains.
- Andere Ausgabe
- Link zur Erstveröffentlichung
DOI: https://doi.org/10.15439/2023F3725 - Freie Schlagwörter (EN)
- Aspect-Based Sentiment Classification
- Klassifikation (DDC)
- 006
- Verlag
- Polish Information Processing Society, Warschau
- Version / Begutachtungsstatus
- publizierte Version / Verlagsversion
- URN Qucosa
- urn:nbn:de:bsz:15-qucosa2-923776
- Veröffentlichungsdatum Qucosa
- 28.06.2024
- Dokumenttyp
- Konferenzbeitrag
- Sprache des Dokumentes
- Englisch
- Lizenz / Rechtehinweis
CC BY 4.0