Time Series & Sequence Modeling

Reasonable modeling of time or order is a challenge in many areasm such as sensor data, but also (human) behavior & language. Other examples include RNA, or behaviour sequences in recommendation and many areas more.

Publications

2023[ to top ]

Enhancing Sequential Next-Item Prediction through Modelling Non-Item Pages. Fischer, Elisabeth; Schlör, Daniel; Zehe, Albin; Hotho, Andreas. 2023.
- [ BibTeX ]
@inproceedings{fischer2023enhancing, author = {Fischer, Elisabeth and Schlör, Daniel and Zehe, Albin and Hotho, Andreas}, keywords = {author:zehe}, title = {Enhancing Sequential Next-Item Prediction through Modelling Non-Item Pages}, year = 2023 }
Higher-Order DeepTrails: Unified Approach to *Trails. Koopmann, Tobias; Pfister, Jan; Markus, André; Carolus, Astrid; Wienrich, Carolin; Hotho, Andreas. In Lernen, Wissen, Daten, Analysen (LWDA) Conference Proceedings, Marburg, Germany, October 9-11, 2023, Vol. 3630 of CEUR Workshop Proceedings, M. Leyer, J. Wichmann (eds.), pp. 372–386. CEUR-WS.org, 2023.
- [ BibTeX ]
- [ URL ]
- [ Download ]
@inproceedings{DBLP:conf/lwa/Koopmann23, author = {Koopmann, Tobias and Pfister, Jan and Markus, André and Carolus, Astrid and Wienrich, Carolin and Hotho, Andreas}, booktitle = {Lernen, Wissen, Daten, Analysen {(LWDA)} Conference Proceedings, Marburg, Germany, October 9-11, 2023}, editor = {Leyer, Michael and Wichmann, Johannes}, keywords = {author:pfister}, pages = {372–386}, publisher = {CEUR-WS.org}, series = {{CEUR} Workshop Proceedings}, title = {Higher-Order DeepTrails: Unified Approach to *Trails}, volume = 3630, year = 2023 }

2021[ to top ]

Comparison of Transformer-Based Sequential Product Recommendation Models for the Coveo Data Challenge. Fischer, Elisabeth; Zoller, Daniel; Hotho, Andreas. In SIGIR Workshop On eCommerce. 2021.
- [ BibTeX ]
- [ Download ]
@article{fischer2021comparison, author = {Fischer, Elisabeth and Zoller, Daniel and Hotho, Andreas}, journal = {SIGIR Workshop On eCommerce}, keywords = {author:hotho}, month = {07}, title = {Comparison of Transformer-Based Sequential Product Recommendation Models for the Coveo Data Challenge}, year = 2021 }
Detecting Presence Of Speech In Acoustic Data Obtained From Beehives. Janetzky, Pascal; Davidson, Padraig; Steininger, Michael; Krause, Anna; Hotho, Andreas. In DCASE Workshop. 2021.
- [ BibTeX ]
- [ Download ]
@article{janetzkydetecting, author = {Janetzky, Pascal and Davidson, Padraig and Steininger, Michael and Krause, Anna and Hotho, Andreas}, journal = {DCASE Workshop}, keywords = {from:msteininger}, title = {Detecting Presence Of Speech In Acoustic Data Obtained From Beehives}, year = 2021 }
Malware detection on windows audit logs using LSTMs. Ring, Markus; Schlör, Daniel; Wunderlich, Sarah; Landes, Dieter; Hotho, Andreas. In Computers & Security, 109, p. 102389. 2021.
- [ Abstract ]
- [ BibTeX ]
- [ URL ]
- [ Download ]
Malware is a constant threat and is continuously evolving. Security systems try to keep up with the constant change. One challenge that arises is the large amount of logs generated on an operating system and the need to clarify which information contributes to the detection of possible malware. This work aims at the detection of malware using neural networks based on Windows audit log events. Neural networks can only process continuous data, but Windows audit logs are sequential and textual data. To address these challenges, we extract features out of the audit log events and use LSTMs to capture sequential effects. We create different subsets of features and analyze the effects of additional information. Features describe for example the action-type of windows audit log events, process names or target files that are accessed. Textual features are represented either as one-hot encoding or embedding representation, for which we compare three different approaches for representation learning. Effects of different feature subsets and representations are evaluated on a publicly available data set. Results indicate that using additional information improves the performance of the LSTM-model. While different representations lead to similar classification results, analysis of the latent space shows differences more precisely where FastText seems to be the most promising representation.

@article{RING2021102389, abstract = {Malware is a constant threat and is continuously evolving. Security systems try to keep up with the constant change. One challenge that arises is the large amount of logs generated on an operating system and the need to clarify which information contributes to the detection of possible malware. This work aims at the detection of malware using neural networks based on Windows audit log events. Neural networks can only process continuous data, but Windows audit logs are sequential and textual data. To address these challenges, we extract features out of the audit log events and use LSTMs to capture sequential effects. We create different subsets of features and analyze the effects of additional information. Features describe for example the action-type of windows audit log events, process names or target files that are accessed. Textual features are represented either as one-hot encoding or embedding representation, for which we compare three different approaches for representation learning. Effects of different feature subsets and representations are evaluated on a publicly available data set. Results indicate that using additional information improves the performance of the LSTM-model. While different representations lead to similar classification results, analysis of the latent space shows differences more precisely where FastText seems to be the most promising representation.}, author = {Ring, Markus and Schlör, Daniel and Wunderlich, Sarah and Landes, Dieter and Hotho, Andreas}, journal = {Computers & Security}, keywords = {author:hotho}, pages = 102389, title = {Malware detection on windows audit logs using LSTMs}, volume = 109, year = 2021 }

2020[ to top ]

Improving Sentiment Analysis with Biofeedback Data. Schl"o}r, Daniel; Zehe, Albin; Kobs, Konstantin; Veseli, Blerta; Westermeier, Franziska; Br"u}bach, Larissa; Roth, Daniel; Latoschik, Marc Erich; Hotho, Andreas. In Proceedings of LREC2020 Workshop ``People in language, vision and the mind’’ (ONION2020), pp. 28–33. European Language Resources Association (ELRA), Marseille, France, 2020.
- [ Abstract ]
- [ BibTeX ]
- [ URL ]
- [ Download ]
Humans frequently are able to read and interpret emotions of others by directly taking verbal and non-verbal signals in human-to-human communication into account or to infer or even experience emotions from mediated stories. For computers, however, emotion recognition is a complex problem: Thoughts and feelings are the roots of many behavioural responses and they are deeply entangled with neurophysiological changes within humans. As such, emotions are very subjective, often are expressed in a subtle manner, and are highly depending on context. For example, machine learning approaches for text-based sentiment analysis often rely on incorporating sentiment lexicons or language models to capture the contextual meaning. This paper explores if and how we further can enhance sentiment analysis using biofeedback of humans which are experiencing emotions while reading texts. Specifically, we record the heart rate and brain waves of readers that are presented with short texts which have been annotated with the emotions they induce. We use these physiological signals to improve the performance of a lexicon-based sentiment classifier. We find that the combination of several biosignals can improve the ability of a text-based classifier to detect the presence of a sentiment in a text on a per-sentence level.

@inproceedings{schlor-etal-2020-improving, abstract = {Humans frequently are able to read and interpret emotions of others by directly taking verbal and non-verbal signals in human-to-human communication into account or to infer or even experience emotions from mediated stories. For computers, however, emotion recognition is a complex problem: Thoughts and feelings are the roots of many behavioural responses and they are deeply entangled with neurophysiological changes within humans. As such, emotions are very subjective, often are expressed in a subtle manner, and are highly depending on context. For example, machine learning approaches for text-based sentiment analysis often rely on incorporating sentiment lexicons or language models to capture the contextual meaning. This paper explores if and how we further can enhance sentiment analysis using biofeedback of humans which are experiencing emotions while reading texts. Specifically, we record the heart rate and brain waves of readers that are presented with short texts which have been annotated with the emotions they induce. We use these physiological signals to improve the performance of a lexicon-based sentiment classifier. We find that the combination of several biosignals can improve the ability of a text-based classifier to detect the presence of a sentiment in a text on a per-sentence level.}, address = {Marseille, France}, author = {Schl{\"o}r, Daniel and Zehe, Albin and Kobs, Konstantin and Veseli, Blerta and Westermeier, Franziska and Br{\"u}bach, Larissa and Roth, Daniel and Latoschik, Marc Erich and Hotho, Andreas}, booktitle = {Proceedings of LREC2020 Workshop ``People in language, vision and the mind'' (ONION2020)}, keywords = {author:zehe}, month = {05}, pages = {28–33}, publisher = {European Language Resources Association (ELRA)}, title = {Improving Sentiment Analysis with Biofeedback Data}, year = 2020 }
Time Series Forecasting for Self-Aware Systems. Bauer, A.; Züfle, M.; Herbst, N.; Zehe, A.; Hotho, A.; Kounev, S. In Proceedings of the IEEE, pp. 1–26. 2020.
- [ Abstract ]
- [ BibTeX ]
Modern distributed systems and Internet-of-Things applications are governed by fast living and changing requirements. Moreover, they have to struggle with huge amounts of data that they create or have to process. To improve the self-awareness of such systems and enable proactive and autonomous decisions, reliable time series forecasting methods are required. However, selecting a suitable forecasting method for a given scenario is a challenging task. According to the ``No-Free-Lunch Theorem,'' there is no general forecasting method that always performs best. Thus, manual feature engineering remains to be a mandatory expert task to avoid trial and error. Furthermore, determining the expected time-to-result of existing forecasting methods is a challenge. In this article, we extensively assess the state-of-the-art in time series forecasting. We compare existing methods and discuss the issues that have to be addressed to enable their use in a self-aware computing context. To address these issues, we present a step-by-step approach to fully automate the feature engineering and forecasting process. Then, following the principles from benchmarking, we establish a level-playing field for evaluating the accuracy and time-to-result of automated forecasting methods for a broad set of application scenarios. We provide results of a benchmarking competition to guide in selecting and appropriately using existing forecasting methods for a given self-aware computing context. Finally, we present a case study in the area of self-aware data-center resource management to exemplify the benefits of fully automated learning and reasoning processes on time series data.

@article{9069193, abstract = {Modern distributed systems and Internet-of-Things applications are governed by fast living and changing requirements. Moreover, they have to struggle with huge amounts of data that they create or have to process. To improve the self-awareness of such systems and enable proactive and autonomous decisions, reliable time series forecasting methods are required. However, selecting a suitable forecasting method for a given scenario is a challenging task. According to the ``No-Free-Lunch Theorem,'' there is no general forecasting method that always performs best. Thus, manual feature engineering remains to be a mandatory expert task to avoid trial and error. Furthermore, determining the expected time-to-result of existing forecasting methods is a challenge. In this article, we extensively assess the state-of-the-art in time series forecasting. We compare existing methods and discuss the issues that have to be addressed to enable their use in a self-aware computing context. To address these issues, we present a step-by-step approach to fully automate the feature engineering and forecasting process. Then, following the principles from benchmarking, we establish a level-playing field for evaluating the accuracy and time-to-result of automated forecasting methods for a broad set of application scenarios. We provide results of a benchmarking competition to guide in selecting and appropriately using existing forecasting methods for a given self-aware computing context. Finally, we present a case study in the area of self-aware data-center resource management to exemplify the benefits of fully automated learning and reasoning processes on time series data.}, author = {{Bauer}, A. and {Züfle}, M. and {Herbst}, N. and {Zehe}, A. and {Hotho}, A. and {Kounev}, S.}, journal = {Proceedings of the IEEE}, keywords = {author:zehe}, pages = {1-26}, title = {Time Series Forecasting for Self-Aware Systems}, year = 2020 }
Integrating Keywords into BERT4Rec for Sequential Recommendation. Fischer, Elisabeth; Zoller, Daniel; Dallmann, Alexander; Hotho, Andreas. In KI 2020: Advances in Artificial Intelligence. 2020.
- [ BibTeX ]
- [ Download ]
@inproceedings{fischer2020integrating, author = {Fischer, Elisabeth and Zoller, Daniel and Dallmann, Alexander and Hotho, Andreas}, booktitle = {KI 2020: Advances in Artificial Intelligence}, keywords = {selected}, title = {Integrating Keywords into BERT4Rec for Sequential Recommendation}, year = 2020 }

Hubland Nord

Time Series & Sequence Modeling

Publications

Data privacy protection

Data privacy protection

Picture credits