Deep LSTM-Based Transfer Learning Approach for Coherent Forecasts in Hierarchical Time Series
Open Access
- 26 June 2021
- Vol. 21 (13), 4379
- https://doi.org/10.3390/s21134379
Abstract
Hierarchical time series is a set of data sequences organized by aggregation constraints to represent many real-world applications in research and the industry. Forecasting of hierarchical time series is a challenging and time-consuming problem owing to ensuring the forecasting consistency among the hierarchy levels based on their dimensional features. The excellent empirical performance of our Deep Long Short-Term Memory (DLSTM) approach on various forecasting tasks motivated us to extend it to solve the forecasting problem through hierarchical architectures. Toward this target, we develop the DLSTM model in auto-encoder (AE) fashion and take full advantage of the hierarchical architecture for better time series forecasting. DLSTM-AE works as an alternative approach to traditional and machine learning approaches that have been used to manipulate hierarchical forecasting. However, training a DLSTM in hierarchical architectures requires updating the weight vectors for each LSTM cell, which is time-consuming and requires a large amount of data through several dimensions. Transfer learning can mitigate this problem by training first the time series at the bottom level of the hierarchy using the proposed DLSTM-AE approach. Then, we transfer the learned features to perform synchronous training for the time series of the upper levels of the hierarchy. To demonstrate the efficiency of the proposed approach, we compare its performance with existing approaches using two case studies related to the energy and tourism domains. An evaluation of all approaches was based on two criteria, namely, the forecasting accuracy and the ability to produce coherent forecasts through through the hierarchy. In both case studies, the proposed approach attained the highest accuracy results among all counterparts and produced more coherent forecasts.Keywords
Funding Information
- Deputyship for Research and Innovation, Ministry of Education, Saudi Arabia (IFT201002)
This publication has 27 references indexed in Scilit:
- A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competitionExpert Systems with Applications, 2012
- A hierarchical structure of observer-based adaptive fuzzy-neural controller for MIMO systemsFuzzy Sets and Systems, 2011
- Optimal combination forecasts for hierarchical time seriesComputational Statistics & Data Analysis, 2011
- Forecasting aggregate demand: An analytical evaluation of top-down versus bottom-up forecasting in a production planning frameworkInternational Journal of Production Economics, 2009
- Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecastingExpert Systems with Applications, 2009
- Hierarchical forecasts for Australian domestic tourismInternational Journal of Forecasting, 2009
- Modelling and forecasting Australian domestic tourismTourism Management, 2008
- Methodology for long-term prediction of time seriesNeurocomputing, 2007
- Another look at measures of forecast accuracyInternational Journal of Forecasting, 2006
- Long Short-Term MemoryNeural Computation, 1997