A Multiagent Approach to $Q$-Learning for Daily Stock Trading
- 29 October 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Vol. 37 (6), 864-877
- https://doi.org/10.1109/tsmca.2007.904825
Abstract
The portfolio management for trading in the stock market poses a challenging stochastic control problem of significant commercial interests to finance industry. To date, many researchers have proposed various methods to build an intelligent portfolio management system that can recommend financial decisions for daily stock trading. Many promising results have been reported from the supervised learning community on the possibility of building a profitable trading system. More recently, several studies have shown that even the problem of integrating stock price prediction results with trading strategies can be successfully addressed by applying reinforcement learning algorithms. Motivated by this, we present a new stock trading framework that attempts to further enhance the performance of reinforcement learning-based systems. The proposed approach incorporates multiple Q-learning agents, allowing them to effectively divide and conquer the stock trading problem by defining necessary roles for cooperatively carrying out stock pricing and selection decisions. Furthermore, in an attempt to address the complexity issue when considering a large amount of data to obtain long-term dependence among the stock prices, we present a representation scheme that can succinctly summarize the history of price changes. Experimental results on a Korean stock market show that the proposed trading framework outperforms those trained by other alternative approaches both in terms of profit and risk management.This publication has 11 references indexed in Scilit:
- iJADE Stock Advisor: An Intelligent Agent Based Stock Prediction System Using Hybrid RBF Recurrent NetworkIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2004
- The Penn-Lehman automated trading projectIEEE Intelligent Systems, 2003
- A multi-agent decision support system for stock tradingIEEE Network, 2002
- Learning to trade via direct reinforcementIEEE Transactions on Neural Networks, 2001
- Expert system for predicting stock market timing using a candlestick chartExpert Systems with Applications, 1999
- Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networksIEEE Transactions on Neural Networks, 1998
- Performance functions and reinforcement learning for trading systems and portfoliosJournal of Forecasting, 1998
- Financial prediction and trading strategies using neurofuzzy approachesIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1998
- Embedding technical analysis into neural network based trading systemsApplied Artificial Intelligence, 1996
- Dividend yields and expected stock returnsJournal of Financial Economics, 1988