Burst-level congestion control using hindsight optimization
- 7 August 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 47 (6), 979-991
- https://doi.org/10.1109/tac.2002.1008362
Abstract
We consider the burst-level congestion-control problem in a communication network with multiple traffic sources, each modeled as a fully controllable stream of fluid traffic. The controlled traffic shares a common bottleneck node with high-priority cross traffic described by a Markov-modulated fluid (MMF). Each controlled source is assumed to have a unique round-trip delay. The goal is to maximize a linear combination of the throughput, delay, traffic-loss rate, and a fairness metric at the bottleneck node. We introduce a simulation-based congestion-control scheme capable of performing effectively under rapidly varying cross traffic by making use of the provided MMF model of that variation. The control problem is posed as a finite-horizon Markov decision process, and is solved heuristically using a technique called hindsight optimization. We provide a detailed derivation of our congestion-control algorithm based on this technique. Our empirical study shows that the control scheme performs significantly better than the conventional proportional-derivative congestion-control method.Keywords
This publication has 31 references indexed in Scilit:
- Robust rate control for ABR sourcesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A rate-based flow control method for ABR service in ATM networksComputer Networks, 2000
- An analysis of a class of neural networks for solving linear programming problemsIEEE Transactions on Automatic Control, 1999
- A control-theoretic approach to the design of an explicit rate controller for ABR serviceIEEE/ACM Transactions on Networking, 1999
- Rollout Algorithms for Stochastic Scheduling ProblemsJournal of Heuristics, 1999
- Multiuser rate-based flow controlIEEE Transactions on Communications, 1998
- Service disciplines for guaranteed performance service in packet-switching networksProceedings of the IEEE, 1995
- Optimal control of arrivals to queues with delayed queue length informationIEEE Transactions on Automatic Control, 1995
- Closed-loop control with delayed informationACM SIGMETRICS Performance Evaluation Review, 1992
- Dynamic Flow Control in Store-and-Forward Computer NetworksIEEE Transactions on Communications, 1980