TIMELY
Top Cited Papers
- 17 August 2015
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in ACM SIGCOMM Computer Communication Review
- Vol. 45 (4), 537-550
- https://doi.org/10.1145/2829988.2787510
Abstract
Datacenter transports aim to deliver low latency messaging together with high throughput. We show that simple packet delay, measured as round-trip times at hosts, is an effective congestion signal without the need for switch feedback. First, we show that advances in NIC hardware have made RTT measurement possible with microsecond accuracy, and that these RTTs are sufficient to estimate switch queueing. Then we describe how TIMELY can adjust transmission rates using RTT gradients to keep packet latency low while delivering high bandwidth. We implement our design in host software running over NICs with OS-bypass capabilities. We show using experiments with up to hundreds of machines on a Clos network topology that it provides excellent performance: turning on TIMELY for OS-bypass messaging over a fabric with PFC lowers 99 percentile tail latency by 9X while maintaining near line-rate throughput. Our system also outperforms DCTCP running in an optimized kernel, reducing tail latency by $13$X. To the best of our knowledge, TIMELY is the first delay-based congestion control protocol for use in the datacenter, and it achieves its results despite having an order of magnitude fewer RTT signals (due to NIC offload) than earlier delay-based schemes such as Vegas.Keywords
This publication has 30 references indexed in Scilit:
- Congestion Control for Large-Scale RDMA DeploymentsPublished by Association for Computing Machinery (ACM) ,2015
- The tail at scaleCommunications of the ACM, 2013
- Controlling Queue DelayQueue, 2012
- Revisiting TCP Congestion Control Using Delay GradientsLecture Notes in Computer Science, 2011
- CUBICACM SIGOPS Operating Systems Review, 2008
- Stability and fairness of explicit congestion control with small buffersACM SIGCOMM Computer Communication Review, 2008
- Processor Sharing Flows in the InternetLecture Notes in Computer Science, 2005
- TCP and explicit congestion notificationACM SIGCOMM Computer Communication Review, 1994
- Random early detection gateways for congestion avoidanceIEEE/ACM Transactions on Networking, 1993
- Analysis of the increase and decrease algorithms for congestion avoidance in computer networksComputer Networks and ISDN Systems, 1989