RED experiment data
On February 27, 2001, I started monitoring packet drops on our
University's Internet border router's WAN link. The Internet
link speed was 18 Mb/s on a fractional DS-3 to the UUnet pop
in Chicago. The LAN interface to the University was a
full-duplex 100 Mb/s ethernet link. The router is a Cisco
7206 running 12.0(11.6)S IOS. At that time, the WAN link was
NOT setup to do any time of active queue management nor was
it configured to do any fair scheduling.
On the evening of March 22, I enabled RED on the Internet
border router's WAN interface with the following parameters:
- random detect
- random detect precedence 0 10 40 10
- random detect precedence 1 10 40 10
- random detect precedence 2 10 40 10
- random detect precedence 3 10 40 10
- random detect precedence 4 10 40 10
- random detect precedence 5 10 40 10
- random detect precedence 6 10 40 10
- random detect precedence 7 10 40 10
- random detect precedence rsvp 10 40 10
The above configuration sets all IP packets to be treated
equally, reglardless of their ToS field settings. The
parameters are as follows:
- min_sh (minimum threshold)
When the average queue size is less than min_sh, no packets
will be marked. 10 seemed like a fairly conversative
value.
- max_th (maximum threshold)
When the average queue size is greater than this value, all
packets are marked. I also set this to a fairly conversative
value of 40. Note: the default queue size on our Internet
border router was also 40 when RED was not enabled.
- max_p (upper bound on marking probability)
As recommended by Sally Floyd, this is set to 0.1. See
RED
Parameters discussion.
During the time packet drops were being monitored, but before
RED was enabled, traffic from the University to the Internet
was consistently heavy during peak usage hours (10 a.m. to
midnight). Much of the outbound traffic was identified as
file sharing applications such as Napster. RED was enabled
just as the University's Winter quarter was ending. Therefore,
it would be a few weeks before we saw any impact with RED.
Surprising, the average traffic utilization from the University
to the Internet in the following Spring quarter was lower.
This lower average outbound utilization appears to be attributed
to the effectiveness of the mandated filtering applied by
Napster and possibly other similar services.
After an email from Sally Floyd on May 1, 2001 asking how RED
was doing for us, I started to see if I could provide her with
some worthwhile data. It just so happened that on May 2, 2001
we had begun seeing heavy outbound traffic. Interestingly,
the increase was due to a Windows machine on campus having
been compromised and was being used to distribute copyrighted
material via ftp. Before it was disabled however, I seized this
opportunity to perform some queue management comparisons
with both RED enabled and disabled. I was still watching
packet drops so along with the traffic utilization and
classification of data, the information below shows the results
with and without RED. With each of the graphs, I'll point out
where RED was enabled, disabled and the time periods of the
graphs. Outbound traffic is traffic from the University to
the Internet. This is where RED is applied on the WAN
interface.
The following graphs show historic packet drop and traffic
utilization data before RED was enabled. These graphs were saved
an hour after RED was enabled (most recent time is to the right of
the graph).
- March 22, 2001
- RED enabled at 2030 hours (far right)
- Packet drops versus traffic utilization
| Max In:
|
0.0 Drops/s
| |
Average
In: |
0.0 Drops/s
| |
Current
In: |
0.0 Drops/s |
| Max Out:
|
212.0 Drops/s
| |
Average
Out: |
39.0 Drops/s |
|
Current
Out: |
0.0 Drops/s |
| Max In:
|
18.3 Mb/s (96.7%) |
|
Average
In: |
10.2 Mb/s (53.6%) |
|
Current
In: |
8992.7 kb/s (47.5%) |
| Max Out:
|
18.9 Mb/s (99.9%) |
|
Average
Out: |
15.2 Mb/s (80.5%) |
|
Current
Out: |
13.3 Mb/s (70.3%) |
- Week of March 15 through 22, 2001
| Max In:
|
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
478.0 Drops/s |
|
Average
Out: |
116.0 Drops/s |
|
Current
Out: |
0.0 Drops/s |
| Max In: |
18.4 Mb/s (97.0%) |
|
Average
In: |
9256.6 kb/s (48.9%) |
|
Current
In: |
9470.0 kb/s (50.0%) |
| Max Out:
|
18.9 Mb/s (100.0%) |
|
Average
Out: |
16.4 Mb/s (86.6%) |
|
Current
Out: |
15.1 Mb/s (79.5%) |
- End of February through March 22, 2001
| Max In:
|
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
443.0 Drops/s |
|
Average
Out: |
89.0 Drops/s |
|
Current
Out: |
7.0 Drops/s |
| Max In:
|
18.1 Mb/s (95.5%) |
|
Average
In: |
10.3 Mb/s (54.2%) |
|
Current
In: |
10.0 Mb/s (53.0%) |
| Max Out:
|
18.9 Mb/s (100.0%) |
|
Average
Out: |
16.3 Mb/s (85.8%) |
|
Current
Out: |
16.9 Mb/s (89.1%) |
The following graphs show historic packet drop and traffic
utilization data after RED was enabled. In addition, during
the most recent period of high outbound traffic, RED was
temporarily disabled and re-enabled twice to help show the
effect it had compared to default tail drop queueing.
- May 2, 2001
- RED disabled at 1200 hours (far right)
- RED was re-enabled at 1215 hours (far right)
- RED was disabled at 1315 hours (far right)
- RED was re-enabled at 1345 hours (far right)
- Compromised FTP host shut down at 1400 hours (far right)
| Max In:
|
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
384.0 Drops/s |
|
Average
Out: |
56.0 Drops/s |
|
Current
Out: |
4.0 Drops/s |
| Max In:
|
18.6 Mb/s (98.4%) |
|
Average
In: |
11.6 Mb/s (61.2%) |
|
Current
In: |
17.6 Mb/s (93.1%) |
| Max Out:
|
18.9 Mb/s (99.8%) |
|
Average
Out: |
14.4 Mb/s (75.9%) |
|
Current
Out: |
16.5 Mb/s (87.0%) |
- Week of April 26 through May 2, 2001
| Max In:
|
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
318.0 Drops/s |
|
Average
Out: |
24.0 Drops/s |
|
Current
Out: |
3.0 Drops/s |
| Max In:
|
18.6 Mb/s (98.1%) |
|
Average
In: |
10.2 Mb/s (54.1%) |
|
Current
In: |
17.7 Mb/s (93.3%) |
| Max Out:
|
18.8 Mb/s (99.4%) |
|
Average
Out: |
13.5 Mb/s (71.3%) |
|
Current
Out: |
15.7 Mb/s (82.8%) |
- April and Beginning of May, 2001
| Max
In: |
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
180.0 Drops/s |
|
Average
Out: |
22.0 Drops/s |
|
Current
Out: |
154.0 Drops/s |
| Max In:
|
18.5 Mb/s (97.5%) |
|
Average
In: |
9152.1 kb/s (48.3%) |
|
Current
In: |
15.8 Mb/s (83.4%) |
| Max Out:
|
18.8 Mb/s (99.1%) |
|
Average
Out: |
13.8 Mb/s (72.6%) |
|
Current
Out: |
17.2 Mb/s (90.7%) |
| Max In:
|
0.0 Drops/s |
|
Average
In: |
0.0 Drops/s |
|
Current
In: |
0.0 Drops/s |
| Max Out:
|
213.0 Drops/s |
|
Average
Out: |
36.0 Drops/s |
|
Current
Out: |
5.0 Drops/s |
| Max
In: |
12.6 Mb/s (66.6%) |
|
Average
In: |
6594.0 kb/s (34.8%)
|
Current
In: |
11.3 Mb/s (59.9%) |
|
| Max Out:
|
18.6 Mb/s (98.0%) |
|
Average
Out: |
8397.7 kb/s (44.3%) |
|
Current
Out: |
13.6 Mb/s (71.8%) |
Last updated: May 2, 2001