LANDER:Bottleneck traces-20041202 From Predict README version: 13668, last modified: 2023-01-9. This file describes the trace dataset "Bottleneck_traces-20041202" provided by the LANDER project. Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Data Format • 4 Citation • 5 Results Using This Dataset • 6 User Annotations • 6.1 Short data file LANDER Metadata ┌───────────────────────────┬────────────────────────────────────────────────────────────────────────────────────┐ │ dataSetName │ Bottleneck_traces-20041202 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ status │ usc-web-and-predict │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ shortDesc │ bottleneck trace at USC Internet2 link │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ longDesc │ This trace set contains 24 trace pairs gathered on Dec. 2nd, 2004. A pair of │ │ │ traces was gathered every hour for 24 hours. Each trace pair has two traces in │ │ │ Endace DAG format. The first one is a 5-minute long trace with no Iperf bottleneck │ │ │ flow inside (named by ***_background_dag). The second one was gathered shortly │ │ │ after the first one, and contains a 5-minute long trace with an Iperf TCP flow │ │ │ going through a known 100Mbps bottleneck (named by ***_bottleneck_dag). The Iperf │ │ │ TCP flow is from 164.136.245.16:37111 to 200.116.161.92:5001. (Both of these │ │ │ addresses are anonymized.). Both traces contain all packet headers traversing the │ │ │ monitored link in one direction in the corresponding time period. │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ datasetClass │ Restricted │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ commercialAllowed │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ requestReviewRequired │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ productReviewRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ ongoingMeasurement │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ submissionMethod │ Upload │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartDate │ 2004-12-02 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartTime │ 00:56:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndDate │ 2004-12-02 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndTime │ 23:06:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartDate │ 2012-01-27 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartTime │ 17:04:38 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndDate │ 2030-01-01 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ anonymization │ cryptopan/full │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ archivingAllowed │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ keywords │ category:ip-packet-headers, subcategory:ip-packet-headers, packet-header, │ │ │ bottleneck, one-time │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ format │ dag │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ access │ https │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ hostName │ USC-LANDER │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ providerName │ USC │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingId │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingSummaryFlag │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ retrievalInstructions │ download │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ byteSize │ 19920846848 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ expirationDays │ 14 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ uncompressedSize │ 50460475028 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ impactDoi │ 10.23721/109/1353560 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ useAgreement │ dua-ni-160816 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ irbRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ privateAccessInstructions │ See https://ant.isi.edu/datasets/#getting-datasets for information on obtaining │ │ │ this dataset. │ │ │ See │ └───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents Bottleneck_traces-20041202.README.txt          copy of this README DVD_1/     D12_02T00_56_background_dag.gz D12_02T00_56_bottleneck_dag.gz     see description below     D12_02T01_56_background_dag.gz D12_02T01_56_bottleneck_dag.gz     D12_02T02_56_background_dag.gz D12_02T02_56_bottleneck_dag.gz     D12_02T03_56_background_dag.gz D12_02T03_56_bottleneck_dag.gz     D12_02T04_56_background_dag.gz D12_02T04_56_bottleneck_dag.gz     D12_02T05_56_background_dag.gz D12_02T05_56_bottleneck_dag.gz     D12_02T06_56_background_dag.gz D12_02T06_56_bottleneck_dag.gz     D12_02T07_56_background_dag.gz D12_02T07_56_bottleneck_dag.gz     D12_02T08_56_background_dag.gz D12_02T08_56_bottleneck_dag.gz     .sha1sum     SHA-1 checksum DVD_2/     D12_02T09_56_background_dag.gz D12_02T09_56_bottleneck_dag.gz     D12_02T10_56_background_dag.gz D12_02T10_56_bottleneck_dag.gz     D12_02T11_56_background_dag.gz D12_02T11_56_bottleneck_dag.gz     D12_02T12_56_background_dag.gz D12_02T12_56_bottleneck_dag.gz     D12_02T13_56_background_dag.gz D12_02T13_56_bottleneck_dag.gz     D12_02T14_56_background_dag.gz D12_02T14_56_bottleneck_dag.gz     .sha1sum     SHA-1 checksum DVD_3/     D12_02T15_56_background_dag.gz D12_02T15_56_bottleneck_dag.gz     D12_02T16_56_background_dag.gz D12_02T16_56_bottleneck_dag.gz     D12_02T17_56_background_dag.gz D12_02T17_56_bottleneck_dag.gz     D12_02T18_56_background_dag.gz D12_02T18_56_bottleneck_dag.gz     D12_02T19_56_background_dag.gz D12_02T19_56_bottleneck_dag.gz     .sha1sum     SHA-1 checksum DVD_4/     D12_02T20_56_background_dag.gz D12_02T20_56_bottleneck_dag.gz     D12_02T21_56_background_dag.gz D12_02T21_56_bottleneck_dag.gz     D12_02T22_56_background_dag.gz D12_02T22_56_bottleneck_dag.gz     D12_02T23_56_background_dag.gz D12_02T23_56_bottleneck_dag.gz     .sha1sum     SHA-1 checksum Data Format All data files are in Endace DAG format, five minutes long, compressed with GZIP. IP addresses were fully anonymized. ┌────────────────────────────────┬───────────────────────────────────────────────────────────────────────────────┐ │ D12_02Txx_56_background_dag.gz │ traces gathered around time xx o'clock (xx varies from 00 to 24). │ ├────────────────────────────────┼───────────────────────────────────────────────────────────────────────────────┤ │ D12_02Txx_56_bottleneck_dag.gz │ traces gathered shortly │ │ │ │ │ │ after the D12_02Txx_56_background_dag trace. It contains an Iperf TCP flow │ │ │ through a known 100Mbps bottleneck. The Iperf TCP flow is from [anonymized] │ │ │ 164.136.245.16:37111 to [anonymized] 200.116.161.92:5001 and was generated by │ │ │ running the following commands: │ │ │ │ │ │iperf -s -i 1 -w 128K #at the server side │ │ │iperf -c server_address -i 1 -w 128K # at the client side. │ └────────────────────────────────┴───────────────────────────────────────────────────────────────────────────────┘ The access link where the traces were collected was running at 1Gb/s. Data was collected via an Endace DAG card with GPS-synchronized timestamps. All traces have been anonymized by running the following command dag_scrubber -c -s key_file original_dag_file > anonymized_dag_file The file ".sha1sum" contains SHA1 checksums of individual compressed files. The integrity of the distribution thus can be checked by independently calculating SHA1 sums of files and comparing them with those listed in the file. If you have the sha1sum utility installed on your system, you can do that by executing: sha1sum --check .sha1sum This has to be done before files are uncompressed. Citation If you use this trace to conduct additional research, please cite it as: Scrambled Internet Trace Measurement dataset, PREDICT ID USC-LANDER/Bottleneck_traces-20041202. Traces taken 2004-12-02 to 2004-12-03. Provided by the USC/LANDER project http://www.isi.edu/ant/lander. Results Using This Dataset Traces similar to this one have been used the following previously published work: • Xinming He, Christos Papadopoulos, John Heidemann, Urbashi Mitra, Usman Riaz, and Alefiya Hussain. Spectral Analysis of Bottleneck Traffic. USC/Computer Science Department Technical Report 05-853, May 2005. https://www.isi.edu/~johnh/PAPERS/He05a.pdf User Annotations Short data file Please note that D12_02T13_56_bottleneck_dag.gz is a bit shorter than 300 seconds (about 293 second long) because of a file corruption after 293 second (the corruption has been removed from the file). --Yuri 00:19, 8 June 2010 (UTC) Categories: • LANDER • LANDER:Datasets • Datasets