Commit 9003b536 authored by Joanne Hugé's avatar Joanne Hugé

Add new measures from custom 4.19 and 5.6

Add 16h51 long 5.6-dirty packet_jitter measure
Add short 4.16-dirty cyclictest measure
Add short 4.19-dirty packet_jitter measure
parent b1f2788a
......@@ -23,17 +23,18 @@ Measures measuring the same propriety are grouped together in tables and graphs,
Uses cyclictest from the rt-tests test suite to measure wake-up latency. A real-time thread is run on CPU1, and wakes up at a regular interval (specified by the interval parameter) using clock_nanosleep. It then uses clock_gettime and computes the difference between the scheduled wake-up time and the effective wake-up time measured by clock_gettime. The command used is: cyclictest -p `prio` -a1 -t1 -n -h 200 -q -i `interval`
**Common test metadata:** Boot Parameters: isolcpus, Interval: 200us, Task priority: 99, qdisc: pfifo_fast, etf_offset: none, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation
----------------------------------------- | ------------------- | ------------------- | ------------------- | -------------------
**duration, load, ker, delta** | **wake-up latency** | **wake-up latency** | **wake-up latency** | **wake-up latency**
21h22, hackbench, 4.19, 200us (384342932) | 14.0000us | 65.0000us | 21.2779us | 2.1746us
21h22, hackbench, 4.19, 200us (384614861) | 14.0000us | 112.0000us | 19.5352us | 2.0136us
46h, hackbench, 4.19, 200us (1269804578) | 14.0000us | 72.0000us | 20.5580us | 1.9820us
24h, ssh, 4.19, 200us (303042302) | 12.0000us | 80.0000us | 15.4101us | 1.1091us
0h4, ssh, 5.6, none (1274173) | 16.0000us | 391.0000us | 94.1305us | 60.3282us
0h4, hackbench, 5.6, none (1103179) | 18.0000us | 70.0000us | 27.9461us | 2.6279us
**Common test metadata:** Boot Parameters: isolcpus, Task priority: 99, qdisc: pfifo_fast, etf_offset: none, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation
------------------------------------------------ | ------------------- | ------------------- | ------------------- | -------------------
**duration, load, ker, delta, i** | **wake-up latency** | **wake-up latency** | **wake-up latency** | **wake-up latency**
21h22, hackbench, 4.19, 200us, 200us (384342932) | 14.0000us | 65.0000us | 21.2779us | 2.1746us
21h22, hackbench, 4.19, 200us, 200us (384614861) | 14.0000us | 112.0000us | 19.5352us | 2.0136us
46h, hackbench, 4.19, 200us, 200us (1269804578) | 14.0000us | 72.0000us | 20.5580us | 1.9820us
24h, ssh, 4.19, 200us, 200us (303042302) | 12.0000us | 80.0000us | 15.4101us | 1.1091us
0h4, ssh, 5.6, none, 200us (1274173) | 16.0000us | 391.0000us | 94.1305us | 60.3282us
0h4, hackbench, 5.6, none, 200us (1103179) | 18.0000us | 70.0000us | 27.9461us | 2.6279us
0h1, hackbench, 4.19-dirty, none, 1000us (35133) | 18.0000us | 92.0000us | 39.0571us | 8.4098us
![alt text](measures/graphs/cyclictest_wake-up_latencywake-up latency.png "cyclictest_wake-up_latency Graph")
......@@ -54,16 +55,18 @@ Minimum | Maximum | Average | Standard deviation | Lost packets
An UDP packet is periodically sent from one board to another using a real time thread. The receiving board calculates the intervals between the packets it receives, and sees how much it differs from the scheduled interval.
**Common test metadata:** Linux kernel version: 4.19, Boot Parameters: isolcpus, Interval: 1000us, Task priority: 99, Device and processor load: ssh, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation | Lost packets
-------------------------------------- | ----------- | ---------- | ---------- | ------------------ | ------------
**delta, duration, qdisc, etf_offset** | **jitter** | **jitter** | **jitter** | **jitter** |
160us, 0h56, etf, 600us (3393011) | -229.0000us | 204.0000us | 18.6086us | 23.8092us | 0
300us, 2h17, etf, 600us (8240231) | -255.0000us | 175.0000us | 11.1936us | 13.4745us | 0
none, 0h51, pfifo_fast, none (3077562) | -324.0000us | 162.0000us | 8.5575us | 13.0667us | 0
160us, 0h59, etf, 600us (3565860) | -172.0000us | 144.0000us | 10.6586us | 13.4834us | 0
160us, 16h18, etf, 500us (58719959) | -198.0000us | 182.0000us | 10.5478us | 13.0301us | 7
**Common test metadata:** Boot Parameters: isolcpus, Interval: 1000us, Task priority: 99, Device and processor load: ssh, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation | Lost packets
------------------------------------------- | ----------- | ---------- | ---------- | ------------------ | ------------
**delta, duration, qdisc, etf_offset, ker** | **jitter** | **jitter** | **jitter** | **jitter** |
160us, 0h56, etf, 600us, 4.19 (3393011) | -229.0000us | 204.0000us | 18.6086us | 23.8092us | 0
300us, 2h17, etf, 600us, 4.19 (8240231) | -255.0000us | 175.0000us | 11.1936us | 13.4745us | 0
none, 0h51, pfifo_fast, none, 4.19 (3077562) | -324.0000us | 162.0000us | 8.5575us | 13.0667us | 0
160us, 0h59, etf, 600us, 4.19 (3565860) | -172.0000us | 144.0000us | 10.6586us | 13.4834us | 0
160us, 16h51, etf, 600us, 5.6-dirty (60200401) | -500.0000us | 483.0000us | 5.2553us | 8.1791us | 0
none, 0h6, pfifo_fast, none, 4.19-dirty (369011) | -206.0000us | 219.0000us | 5.6766us | 9.1918us | 0
160us, 16h18, etf, 500us, 4.19 (58719959) | -198.0000us | 182.0000us | 10.5478us | 13.0301us | 7
![alt text](measures/graphs/packet_jitterjitter.png "packet_jitter Graph")
......
{"measure_sets": [{"measure_type": "cyclictest_wake-up_latency", "props_names": ["wake-up latency"], "units": ["us"], "middle": 0, "props": [[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 104, 525, 95, 62, 27, 17, 7, 21, 30, 53, 104, 203, 371, 631, 1226, 2034, 2822, 3525, 3643, 3270, 2796, 2232, 1819, 1416, 1062, 829, 665, 509, 384, 285, 305, 268, 291, 289, 287, 301, 274, 261, 255, 223, 182, 154, 154, 116, 110, 96, 89, 96, 98, 81, 73, 63, 44, 40, 43, 31, 27, 27, 22, 14, 9, 7, 2, 11, 5, 4, 3, 3, 1, 1, 3, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "4.19-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "none", "prio": "99", "load": "hackbench", "duration": "0h1", "qdisc": "pfifo_fast", "etf_offset": "none", "route": "switch"}}]}
\ No newline at end of file
{"cyclictest_wake-up_latency": {"ids": [25, 26, 28, 30, 31, 32], "next_id": 33}, "packet_rtt": {"ids": [0], "next_id": 1}, "packet_jitter": {"ids": [0, 1, 2, 3, 4], "next_id": 5}, "packet_recv_timestamps": {"ids": [0], "next_id": 1}}
{"cyclictest_wake-up_latency": {"ids": [25, 26, 28, 30, 31, 32, 33], "next_id": 34}, "packet_rtt": {"ids": [0], "next_id": 1}, "packet_jitter": {"ids": [0, 1, 2, 3, 4, 5, 6], "next_id": 7}, "packet_recv_timestamps": {"ids": [0], "next_id": 1}}
\ No newline at end of file
{"measure_sets": [{"measure_type": "packet_jitter", "props_names": ["jitter"], "units": ["us"], "middle": 500, "props": [[1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 0, 0, 1, 1, 2, 0, 0, 1, 1, 0, 1, 1, 1, 1, 0, 3, 0, 1, 0, 2, 0, 0, 0, 2, 0, 0, 1, 2, 0, 0, 1, 1, 0, 2, 0, 1, 0, 1, 1, 0, 1, 1, 3, 1, 1, 1, 0, 0, 2, 1, 0, 0, 1, 4, 1, 1, 1, 0, 3, 1, 3, 1, 2, 1, 5, 2, 5, 2, 5, 0, 0, 3, 2, 2, 2, 2, 3, 3, 2, 4, 1, 0, 4, 1, 5, 3, 4, 4, 6, 4, 0, 3, 4, 4, 1, 4, 3, 2, 3, 6, 1, 4, 6, 3, 4, 0, 1, 9, 3, 4, 5, 2, 5, 6, 7, 5, 3, 5, 4, 6, 1, 2, 6, 4, 7, 8, 6, 4, 4, 9, 0, 5, 7, 4, 5, 1, 4, 4, 5, 5, 0, 2, 3, 1, 4, 6, 3, 3, 2, 5, 0, 0, 0, 0, 2, 3, 5, 1, 3, 4, 4, 2, 2, 4, 4, 1, 1, 5, 4, 3, 4, 0, 3, 4, 1, 5, 1, 6, 1, 6, 4, 2, 1, 3, 4, 3, 4, 4, 9, 3, 6, 5, 2, 8, 5, 10, 3, 6, 7, 3, 7, 8, 6, 6, 5, 5, 4, 9, 3, 14, 2, 2, 2, 8, 14, 7, 7, 10, 9, 12, 12, 10, 8, 9, 8, 9, 6, 11, 8, 11, 11, 8, 11, 21, 9, 13, 11, 18, 18, 18, 23, 23, 19, 27, 25, 25, 30, 27, 33, 26, 23, 38, 27, 21, 17, 29, 26, 34, 36, 33, 39, 23, 34, 38, 35, 35, 36, 37, 34, 27, 29, 31, 40, 31, 35, 31, 37, 30, 36, 33, 27, 34, 40, 29, 38, 24, 29, 35, 22, 27, 40, 30, 25, 34, 32, 27, 35, 33, 31, 33, 34, 40, 31, 46, 31, 39, 40, 36, 48, 39, 39, 31, 40, 55, 42, 30, 33, 44, 33, 42, 40, 38, 50, 45, 34, 55, 43, 43, 41, 50, 58, 61, 59, 64, 75, 84, 80, 82, 97, 124, 112, 105, 113, 134, 142, 142, 144, 154, 158, 189, 191, 194, 208, 200, 230, 227, 247, 276, 273, 337, 304, 347, 305, 317, 367, 334, 344, 331, 321, 323, 316, 319, 291, 295, 304, 308, 304, 249, 300, 255, 266, 223, 194, 231, 174, 208, 178, 202, 169, 191, 176, 182, 186, 186, 167, 182, 177, 161, 194, 160, 171, 177, 178, 144, 124, 142, 131, 131, 135, 146, 165, 150, 156, 172, 188, 186, 244, 242, 322, 325, 386, 472, 541, 680, 806, 984, 1223, 1430, 1689, 1931, 2055, 2193, 2130, 1982, 1720, 1443, 1176, 1033, 880, 806, 711, 733, 649, 654, 659, 700, 739, 916, 1076, 1250, 1420, 1721, 2127, 2547, 3148, 4008, 4585, 5678, 6827, 7885, 9334, 11032, 12791, 14778, 17538, 20996, 24465, 29154, 35274, 44260, 57443, 76625, 105669, 145093, 203549, 286448, 393784, 527036, 691725, 891558, 1110346, 1311678, 1552307, 1883730, 2307989, 2822007, 3445042, 4176829, 4831205, 4968708, 4568045, 3828434, 3069307, 2491506, 2123145, 1903779, 1753643, 1575350, 1371339, 1147291, 917313, 710551, 543825, 422588, 335908, 259848, 201349, 151855, 114622, 87032, 67137, 53851, 45518, 39227, 35333, 31733, 28127, 24247, 21242, 18664, 16648, 14415, 12765, 10800, 9179, 7322, 5828, 4623, 3847, 3137, 2665, 2310, 1898, 1688, 1392, 1211, 1091, 1005, 892, 838, 862, 899, 890, 1047, 1086, 1222, 1294, 1625, 1700, 1904, 2049, 1901, 1827, 1753, 1569, 1312, 1100, 919, 690, 646, 506, 422, 313, 311, 257, 261, 192, 203, 194, 188, 183, 181, 174, 192, 186, 173, 166, 175, 177, 169, 201, 176, 194, 177, 166, 191, 174, 194, 161, 179, 174, 182, 161, 161, 148, 169, 159, 166, 156, 134, 167, 190, 156, 206, 204, 213, 248, 207, 271, 275, 325, 322, 334, 311, 318, 348, 336, 328, 330, 333, 340, 327, 344, 320, 285, 277, 274, 255, 230, 256, 219, 209, 179, 189, 181, 155, 175, 139, 119, 135, 114, 110, 96, 88, 85, 79, 82, 77, 78, 81, 68, 67, 60, 51, 64, 42, 53, 52, 60, 49, 51, 58, 34, 43, 51, 40, 46, 60, 48, 54, 59, 61, 40, 49, 50, 65, 68, 85, 65, 88, 79, 94, 108, 103, 110, 96, 99, 93, 126, 92, 94, 100, 88, 84, 66, 60, 72, 65, 51, 44, 43, 30, 35, 32, 45, 39, 30, 37, 19, 33, 33, 33, 30, 29, 31, 31, 19, 25, 33, 18, 27, 31, 40, 22, 26, 31, 37, 40, 22, 23, 39, 27, 31, 34, 30, 28, 32, 21, 27, 39, 40, 28, 29, 28, 26, 30, 20, 31, 27, 30, 19, 24, 30, 17, 29, 23, 14, 26, 13, 19, 17, 14, 19, 15, 11, 12, 8, 11, 15, 5, 10, 12, 4, 7, 10, 5, 4, 10, 4, 8, 4, 4, 3, 8, 3, 4, 3, 4, 9, 3, 6, 3, 5, 5, 4, 7, 3, 4, 10, 8, 4, 2, 4, 3, 4, 1, 4, 2, 3, 3, 3, 4, 3, 7, 0, 2, 0, 4, 1, 0, 1, 1, 2, 3, 0, 1, 2, 0, 1, 0, 0, 0, 1, 0, 0, 0, 2, 4, 1, 3, 0, 4, 4, 1, 4, 0, 0, 1, 3, 1, 3, 1, 1, 2, 3, 1, 3, 3, 1, 3, 0, 0, 1, 0, 3, 0, 1, 2, 0, 0, 2, 0, 2, 0, 1, 0, 1, 1, 0, 1, 1, 3, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 2, 0, 0, 1, 1, 2, 1, 3, 1, 0, 1, 1, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "5.6-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "160us", "prio": "99", "load": "ssh", "duration": "16h51", "qdisc": "etf", "etf_offset": "600us", "route": "switch", "lost_packets": "0"}}]}
\ No newline at end of file
{"measure_sets": [{"measure_type": "packet_jitter", "props_names": ["jitter"], "units": ["us"], "middle": 206, "props": [[1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 2, 1, 0, 0, 1, 1, 1, 3, 0, 0, 0, 0, 3, 3, 2, 1, 3, 1, 2, 1, 6, 1, 2, 0, 4, 2, 2, 2, 3, 3, 3, 2, 4, 3, 2, 2, 3, 3, 4, 3, 3, 1, 2, 2, 2, 0, 6, 3, 3, 3, 2, 2, 2, 1, 7, 5, 3, 3, 4, 3, 3, 1, 4, 5, 3, 3, 7, 4, 5, 4, 5, 6, 4, 4, 8, 1, 0, 2, 4, 4, 6, 2, 4, 4, 6, 3, 3, 1, 5, 9, 0, 7, 12, 11, 22, 11, 27, 27, 31, 37, 52, 65, 71, 82, 87, 116, 139, 143, 146, 145, 145, 122, 119, 97, 82, 88, 103, 110, 143, 169, 238, 259, 457, 515, 670, 869, 1193, 1586, 2231, 3105, 3969, 4990, 5879, 6601, 7340, 7825, 9195, 11425, 15501, 21329, 28386, 34718, 36315, 32936, 25947, 17752, 11444, 7421, 5467, 5072, 5359, 6161, 6632, 6613, 6083, 5150, 3974, 2890, 2051, 1455, 1061, 863, 707, 614, 553, 464, 422, 297, 283, 308, 249, 195, 168, 142, 139, 102, 81, 94, 79, 83, 75, 95, 95, 100, 159, 153, 174, 200, 179, 159, 145, 122, 83, 63, 53, 43, 45, 35, 25, 28, 26, 27, 18, 20, 10, 13, 13, 6, 7, 4, 4, 5, 4, 2, 8, 6, 6, 5, 8, 3, 7, 0, 3, 6, 3, 7, 3, 2, 5, 2, 4, 10, 4, 5, 2, 2, 6, 2, 3, 1, 1, 5, 6, 6, 2, 3, 4, 4, 3, 2, 4, 2, 3, 5, 3, 4, 3, 2, 3, 4, 3, 2, 4, 2, 0, 1, 2, 1, 1, 3, 3, 1, 2, 1, 2, 1, 0, 5, 0, 0, 1, 0, 0, 0, 1, 1, 0, 1, 0, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "4.19-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "none", "prio": "99", "load": "ssh", "duration": "0h6", "qdisc": "pfifo_fast", "etf_offset": "none", "route": "switch", "lost_packets": "0"}}]}
\ No newline at end of file
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment