Commit 9003b536 authored by Joanne Hugé's avatar Joanne Hugé

Add new measures from custom 4.19 and 5.6

Add 16h51 long 5.6-dirty packet_jitter measure
Add short 4.16-dirty cyclictest measure
Add short 4.19-dirty packet_jitter measure
parent b1f2788a
...@@ -23,17 +23,18 @@ Measures measuring the same propriety are grouped together in tables and graphs, ...@@ -23,17 +23,18 @@ Measures measuring the same propriety are grouped together in tables and graphs,
Uses cyclictest from the rt-tests test suite to measure wake-up latency. A real-time thread is run on CPU1, and wakes up at a regular interval (specified by the interval parameter) using clock_nanosleep. It then uses clock_gettime and computes the difference between the scheduled wake-up time and the effective wake-up time measured by clock_gettime. The command used is: cyclictest -p `prio` -a1 -t1 -n -h 200 -q -i `interval` Uses cyclictest from the rt-tests test suite to measure wake-up latency. A real-time thread is run on CPU1, and wakes up at a regular interval (specified by the interval parameter) using clock_nanosleep. It then uses clock_gettime and computes the difference between the scheduled wake-up time and the effective wake-up time measured by clock_gettime. The command used is: cyclictest -p `prio` -a1 -t1 -n -h 200 -q -i `interval`
**Common test metadata:** Boot Parameters: isolcpus, Interval: 200us, Task priority: 99, qdisc: pfifo_fast, etf_offset: none, route: switch **Common test metadata:** Boot Parameters: isolcpus, Task priority: 99, qdisc: pfifo_fast, etf_offset: none, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation Metadata | Minimum | Maximum | Average | Standard deviation
----------------------------------------- | ------------------- | ------------------- | ------------------- | ------------------- ------------------------------------------------ | ------------------- | ------------------- | ------------------- | -------------------
**duration, load, ker, delta** | **wake-up latency** | **wake-up latency** | **wake-up latency** | **wake-up latency** **duration, load, ker, delta, i** | **wake-up latency** | **wake-up latency** | **wake-up latency** | **wake-up latency**
21h22, hackbench, 4.19, 200us (384342932) | 14.0000us | 65.0000us | 21.2779us | 2.1746us 21h22, hackbench, 4.19, 200us, 200us (384342932) | 14.0000us | 65.0000us | 21.2779us | 2.1746us
21h22, hackbench, 4.19, 200us (384614861) | 14.0000us | 112.0000us | 19.5352us | 2.0136us 21h22, hackbench, 4.19, 200us, 200us (384614861) | 14.0000us | 112.0000us | 19.5352us | 2.0136us
46h, hackbench, 4.19, 200us (1269804578) | 14.0000us | 72.0000us | 20.5580us | 1.9820us 46h, hackbench, 4.19, 200us, 200us (1269804578) | 14.0000us | 72.0000us | 20.5580us | 1.9820us
24h, ssh, 4.19, 200us (303042302) | 12.0000us | 80.0000us | 15.4101us | 1.1091us 24h, ssh, 4.19, 200us, 200us (303042302) | 12.0000us | 80.0000us | 15.4101us | 1.1091us
0h4, ssh, 5.6, none (1274173) | 16.0000us | 391.0000us | 94.1305us | 60.3282us 0h4, ssh, 5.6, none, 200us (1274173) | 16.0000us | 391.0000us | 94.1305us | 60.3282us
0h4, hackbench, 5.6, none (1103179) | 18.0000us | 70.0000us | 27.9461us | 2.6279us 0h4, hackbench, 5.6, none, 200us (1103179) | 18.0000us | 70.0000us | 27.9461us | 2.6279us
0h1, hackbench, 4.19-dirty, none, 1000us (35133) | 18.0000us | 92.0000us | 39.0571us | 8.4098us
![alt text](measures/graphs/cyclictest_wake-up_latencywake-up latency.png "cyclictest_wake-up_latency Graph") ![alt text](measures/graphs/cyclictest_wake-up_latencywake-up latency.png "cyclictest_wake-up_latency Graph")
...@@ -54,16 +55,18 @@ Minimum | Maximum | Average | Standard deviation | Lost packets ...@@ -54,16 +55,18 @@ Minimum | Maximum | Average | Standard deviation | Lost packets
An UDP packet is periodically sent from one board to another using a real time thread. The receiving board calculates the intervals between the packets it receives, and sees how much it differs from the scheduled interval. An UDP packet is periodically sent from one board to another using a real time thread. The receiving board calculates the intervals between the packets it receives, and sees how much it differs from the scheduled interval.
**Common test metadata:** Linux kernel version: 4.19, Boot Parameters: isolcpus, Interval: 1000us, Task priority: 99, Device and processor load: ssh, route: switch **Common test metadata:** Boot Parameters: isolcpus, Interval: 1000us, Task priority: 99, Device and processor load: ssh, route: switch
Metadata | Minimum | Maximum | Average | Standard deviation | Lost packets Metadata | Minimum | Maximum | Average | Standard deviation | Lost packets
-------------------------------------- | ----------- | ---------- | ---------- | ------------------ | ------------ ------------------------------------------- | ----------- | ---------- | ---------- | ------------------ | ------------
**delta, duration, qdisc, etf_offset** | **jitter** | **jitter** | **jitter** | **jitter** | **delta, duration, qdisc, etf_offset, ker** | **jitter** | **jitter** | **jitter** | **jitter** |
160us, 0h56, etf, 600us (3393011) | -229.0000us | 204.0000us | 18.6086us | 23.8092us | 0 160us, 0h56, etf, 600us, 4.19 (3393011) | -229.0000us | 204.0000us | 18.6086us | 23.8092us | 0
300us, 2h17, etf, 600us (8240231) | -255.0000us | 175.0000us | 11.1936us | 13.4745us | 0 300us, 2h17, etf, 600us, 4.19 (8240231) | -255.0000us | 175.0000us | 11.1936us | 13.4745us | 0
none, 0h51, pfifo_fast, none (3077562) | -324.0000us | 162.0000us | 8.5575us | 13.0667us | 0 none, 0h51, pfifo_fast, none, 4.19 (3077562) | -324.0000us | 162.0000us | 8.5575us | 13.0667us | 0
160us, 0h59, etf, 600us (3565860) | -172.0000us | 144.0000us | 10.6586us | 13.4834us | 0 160us, 0h59, etf, 600us, 4.19 (3565860) | -172.0000us | 144.0000us | 10.6586us | 13.4834us | 0
160us, 16h18, etf, 500us (58719959) | -198.0000us | 182.0000us | 10.5478us | 13.0301us | 7 160us, 16h51, etf, 600us, 5.6-dirty (60200401) | -500.0000us | 483.0000us | 5.2553us | 8.1791us | 0
none, 0h6, pfifo_fast, none, 4.19-dirty (369011) | -206.0000us | 219.0000us | 5.6766us | 9.1918us | 0
160us, 16h18, etf, 500us, 4.19 (58719959) | -198.0000us | 182.0000us | 10.5478us | 13.0301us | 7
![alt text](measures/graphs/packet_jitterjitter.png "packet_jitter Graph") ![alt text](measures/graphs/packet_jitterjitter.png "packet_jitter Graph")
......
{"measure_sets": [{"measure_type": "cyclictest_wake-up_latency", "props_names": ["wake-up latency"], "units": ["us"], "middle": 0, "props": [[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 104, 525, 95, 62, 27, 17, 7, 21, 30, 53, 104, 203, 371, 631, 1226, 2034, 2822, 3525, 3643, 3270, 2796, 2232, 1819, 1416, 1062, 829, 665, 509, 384, 285, 305, 268, 291, 289, 287, 301, 274, 261, 255, 223, 182, 154, 154, 116, 110, 96, 89, 96, 98, 81, 73, 63, 44, 40, 43, 31, 27, 27, 22, 14, 9, 7, 2, 11, 5, 4, 3, 3, 1, 1, 3, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "4.19-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "none", "prio": "99", "load": "hackbench", "duration": "0h1", "qdisc": "pfifo_fast", "etf_offset": "none", "route": "switch"}}]}
\ No newline at end of file
{"cyclictest_wake-up_latency": {"ids": [25, 26, 28, 30, 31, 32], "next_id": 33}, "packet_rtt": {"ids": [0], "next_id": 1}, "packet_jitter": {"ids": [0, 1, 2, 3, 4], "next_id": 5}, "packet_recv_timestamps": {"ids": [0], "next_id": 1}} {"cyclictest_wake-up_latency": {"ids": [25, 26, 28, 30, 31, 32, 33], "next_id": 34}, "packet_rtt": {"ids": [0], "next_id": 1}, "packet_jitter": {"ids": [0, 1, 2, 3, 4, 5, 6], "next_id": 7}, "packet_recv_timestamps": {"ids": [0], "next_id": 1}}
\ No newline at end of file
{"measure_sets": [{"measure_type": "packet_jitter", "props_names": ["jitter"], "units": ["us"], "middle": 500, "props": [[1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 0, 0, 1, 1, 2, 0, 0, 1, 1, 0, 1, 1, 1, 1, 0, 3, 0, 1, 0, 2, 0, 0, 0, 2, 0, 0, 1, 2, 0, 0, 1, 1, 0, 2, 0, 1, 0, 1, 1, 0, 1, 1, 3, 1, 1, 1, 0, 0, 2, 1, 0, 0, 1, 4, 1, 1, 1, 0, 3, 1, 3, 1, 2, 1, 5, 2, 5, 2, 5, 0, 0, 3, 2, 2, 2, 2, 3, 3, 2, 4, 1, 0, 4, 1, 5, 3, 4, 4, 6, 4, 0, 3, 4, 4, 1, 4, 3, 2, 3, 6, 1, 4, 6, 3, 4, 0, 1, 9, 3, 4, 5, 2, 5, 6, 7, 5, 3, 5, 4, 6, 1, 2, 6, 4, 7, 8, 6, 4, 4, 9, 0, 5, 7, 4, 5, 1, 4, 4, 5, 5, 0, 2, 3, 1, 4, 6, 3, 3, 2, 5, 0, 0, 0, 0, 2, 3, 5, 1, 3, 4, 4, 2, 2, 4, 4, 1, 1, 5, 4, 3, 4, 0, 3, 4, 1, 5, 1, 6, 1, 6, 4, 2, 1, 3, 4, 3, 4, 4, 9, 3, 6, 5, 2, 8, 5, 10, 3, 6, 7, 3, 7, 8, 6, 6, 5, 5, 4, 9, 3, 14, 2, 2, 2, 8, 14, 7, 7, 10, 9, 12, 12, 10, 8, 9, 8, 9, 6, 11, 8, 11, 11, 8, 11, 21, 9, 13, 11, 18, 18, 18, 23, 23, 19, 27, 25, 25, 30, 27, 33, 26, 23, 38, 27, 21, 17, 29, 26, 34, 36, 33, 39, 23, 34, 38, 35, 35, 36, 37, 34, 27, 29, 31, 40, 31, 35, 31, 37, 30, 36, 33, 27, 34, 40, 29, 38, 24, 29, 35, 22, 27, 40, 30, 25, 34, 32, 27, 35, 33, 31, 33, 34, 40, 31, 46, 31, 39, 40, 36, 48, 39, 39, 31, 40, 55, 42, 30, 33, 44, 33, 42, 40, 38, 50, 45, 34, 55, 43, 43, 41, 50, 58, 61, 59, 64, 75, 84, 80, 82, 97, 124, 112, 105, 113, 134, 142, 142, 144, 154, 158, 189, 191, 194, 208, 200, 230, 227, 247, 276, 273, 337, 304, 347, 305, 317, 367, 334, 344, 331, 321, 323, 316, 319, 291, 295, 304, 308, 304, 249, 300, 255, 266, 223, 194, 231, 174, 208, 178, 202, 169, 191, 176, 182, 186, 186, 167, 182, 177, 161, 194, 160, 171, 177, 178, 144, 124, 142, 131, 131, 135, 146, 165, 150, 156, 172, 188, 186, 244, 242, 322, 325, 386, 472, 541, 680, 806, 984, 1223, 1430, 1689, 1931, 2055, 2193, 2130, 1982, 1720, 1443, 1176, 1033, 880, 806, 711, 733, 649, 654, 659, 700, 739, 916, 1076, 1250, 1420, 1721, 2127, 2547, 3148, 4008, 4585, 5678, 6827, 7885, 9334, 11032, 12791, 14778, 17538, 20996, 24465, 29154, 35274, 44260, 57443, 76625, 105669, 145093, 203549, 286448, 393784, 527036, 691725, 891558, 1110346, 1311678, 1552307, 1883730, 2307989, 2822007, 3445042, 4176829, 4831205, 4968708, 4568045, 3828434, 3069307, 2491506, 2123145, 1903779, 1753643, 1575350, 1371339, 1147291, 917313, 710551, 543825, 422588, 335908, 259848, 201349, 151855, 114622, 87032, 67137, 53851, 45518, 39227, 35333, 31733, 28127, 24247, 21242, 18664, 16648, 14415, 12765, 10800, 9179, 7322, 5828, 4623, 3847, 3137, 2665, 2310, 1898, 1688, 1392, 1211, 1091, 1005, 892, 838, 862, 899, 890, 1047, 1086, 1222, 1294, 1625, 1700, 1904, 2049, 1901, 1827, 1753, 1569, 1312, 1100, 919, 690, 646, 506, 422, 313, 311, 257, 261, 192, 203, 194, 188, 183, 181, 174, 192, 186, 173, 166, 175, 177, 169, 201, 176, 194, 177, 166, 191, 174, 194, 161, 179, 174, 182, 161, 161, 148, 169, 159, 166, 156, 134, 167, 190, 156, 206, 204, 213, 248, 207, 271, 275, 325, 322, 334, 311, 318, 348, 336, 328, 330, 333, 340, 327, 344, 320, 285, 277, 274, 255, 230, 256, 219, 209, 179, 189, 181, 155, 175, 139, 119, 135, 114, 110, 96, 88, 85, 79, 82, 77, 78, 81, 68, 67, 60, 51, 64, 42, 53, 52, 60, 49, 51, 58, 34, 43, 51, 40, 46, 60, 48, 54, 59, 61, 40, 49, 50, 65, 68, 85, 65, 88, 79, 94, 108, 103, 110, 96, 99, 93, 126, 92, 94, 100, 88, 84, 66, 60, 72, 65, 51, 44, 43, 30, 35, 32, 45, 39, 30, 37, 19, 33, 33, 33, 30, 29, 31, 31, 19, 25, 33, 18, 27, 31, 40, 22, 26, 31, 37, 40, 22, 23, 39, 27, 31, 34, 30, 28, 32, 21, 27, 39, 40, 28, 29, 28, 26, 30, 20, 31, 27, 30, 19, 24, 30, 17, 29, 23, 14, 26, 13, 19, 17, 14, 19, 15, 11, 12, 8, 11, 15, 5, 10, 12, 4, 7, 10, 5, 4, 10, 4, 8, 4, 4, 3, 8, 3, 4, 3, 4, 9, 3, 6, 3, 5, 5, 4, 7, 3, 4, 10, 8, 4, 2, 4, 3, 4, 1, 4, 2, 3, 3, 3, 4, 3, 7, 0, 2, 0, 4, 1, 0, 1, 1, 2, 3, 0, 1, 2, 0, 1, 0, 0, 0, 1, 0, 0, 0, 2, 4, 1, 3, 0, 4, 4, 1, 4, 0, 0, 1, 3, 1, 3, 1, 1, 2, 3, 1, 3, 3, 1, 3, 0, 0, 1, 0, 3, 0, 1, 2, 0, 0, 2, 0, 2, 0, 1, 0, 1, 1, 0, 1, 1, 3, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 2, 0, 0, 1, 1, 2, 1, 3, 1, 0, 1, 1, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "5.6-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "160us", "prio": "99", "load": "ssh", "duration": "16h51", "qdisc": "etf", "etf_offset": "600us", "route": "switch", "lost_packets": "0"}}]}
\ No newline at end of file
{"measure_sets": [{"measure_type": "packet_jitter", "props_names": ["jitter"], "units": ["us"], "middle": 206, "props": [[1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 1, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 2, 1, 0, 0, 1, 1, 1, 3, 0, 0, 0, 0, 3, 3, 2, 1, 3, 1, 2, 1, 6, 1, 2, 0, 4, 2, 2, 2, 3, 3, 3, 2, 4, 3, 2, 2, 3, 3, 4, 3, 3, 1, 2, 2, 2, 0, 6, 3, 3, 3, 2, 2, 2, 1, 7, 5, 3, 3, 4, 3, 3, 1, 4, 5, 3, 3, 7, 4, 5, 4, 5, 6, 4, 4, 8, 1, 0, 2, 4, 4, 6, 2, 4, 4, 6, 3, 3, 1, 5, 9, 0, 7, 12, 11, 22, 11, 27, 27, 31, 37, 52, 65, 71, 82, 87, 116, 139, 143, 146, 145, 145, 122, 119, 97, 82, 88, 103, 110, 143, 169, 238, 259, 457, 515, 670, 869, 1193, 1586, 2231, 3105, 3969, 4990, 5879, 6601, 7340, 7825, 9195, 11425, 15501, 21329, 28386, 34718, 36315, 32936, 25947, 17752, 11444, 7421, 5467, 5072, 5359, 6161, 6632, 6613, 6083, 5150, 3974, 2890, 2051, 1455, 1061, 863, 707, 614, 553, 464, 422, 297, 283, 308, 249, 195, 168, 142, 139, 102, 81, 94, 79, 83, 75, 95, 95, 100, 159, 153, 174, 200, 179, 159, 145, 122, 83, 63, 53, 43, 45, 35, 25, 28, 26, 27, 18, 20, 10, 13, 13, 6, 7, 4, 4, 5, 4, 2, 8, 6, 6, 5, 8, 3, 7, 0, 3, 6, 3, 7, 3, 2, 5, 2, 4, 10, 4, 5, 2, 2, 6, 2, 3, 1, 1, 5, 6, 6, 2, 3, 4, 4, 3, 2, 4, 2, 3, 5, 3, 4, 3, 2, 3, 4, 3, 2, 4, 2, 0, 1, 2, 1, 1, 3, 3, 1, 2, 1, 2, 1, 0, 5, 0, 0, 1, 0, 0, 0, 1, 1, 0, 1, 0, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]], "props_type": "histogram", "metadata": {"board": "Emerald", "ker": "4.19-dirty", "boot_p": "isolcpus", "i": "1000us", "delta": "none", "prio": "99", "load": "ssh", "duration": "0h6", "qdisc": "pfifo_fast", "etf_offset": "none", "route": "switch", "lost_packets": "0"}}]}
\ No newline at end of file
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment