76 KiB
76 KiB
| 1 | Network model | Release | IE-Type | Platform name | Throughput-INT8 | Throughput-FP16 | Throughput-FP32 | Value | Efficiency | Price | TDP | Sockets | Price/Socket | TDP/Socket | Latency_int8 | UOM_T | UOM_V | UOM_E | UOM_L | Latency_FP16 | Latency_FP32 | Latency_int4 | Throughput_INT4 | Latency_BF16 | Throughput_BF16 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 3 | bert-base-cased | OV-2024.1 | atom | Intel® Atom® x7425E CPU-only | 10.82 | 5.46 | 0.187 | 0.902 | 58 | 12 | 1 | 58 | 12 | 96.96 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 4 | bert-base-cased | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 2.02 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 5 | bert-base-cased | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 11.72 | 4.3 | 0.11 | 0.781 | 107 | 15 | 1 | 107 | 15 | 88.3 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 6 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 21.27 | 14.81 | 0.182 | 0.327 | 117 | 65 | 1 | 117 | 65 | 49.44 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 7 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 32.41 | 21.6 | 0.151 | 0.926 | 214 | 35 | 1 | 214 | 35 | 36.5 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 8 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 119.24 | 47.44 | 0.362 | 0.954 | 329 | 125 | 1 | 329 | 125 | 13.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 9 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 33.23 | 22.4 | 0.173 | 0.511 | 192 | 65 | 1 | 192 | 65 | 31.74 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 10 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 51.45 | 18.39 | 0.121 | 1.838 | 426 | 28 | 1 | 426 | 28 | 22.87 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 11 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 38.87 | 13.63 | 0.079 | 2.591 | 490 | 15 | 1 | 490 | 15 | 28.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 12 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 82.77 | 32.83 | 0.165 | 1.839 | 502 | 45 | 1 | 502 | 45 | 17.28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 13 | bert-base-cased | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 43.94 | 17 | 0.096 | 1.569 | 460 | 28 | 1 | 460 | 28 | 40.91 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 14 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 61.1 | 24.47 | 0.127 | 2.182 | 480 | 28 | 1 | 480 | 28 | 24.95 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 15 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 27.59 | 18.07 | 0.091 | 0.788 | 303 | 35 | 1 | 303 | 35 | 43.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 16 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 32.85 | 21.31 | 0.067 | 0.939 | 488 | 35 | 1 | 488 | 35 | 37.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 17 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 171 | 67.84 | 0.285 | 1.368 | 599 | 125 | 1 | 599 | 125 | 10.79 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 18 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 51.22 | 33.8 | 0.086 | 0.41 | 594 | 125 | 1 | 594 | 125 | 28.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 19 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 20.71 | 14.5 | 0.041 | 0.292 | 506 | 71 | 1 | 506 | 71 | 50.19 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 20 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 217.69 | 79.96 | 0.069 | 1.037 | 3144 | 210 | 2 | 1572 | 105 | 14.57 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 21 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 570.1 | 218.54 | 0.034 | 1.39 | 16954 | 410 | 2 | 8477 | 205 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 22 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 895.58 | 340.44 | 0.048 | 1.658 | 18718 | 540 | 2 | 9359 | 270 | 5.51 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 23 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 3159.1 | 495.77 | 0.093 | 4.513 | 34000 | 700 | 2 | 17000 | 350 | 3.89 | FPS | FPS/$ | FPS/TDP | msec. | 4.67 | 2066.26 | |||||
| 24 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 4721.72 | 584.23 | 0.22 | 6.745 | 21420 | 700 | 2 | 10710 | 350 | 3.84 | FPS | FPS/$ | FPS/TDP | msec. | 5.04 | 3201.77 | |||||
| 25 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 210.89 | 76.47 | 0.104 | 1.004 | 2022 | 210 | 2 | 1011 | 105 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 26 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 441.3 | 166.87 | 0.194 | 1.471 | 2274 | 300 | 2 | 1137 | 150 | 8.04 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 27 | bert-base-cased | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 842.14 | 707.38 | 0.437 | 5.614 | 1925 | 150 | 1 | 1925 | 150 | 18.66 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 28 | bert-base-cased | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 730.85 | 629.55 | 2.277 | 4.872 | 321 | 150 | 1 | 321 | 150 | 21.75 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 29 | bert-base-cased | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 193.52 | 148.61 | 0.102 | 2.58 | 1900 | 75 | 1 | 1900 | 75 | 82.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 30 | bert-base-cased | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 25.03 | 20.17 | 0.432 | 2.086 | 58 | 12 | 1 | 58 | 12 | 148.25 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 31 | bert-base-cased | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 13.3 | 14.83 | 0.199 | 1.108 | 67 | 12 | 1 | 67 | 12 | 300.2 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 32 | bert-base-cased | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 45.46 | 33.29 | 0.425 | 3.031 | 107 | 15 | 1 | 107 | 15 | 87.8 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 33 | bert-base-cased | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 68.12 | 52.93 | 0.16 | 2.433 | 426 | 28 | 1 | 426 | 28 | 58.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 34 | bert-base-cased | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 47.86 | 38.89 | 0.098 | 3.191 | 490 | 15 | 1 | 490 | 15 | 80.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 35 | bert-base-cased | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 87.9 | 68.51 | 0.175 | 1.953 | 502 | 45 | 1 | 502 | 45 | 45.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 36 | bert-base-cased | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 460 | 28 | 1 | 460 | 28 | 7.03 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 37 | bert-base-cased | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 73.09 | 60.98 | 0.159 | 2.61 | 460 | 28 | 1 | 460 | 28 | 14.83 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 38 | bert-base-cased | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 26.48 | 10.15 | 0.457 | 2.207 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 39 | bert-base-cased | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||
| 40 | bert-base-cased | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 46.21 | 23.14 | 0.432 | 3.081 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 41 | bert-base-cased | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 88.37 | 38.93 | 0.207 | 3.156 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 42 | bert-base-cased | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 51.1 | 20.63 | 0.104 | 3.407 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 43 | bert-base-cased | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 107.25 | 44.37 | 0.214 | 2.383 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 44 | bert-base-cased | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 67.65 | 36.74 | 0.147 | 2.416 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 45 | bert-base-cased | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||
| 46 | end_rec | ||||||||||||||||||||||||
| 47 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 48 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 1.04 | 0.49 | 0.018 | 0.087 | 58 | 12 | 1 | 58 | 12 | 983.06 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 49 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 0.18 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 50 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 1.17 | 0.38 | 0.011 | 0.078 | 107 | 15 | 1 | 107 | 15 | 858.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 51 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 2.08 | 1.3 | 0.018 | 0.032 | 117 | 65 | 1 | 117 | 65 | 497.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 52 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 2.99 | 1.86 | 0.014 | 0.085 | 214 | 35 | 1 | 214 | 35 | 350.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 53 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 10.9 | 3.96 | 0.033 | 0.087 | 329 | 125 | 1 | 329 | 125 | 124.83 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 54 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 3.24 | 1.95 | 0.017 | 0.05 | 192 | 65 | 1 | 192 | 65 | 302.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 55 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 5.06 | 1.64 | 0.012 | 0.181 | 426 | 28 | 1 | 426 | 28 | 200.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 56 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 3.66 | 1.19 | 0.007 | 0.244 | 490 | 15 | 1 | 490 | 15 | 267.81 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 57 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 7.92 | 2.83 | 0.016 | 0.176 | 502 | 45 | 1 | 502 | 45 | 164.16 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 58 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 4.26 | 1.45 | 0.009 | 0.152 | 460 | 28 | 1 | 460 | 28 | 270.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 59 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 5.74 | 2.18 | 0.012 | 0.205 | 480 | 28 | 1 | 480 | 28 | 234.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 60 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 2.69 | 1.6 | 0.009 | 0.077 | 303 | 35 | 1 | 303 | 35 | 412.97 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 61 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 3.25 | 1.93 | 0.007 | 0.093 | 488 | 35 | 1 | 488 | 35 | 331.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 62 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 16.12 | 6.05 | 0.027 | 0.129 | 599 | 125 | 1 | 599 | 125 | 91.44 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 63 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 4.67 | 3.09 | 0.008 | 0.037 | 594 | 125 | 1 | 594 | 125 | 225.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 64 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 2.1 | 1.32 | 0.004 | 0.03 | 506 | 71 | 1 | 506 | 71 | 486.39 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 65 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 21.69 | 6.92 | 0.007 | 0.103 | 3144 | 210 | 2 | 1572 | 105 | 105.49 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 66 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 50.99 | 17.86 | 0.003 | 0.124 | 16954 | 410 | 2 | 8477 | 205 | 55.53 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 67 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 64.09 | 27.26 | 0.003 | 0.119 | 18718 | 540 | 2 | 9359 | 270 | 181.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 68 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 252.4 | 45 | 0.007 | 0.361 | 34000 | 700 | 2 | 17000 | 350 | FPS | FPS/$ | FPS/TDP | msec. | 31.34 | 238.17 | ||||||
| 69 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 307.68 | 54.32 | 0.014 | 0.44 | 21420 | 700 | 2 | 10710 | 350 | 22.7 | FPS | FPS/$ | FPS/TDP | msec. | 48.27 | 282.5 | |||||
| 70 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 20.83 | 6.84 | 0.01 | 0.099 | 2022 | 210 | 2 | 1011 | 105 | 109.21 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 71 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 38.81 | 15.18 | 0.017 | 0.129 | 2274 | 300 | 2 | 1137 | 150 | 107.2 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 72 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 155.76 | 113.59 | 0.081 | 1.038 | 1925 | 150 | 1 | 1925 | 150 | 102.15 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 73 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 148.87 | 111.85 | 0.464 | 0.992 | 321 | 150 | 1 | 321 | 150 | 107.07 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 74 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 32.36 | 22.97 | 0.017 | 0.431 | 1900 | 75 | 1 | 1900 | 75 | 494.67 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 75 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 2.38 | 1.83 | 0.041 | 0.198 | 58 | 12 | 1 | 58 | 12 | 1443.08 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 76 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 1.41 | 1.46 | 0.021 | 0.118 | 67 | 12 | 1 | 67 | 12 | 2832.73 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 77 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 5.13 | 3.57 | 0.048 | 0.342 | 107 | 15 | 1 | 107 | 15 | 778.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 78 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 8.57 | 6.33 | 0.02 | 0.306 | 426 | 28 | 1 | 426 | 28 | 451.82 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 79 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 5.19 | 4.26 | 0.011 | 0.346 | 490 | 15 | 1 | 490 | 15 | 738.48 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 80 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 11.13 | 7.99 | 0.022 | 0.247 | 502 | 45 | 1 | 502 | 45 | 358.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 81 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 18.3 | 12.44 | 0.040 | 0.654 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 82 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 8.21 | 6.27 | 0.018 | 0.293 | 460 | 28 | 1 | 460 | 28 | 160.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 83 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 2.44 | 0.87 | 0.042 | 0.203 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 84 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 0.74 | 0.014 | 0.078 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 85 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 5.2 | 2.35 | 0.049 | 0.347 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 86 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 9.17 | 3.73 | 0.022 | 0.328 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 87 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 4.61 | 1.91 | 0.009 | 0.307 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 88 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 10.26 | 4.2 | 0.02 | 0.228 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 89 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 8.28 | 4.36 | 0.018 | 0.296 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 90 | bert-large-uncased-whole-word-masking-squad-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 8.46 | 0.018 | 0.302 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 91 | end_rec | ||||||||||||||||||||||||
| 92 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 93 | efficientdet-d0 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 14.09 | 10.1 | 0.243 | 1.174 | 58 | 12 | 1 | 58 | 12 | 73.36 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 94 | efficientdet-d0 | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 7.29 | 5.14 | 0.109 | 0.608 | 67 | 12 | 1 | 67 | 12 | 140.59 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 95 | efficientdet-d0 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 18.9 | 11.39 | 0.177 | 1.26 | 107 | 15 | 1 | 107 | 15 | 56.95 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 96 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 36.57 | 24.62 | 0.313 | 0.563 | 117 | 65 | 1 | 117 | 65 | 28.55 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 97 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 59.04 | 30 | 0.276 | 1.687 | 214 | 35 | 1 | 214 | 35 | 21.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 98 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 153.46 | 90.43 | 0.466 | 1.228 | 329 | 125 | 1 | 329 | 125 | 9.45 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 99 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 58.33 | 38.44 | 0.304 | 0.897 | 192 | 65 | 1 | 192 | 65 | 18.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 100 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 76.46 | 40.76 | 0.179 | 2.731 | 426 | 28 | 1 | 426 | 28 | 15.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 101 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 53.08 | 21.66 | 0.108 | 3.539 | 490 | 15 | 1 | 490 | 15 | 20.69 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 102 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 107.65 | 56.75 | 0.214 | 2.392 | 502 | 45 | 1 | 502 | 45 | 11.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 103 | efficientdet-d0 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 39.92 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 104 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 82.03 | 39.59 | 0.171 | 2.93 | 480 | 28 | 1 | 480 | 28 | 17.13 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 105 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 51.76 | 35.03 | 0.171 | 1.479 | 303 | 35 | 1 | 303 | 35 | 24.46 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 106 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 64.83 | 36.42 | 0.133 | 1.852 | 488 | 35 | 1 | 488 | 35 | 19 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 107 | efficientdet-d0 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 220.06 | 111.6 | 0.367 | 1.76 | 599 | 125 | 1 | 599 | 125 | 7.21 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 108 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 97.05 | 39.83 | 0.163 | 0.776 | 594 | 125 | 1 | 594 | 125 | 14.28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 109 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 35.01 | 27.24 | 0.069 | 0.493 | 506 | 71 | 1 | 506 | 71 | 29.62 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 110 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 258.91 | 164.14 | 0.082 | 1.233 | 3144 | 210 | 2 | 1572 | 105 | 12.55 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 111 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 522.25 | 309.46 | 0.031 | 1.274 | 16954 | 410 | 2 | 8477 | 205 | 7.95 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 112 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 814.44 | 473.35 | 0.044 | 1.508 | 18718 | 540 | 2 | 9359 | 270 | 4.47 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 113 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 1440.77 | 856.16 | 0.042 | 2.058 | 34000 | 700 | 2 | 17000 | 350 | 4.91 | FPS | FPS/$ | FPS/TDP | msec. | 5.31 | 1051.34 | |||||
| 114 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 1654.92 | 1131.08 | 0.077 | 2.364 | 21420 | 700 | 2 | 10710 | 350 | 5.43 | FPS | FPS/$ | FPS/TDP | msec. | 5.19 | 1371.97 | |||||
| 115 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 251.15 | 157.3 | 0.124 | 1.196 | 2022 | 210 | 2 | 1011 | 105 | 12.83 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 116 | efficientdet-d0 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 467.77 | 283.75 | 0.206 | 1.559 | 2274 | 300 | 2 | 1137 | 150 | 5.92 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 117 | efficientdet-d0 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 849.42 | 829.93 | 0.441 | 5.663 | 1925 | 150 | 1 | 1925 | 150 | 18.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 118 | efficientdet-d0 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 702.37 | 660.01 | 2.188 | 4.682 | 321 | 150 | 1 | 321 | 150 | 22.54 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 119 | efficientdet-d0 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 142.27 | 124.98 | 0.075 | 1.897 | 1900 | 75 | 1 | 1900 | 75 | 112.37 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 120 | efficientdet-d0 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 37.98 | 33.77 | 0.655 | 3.165 | 58 | 12 | 1 | 58 | 12 | 100.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 121 | efficientdet-d0 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 21.69 | 25.5 | 0.324 | 1.808 | 67 | 12 | 1 | 67 | 12 | 183.86 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 122 | efficientdet-d0 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 72.41 | 60.86 | 0.677 | 4.827 | 107 | 15 | 1 | 107 | 15 | 55.05 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 123 | efficientdet-d0 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 92.7 | 77.35 | 0.218 | 3.311 | 426 | 28 | 1 | 426 | 28 | 42.67 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 124 | efficientdet-d0 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 56.37 | 43.21 | 0.115 | 3.758 | 490 | 15 | 1 | 490 | 15 | 70.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 125 | efficientdet-d0 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 126.69 | 102.94 | 0.252 | 2.815 | 502 | 45 | 1 | 502 | 45 | 31.31 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 126 | efficientdet-d0 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 460 | 28 | 1 | 460 | 28 | 8.08 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 127 | efficientdet-d0 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 39.47 | 18.87 | 0.681 | 3.289 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 128 | efficientdet-d0 | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 23.34 | 14.96 | 0.348 | 1.945 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 129 | efficientdet-d0 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 57.22 | 30.61 | 0.535 | 3.815 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 130 | efficientdet-d0 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 104.95 | 49.2 | 0.246 | 3.748 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 131 | efficientdet-d0 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 58.46 | 19.06 | 0.119 | 3.897 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 132 | efficientdet-d0 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 142.24 | 54.34 | 0.283 | 3.161 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 133 | efficientdet-d0 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 114.43 | 83.33 | 0.249 | 4.087 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 134 | efficientdet-d0 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 103.02 | 41.32 | 0.215 | 3.679 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 135 | end_rec | ||||||||||||||||||||||||
| 136 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 137 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 0.15 | 0.07 | 0.003 | 0.013 | 58 | 12 | 1 | 58 | 12 | 6956.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 138 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 0.04 | 0.02 | 0.001 | 0.003 | 67 | 12 | 1 | 67 | 12 | 20351.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 139 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 0.16 | 0.04 | 0.001 | 0.011 | 107 | 15 | 1 | 107 | 15 | 6110.16 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 140 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 0.29 | 0.18 | 0.002 | 0.004 | 117 | 65 | 1 | 117 | 65 | 3383.35 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 141 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 0.42 | 0.27 | 0.002 | 0.012 | 214 | 35 | 1 | 214 | 35 | 2638.53 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 142 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 1.6 | 0.52 | 0.005 | 0.013 | 329 | 125 | 1 | 329 | 125 | 823.05 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 143 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 0.47 | 0.28 | 0.002 | 0.007 | 192 | 65 | 1 | 192 | 65 | 2236.31 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 144 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 0.7 | 0.19 | 0.002 | 0.025 | 426 | 28 | 1 | 426 | 28 | 1433.13 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 145 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 0.5 | 0.14 | 0.001 | 0.033 | 490 | 15 | 1 | 490 | 15 | 1869.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 146 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 1.25 | 0.38 | 0.002 | 0.028 | 502 | 45 | 1 | 502 | 45 | 1069.7 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 147 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 0.83 | 0.23 | 0.002 | 0.03 | 460 | 28 | 1 | 460 | 28 | 1659.96 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 148 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 0.91 | 0.3 | 0.002 | 0.033 | 480 | 28 | 1 | 480 | 28 | 1451.82 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 149 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 0.36 | 0.2 | 0.001 | 0.01 | 303 | 35 | 1 | 303 | 35 | 3131.44 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 150 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 0.45 | 0.26 | 0.001 | 0.013 | 488 | 35 | 1 | 488 | 35 | 2478.06 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 151 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 2.48 | 0.81 | 0.004 | 0.02 | 599 | 125 | 1 | 599 | 125 | 645.95 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 152 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 0.71 | 0.47 | 0.001 | 0.006 | 594 | 125 | 1 | 594 | 125 | 1656.14 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 153 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 0.28 | 0.17 | 0.001 | 0.004 | 506 | 71 | 1 | 506 | 71 | 3515.54 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 154 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 3.05 | 0.89 | 0.001 | 0.015 | 3144 | 210 | 2 | 1572 | 105 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 155 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 7.98 | 2.22 | 0 | 0.019 | 16954 | 410 | 2 | 8477 | 205 | 466.31 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 156 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 12.89 | 3.48 | 0.001 | 0.024 | 18718 | 540 | 2 | 9359 | 270 | 468.34 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 157 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 53.71 | 5.38 | 0.002 | 0.077 | 34000 | 700 | 2 | 17000 | 350 | 240.88 | FPS | FPS/$ | FPS/TDP | msec. | 81.33 | 38.89 | |||||
| 158 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 34.47 | 6.43 | 0.002 | 0.049 | 21420 | 700 | 2 | 10710 | 350 | 377.63 | FPS | FPS/$ | FPS/TDP | msec. | 103.72 | 46.34 | |||||
| 159 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 2.98 | 0.87 | 0.001 | 0.014 | 2022 | 210 | 2 | 1011 | 105 | 883 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 160 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 6.93 | 1.79 | 0.003 | 0.023 | 2274 | 300 | 2 | 1137 | 150 | 503.34 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 161 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 32.09 | 19.6 | 0.017 | 0.214 | 1925 | 150 | 1 | 1925 | 150 | 498 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 162 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 28.32 | 18.45 | 0.088 | 0.189 | 321 | 150 | 1 | 321 | 150 | 564.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 163 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 5.34 | 0.003 | 0.071 | 1900 | 75 | 1 | 1900 | 75 | 2993.79 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 164 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 0.24 | 0.2 | 0.004 | 0.02 | 58 | 12 | 1 | 58 | 12 | 15836.94 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 165 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 0.15 | 0.16 | 0.002 | 0.013 | 67 | 12 | 1 | 67 | 12 | 26123.74 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 166 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 0.53 | 0.54 | 0.005 | 0.035 | 107 | 15 | 1 | 107 | 15 | 7509.04 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 167 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 0.91 | 0.92 | 0.002 | 0.033 | 426 | 28 | 1 | 426 | 28 | 4361.11 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 168 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 0.61 | 0.58 | 0.001 | 0.041 | 490 | 15 | 1 | 490 | 15 | 6370.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 169 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 1.12 | 1.14 | 0.002 | 0.025 | 502 | 45 | 1 | 502 | 45 | 3541.38 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 170 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 1.84 | 1.35 | 0.004 | 0.066 | 460 | 28 | 1 | 460 | 28 | 526.67 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 171 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 0.28 | 0.005 | 0.023 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 172 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 0.15 | 0.002 | 0.013 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 173 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 0.59 | 0.28 | 0.006 | 0.039 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 174 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 1.2 | 0.42 | 0.003 | 0.043 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 175 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 0.69 | 0.2 | 0.001 | 0.046 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 176 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 1.63 | 0.59 | 0.003 | 0.036 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 177 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 1.23 | 0.56 | 0.003 | 0.044 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 178 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 0.002 | 0.043 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||
| 179 | end_rec | ||||||||||||||||||||||||
| 180 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 181 | mobilenet-v2 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 274.2 | 190.76 | 4.728 | 22.85 | 58 | 12 | 1 | 58 | 12 | 4.12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 182 | mobilenet-v2 | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 134.2 | 80.81 | 2.003 | 11.183 | 67 | 12 | 1 | 67 | 12 | 7.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 183 | mobilenet-v2 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 300.45 | 133.46 | 2.808 | 20.03 | 107 | 15 | 1 | 107 | 15 | 3.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 184 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 535.78 | 448.09 | 4.579 | 8.243 | 117 | 65 | 1 | 117 | 65 | 2.06 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 185 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 893.54 | 489.09 | 4.175 | 25.53 | 214 | 35 | 1 | 214 | 35 | 1.62 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 186 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 2984.14 | 1380.24 | 9.07 | 23.873 | 329 | 125 | 1 | 329 | 125 | 0.7 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 187 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 856.66 | 664.56 | 4.462 | 13.179 | 192 | 65 | 1 | 192 | 65 | 1.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 188 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 1370.63 | 517.32 | 3.217 | 48.951 | 426 | 28 | 1 | 426 | 28 | 0.97 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 189 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 969.67 | 314.82 | 1.979 | 64.645 | 490 | 15 | 1 | 490 | 15 | 1.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 190 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 1892.98 | 986.87 | 3.771 | 42.066 | 502 | 45 | 1 | 502 | 45 | 0.93 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 191 | mobilenet-v2 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 1335.3 | 606.33 | 2.903 | 47.689 | 460 | 28 | 1 | 460 | 28 | 1.66 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 192 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 1479.8 | 751.95 | 3.083 | 52.85 | 480 | 28 | 1 | 480 | 28 | 1.11 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 193 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 742.76 | 511.71 | 2.451 | 21.222 | 303 | 35 | 1 | 303 | 35 | 1.89 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 194 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 912.88 | 597.02 | 1.871 | 26.082 | 488 | 35 | 1 | 488 | 35 | 1.57 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 195 | mobilenet-v2 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 4327.78 | 2075.18 | 7.225 | 34.622 | 599 | 125 | 1 | 599 | 125 | 0.58 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 196 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 1440.2 | 552.73 | 2.425 | 11.522 | 594 | 125 | 1 | 594 | 125 | 1.31 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 197 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 521.2 | 445.72 | 1.03 | 7.341 | 506 | 71 | 1 | 506 | 71 | 2.1 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 198 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 5412.93 | 1933.71 | 1.722 | 25.776 | 3144 | 210 | 2 | 1572 | 105 | 1.54 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 199 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 14081.62 | 4387.61 | 0.831 | 34.345 | 16954 | 410 | 2 | 8477 | 205 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 200 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 22954.57 | 6958.93 | 1.226 | 42.508 | 18718 | 540 | 2 | 9359 | 270 | 0.6 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 201 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 39342.91 | 10857.46 | 1.157 | 56.204 | 34000 | 700 | 2 | 17000 | 350 | 0.69 | FPS | FPS/$ | FPS/TDP | msec. | 0.69 | 26801.32 | |||||
| 202 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 40611.58 | 16922.79 | 1.896 | 58.017 | 21420 | 700 | 2 | 10710 | 350 | 0.64 | FPS | FPS/$ | FPS/TDP | msec. | 0.66 | 32078.82 | |||||
| 203 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 5160.49 | 1883.15 | 2.552 | 24.574 | 2022 | 210 | 2 | 1011 | 105 | 1.55 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 204 | mobilenet-v2 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 12276.24 | 3658 | 5.399 | 40.921 | 2274 | 300 | 2 | 1137 | 150 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 205 | mobilenet-v2 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 6753.42 | 6013.53 | 3.508 | 45.023 | 1925 | 150 | 1 | 1925 | 150 | 2.17 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 206 | mobilenet-v2 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 4929.18 | 4590.32 | 15.356 | 32.861 | 321 | 150 | 1 | 321 | 150 | 3.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 207 | mobilenet-v2 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 1918.84 | 1581.38 | 1.01 | 25.585 | 1900 | 75 | 1 | 1900 | 75 | 8.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 208 | mobilenet-v2 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 447.92 | 345.3 | 7.723 | 37.327 | 58 | 12 | 1 | 58 | 12 | 8.73 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 209 | mobilenet-v2 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 196.59 | 236.4 | 2.934 | 16.383 | 67 | 12 | 1 | 67 | 12 | 20.1 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 210 | mobilenet-v2 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 685.64 | 512.03 | 6.408 | 45.709 | 107 | 15 | 1 | 107 | 15 | 5.64 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 211 | mobilenet-v2 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 796.78 | 604.06 | 1.87 | 28.456 | 426 | 28 | 1 | 426 | 28 | 4.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 212 | mobilenet-v2 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 649.25 | 442.72 | 1.325 | 43.283 | 490 | 15 | 1 | 490 | 15 | 6.11 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 213 | mobilenet-v2 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 1318.41 | 908.73 | 2.626 | 29.298 | 502 | 45 | 1 | 502 | 45 | 2.94 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 214 | mobilenet-v2 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 1385.05 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||||
| 215 | mobilenet-v2 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 1947.05 | 1264.15 | 4.233 | 69.538 | 460 | 28 | 1 | 460 | 28 | 0.78 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 216 | mobilenet-v2 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 461.47 | 248.33 | 7.956 | 38.456 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 217 | mobilenet-v2 | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 240.37 | 165.52 | 3.588 | 20.031 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 218 | mobilenet-v2 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 533.39 | 305.48 | 4.985 | 35.559 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 219 | mobilenet-v2 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 1441.4 | 602.27 | 3.384 | 51.479 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 220 | mobilenet-v2 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 1046.89 | 275.12 | 2.137 | 69.793 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 221 | mobilenet-v2 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 2198.66 | 1050.82 | 4.38 | 48.859 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 222 | mobilenet-v2 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 1488.7 | 713.39 | 3.236 | 53.168 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 223 | mobilenet-v2 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 1594.11 | 759.14 | 3.321 | 56.933 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 224 | end_rec | ||||||||||||||||||||||||
| 225 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 226 | resnet-50 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 45.46 | 20.41 | 0.784 | 3.788 | 58 | 12 | 1 | 58 | 12 | 23.86 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 227 | resnet-50 | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 19.88 | 8.14 | 0.297 | 1.657 | 67 | 12 | 1 | 67 | 12 | 52 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 228 | resnet-50 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 51.53 | 14.42 | 0.482 | 3.435 | 107 | 15 | 1 | 107 | 15 | 19.92 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 229 | resnet-50 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 97.06 | 50.22 | 0.83 | 1.493 | 117 | 65 | 1 | 117 | 65 | 10.79 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 230 | resnet-50 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 144.82 | 73.65 | 0.677 | 4.138 | 214 | 35 | 1 | 214 | 35 | 8.26 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 231 | resnet-50 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 557.61 | 151.84 | 1.695 | 4.461 | 329 | 125 | 1 | 329 | 125 | 3.13 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 232 | resnet-50 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 151.29 | 77.63 | 0.788 | 2.328 | 192 | 65 | 1 | 192 | 65 | 7.12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 233 | resnet-50 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 226.77 | 61.25 | 0.532 | 8.099 | 426 | 28 | 1 | 426 | 28 | 5.01 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 234 | resnet-50 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 174.35 | 44.95 | 0.356 | 11.623 | 490 | 15 | 1 | 490 | 15 | 6.47 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 235 | resnet-50 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 417.79 | 114.34 | 0.832 | 9.284 | 502 | 45 | 1 | 502 | 45 | 3.89 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 236 | resnet-50 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 257.66 | 58.85 | 0.56 | 9.202 | 460 | 28 | 1 | 460 | 28 | 7.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 237 | resnet-50 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 300.16 | 87.89 | 0.625 | 10.72 | 480 | 28 | 1 | 480 | 28 | 5.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 238 | resnet-50 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 122.3 | 61.11 | 0.404 | 3.494 | 303 | 35 | 1 | 303 | 35 | 10.05 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 239 | resnet-50 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 152.65 | 73.31 | 0.313 | 4.361 | 488 | 35 | 1 | 488 | 35 | 7.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 240 | resnet-50 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 795.74 | 235.56 | 1.328 | 6.366 | 599 | 125 | 1 | 599 | 125 | 2.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 241 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 241.82 | 97.7 | 0.407 | 1.935 | 594 | 125 | 1 | 594 | 125 | 5.44 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 242 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 92.6 | 49.32 | 0.183 | 1.304 | 506 | 71 | 1 | 506 | 71 | 11.17 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 243 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 973.8 | 268.81 | 0.31 | 4.637 | 3144 | 210 | 2 | 1572 | 105 | 3.03 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 244 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 2849.47 | 735.55 | 0.168 | 6.95 | 16954 | 410 | 2 | 8477 | 205 | 1.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 245 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 4953.19 | 1155.29 | 0.265 | 9.173 | 18718 | 540 | 2 | 9359 | 270 | 1.06 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 246 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 20219.89 | 1653 | 0.595 | 28.886 | 34000 | 700 | 2 | 17000 | 350 | 1.07 | FPS | FPS/$ | FPS/TDP | msec. | 1.29 | 8178.33 | |||||
| 247 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 22402.58 | 2058.94 | 1.046 | 32.004 | 21420 | 700 | 2 | 10710 | 350 | 0.96 | FPS | FPS/$ | FPS/TDP | msec. | 1.54 | 14017.37 | |||||
| 248 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 920.75 | 256.18 | 0.455 | 4.385 | 2022 | 210 | 2 | 1011 | 105 | 3.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 249 | resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 2269.1 | 577.44 | 0.998 | 7.564 | 2274 | 300 | 2 | 1137 | 150 | 1.47 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 250 | resnet-50 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 3588.07 | 2240.26 | 1.864 | 23.92 | 1925 | 150 | 1 | 1925 | 150 | 4.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 251 | resnet-50 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 2985.51 | 1945.66 | 9.301 | 19.903 | 321 | 150 | 1 | 321 | 150 | 5.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 252 | resnet-50 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 821.64 | 517.36 | 0.432 | 10.955 | 1900 | 75 | 1 | 1900 | 75 | 19.45 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 253 | resnet-50 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 111.83 | 62.57 | 1.928 | 9.319 | 58 | 12 | 1 | 58 | 12 | 35.58 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 254 | resnet-50 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 49.3 | 52.41 | 0.736 | 4.108 | 67 | 12 | 1 | 67 | 12 | 80.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 255 | resnet-50 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 210.05 | 118.29 | 1.963 | 14.003 | 107 | 15 | 1 | 107 | 15 | 18.93 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 256 | resnet-50 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 284.72 | 178.12 | 0.668 | 10.169 | 426 | 28 | 1 | 426 | 28 | 13.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 257 | resnet-50 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 207.72 | 121.27 | 0.424 | 13.848 | 490 | 15 | 1 | 490 | 15 | 18.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 258 | resnet-50 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 389.71 | 222.4 | 0.776 | 8.66 | 502 | 45 | 1 | 502 | 45 | 9.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 259 | resnet-50 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 537.89 | 369.59 | 1.169 | 19.210 | 460 | 28 | 1 | 460 | 28 | 2.34 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 260 | resnet-50 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 783.3 | 378.14 | 1.703 | 27.975 | 460 | 28 | 1 | 460 | 28 | 1.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 261 | resnet-50 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 130.47 | 37.61 | 2.249 | 10.873 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 262 | resnet-50 | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 60.54 | 31.21 | 0.904 | 5.045 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 263 | resnet-50 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 201.55 | 71.11 | 1.884 | 13.437 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 264 | resnet-50 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 381.99 | 122.54 | 0.897 | 13.643 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 265 | resnet-50 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 234.33 | 66.48 | 0.478 | 15.622 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 266 | resnet-50 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 529.17 | 152.24 | 1.054 | 11.759 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 267 | resnet-50 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 351.56 | 147.28 | 0.764 | 12.556 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 268 | resnet-50 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 399.48 | 0.832 | 14.267 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 269 | end_rec | ||||||||||||||||||||||||
| 270 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 271 | ssd-resnet34-1200 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 0.76 | 0.35 | 0.013 | 0.063 | 58 | 12 | 1 | 58 | 12 | 1330.73 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 272 | ssd-resnet34-1200 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 0.89 | 0.23 | 0.008 | 0.059 | 107 | 15 | 1 | 107 | 15 | 1121.88 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 273 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 1.66 | 0.95 | 0.014 | 0.026 | 117 | 65 | 1 | 117 | 65 | 599.8 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 274 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 2.41 | 1.39 | 0.011 | 0.069 | 214 | 35 | 1 | 214 | 35 | 459.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 275 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 8.98 | 2.67 | 0.027 | 0.072 | 329 | 125 | 1 | 329 | 125 | 129.64 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 276 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 2.59 | 1.46 | 0.013 | 0.04 | 192 | 65 | 1 | 192 | 65 | 398.99 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 277 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 3.97 | 1.02 | 0.009 | 0.142 | 426 | 28 | 1 | 426 | 28 | 250.07 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 278 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 2.98 | 0.72 | 0.006 | 0.199 | 490 | 15 | 1 | 490 | 15 | 333.24 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 279 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 6.8 | 2.02 | 0.014 | 0.151 | 502 | 45 | 1 | 502 | 45 | 172.93 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 280 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 4.02 | 1.12 | 0.009 | 0.144 | 460 | 28 | 1 | 460 | 28 | 260.23 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 281 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 5 | 1.57 | 0.01 | 0.179 | 480 | 28 | 1 | 480 | 28 | 256.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 282 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 2 | 1.12 | 0.007 | 0.057 | 303 | 35 | 1 | 303 | 35 | 563.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 283 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 2.59 | 1.42 | 0.005 | 0.074 | 488 | 35 | 1 | 488 | 35 | 411.85 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 284 | ssd-resnet34-1200 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 13.13 | 4.19 | 0.022 | 0.105 | 599 | 125 | 1 | 599 | 125 | 99.93 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 285 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 4.33 | 2.44 | 0.007 | 0.035 | 594 | 125 | 1 | 594 | 125 | 239.88 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 286 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 1.59 | 0.91 | 0.003 | 0.022 | 506 | 71 | 1 | 506 | 71 | 629.89 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 287 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 17.62 | 4.57 | 0.006 | 0.084 | 3144 | 210 | 2 | 1572 | 105 | 116.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 288 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 57.69 | 14.91 | 0.003 | 0.141 | 16954 | 410 | 2 | 8477 | 205 | 36.1 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 289 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 77.52 | 20.78 | 0.004 | 0.144 | 18718 | 540 | 2 | 9359 | 270 | 62.5 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 290 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 451.31 | 31.27 | 0.013 | 0.645 | 34000 | 700 | 2 | 17000 | 350 | 8.11 | FPS | FPS/$ | FPS/TDP | msec. | 15.3 | 216.45 | |||||
| 291 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 525.99 | 35.34 | 0.025 | 0.751 | 21420 | 700 | 2 | 10710 | 350 | 7.93 | FPS | FPS/$ | FPS/TDP | msec. | 29.52 | 248.82 | |||||
| 292 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 16.77 | 4.36 | 0.008 | 0.08 | 2022 | 210 | 2 | 1011 | 105 | 121.92 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 293 | ssd-resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 42.26 | 10.54 | 0.019 | 0.141 | 2274 | 300 | 2 | 1137 | 150 | 52.91 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 294 | ssd-resnet34-1200 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 214.37 | 110.89 | 0.111 | 1.429 | 1925 | 150 | 1 | 1925 | 150 | 74.3 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 295 | ssd-resnet34-1200 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 155.87 | 82.51 | 0.486 | 1.039 | 321 | 150 | 1 | 321 | 150 | 102.45 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 296 | ssd-resnet34-1200 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 33.86 | 16.66 | 0.018 | 0.451 | 1900 | 75 | 1 | 1900 | 75 | 469.18 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 297 | ssd-resnet34-1200 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 2.14 | 1.18 | 0.037 | 0.178 | 58 | 12 | 1 | 58 | 12 | 1813.16 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 298 | ssd-resnet34-1200 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 1.19 | 1.19 | 0.018 | 0.099 | 67 | 12 | 1 | 67 | 12 | 3356.08 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 299 | ssd-resnet34-1200 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 5.16 | 2.78 | 0.048 | 0.344 | 107 | 15 | 1 | 107 | 15 | 773.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 300 | ssd-resnet34-1200 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 8.3 | 4.68 | 0.019 | 0.296 | 426 | 28 | 1 | 426 | 28 | 474.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 301 | ssd-resnet34-1200 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 5.27 | 3.02 | 0.011 | 0.351 | 490 | 15 | 1 | 490 | 15 | 696.75 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 302 | ssd-resnet34-1200 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 10.47 | 5.85 | 0.021 | 0.233 | 502 | 45 | 1 | 502 | 45 | 379.95 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 303 | ssd-resnet34-1200 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 16.05 | 9.28 | 0.035 | 0.573 | 460 | 28 | 1 | 460 | 28 | 62.91 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 304 | ssd-resnet34-1200 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 0.76 | 0.35 | 0.013 | 0.063 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 305 | ssd-resnet34-1200 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 0.89 | 0.23 | 0.008 | 0.059 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 306 | ssd-resnet34-1200 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 3.96 | 1.02 | 0.009 | 0.141 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 307 | ssd-resnet34-1200 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 2.95 | 0.7 | 0.006 | 0.197 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 308 | ssd-resnet34-1200 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 6.81 | 2.03 | 0.014 | 0.151 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 309 | ssd-resnet34-1200 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 4.12 | 1.14 | 0.009 | 0.147 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 310 | ssd-resnet34-1200 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 4.98 | 1.56 | 0.01 | 0.178 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 311 | end_rec | ||||||||||||||||||||||||
| 312 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 313 | ssd_mobilenet_v1_coco | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 97.26 | 50.79 | 1.677 | 8.105 | 58 | 12 | 1 | 58 | 12 | 10.81 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 314 | ssd_mobilenet_v1_coco | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 45.79 | 21.6 | 0.683 | 3.816 | 67 | 12 | 1 | 67 | 12 | 22.81 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 315 | ssd_mobilenet_v1_coco | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 114.6 | 37 | 1.071 | 7.64 | 107 | 15 | 1 | 107 | 15 | 9.16 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 316 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 210.07 | 122.08 | 1.795 | 3.232 | 117 | 65 | 1 | 117 | 65 | 5.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 317 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 327.63 | 169.27 | 1.531 | 9.361 | 214 | 35 | 1 | 214 | 35 | 3.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 318 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 1090.55 | 389.63 | 3.315 | 8.724 | 329 | 125 | 1 | 329 | 125 | 1.43 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 319 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 333.01 | 191.23 | 1.734 | 5.123 | 192 | 65 | 1 | 192 | 65 | 3.16 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 320 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 517.03 | 147.64 | 1.214 | 18.465 | 426 | 28 | 1 | 426 | 28 | 2.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 321 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 389.5 | 100.56 | 0.795 | 25.967 | 490 | 15 | 1 | 490 | 15 | 2.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 322 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 817.31 | 294.59 | 1.628 | 18.162 | 502 | 45 | 1 | 502 | 45 | 1.89 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 323 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 538.96 | 152.67 | 1.172 | 19.249 | 460 | 28 | 1 | 460 | 28 | 3.69 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 324 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 607.65 | 223.66 | 1.266 | 21.702 | 480 | 28 | 1 | 480 | 28 | 2.5 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 325 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 275.71 | 156.99 | 0.91 | 7.877 | 303 | 35 | 1 | 303 | 35 | 4.38 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 326 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 353.13 | 186.7 | 0.724 | 10.089 | 488 | 35 | 1 | 488 | 35 | 3.42 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 327 | ssd_mobilenet_v1_coco | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 1617.11 | 605.3 | 2.7 | 12.937 | 599 | 125 | 1 | 599 | 125 | 1.15 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 328 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 574.42 | 222.78 | 0.967 | 4.595 | 594 | 125 | 1 | 594 | 125 | 2.38 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 329 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 201.39 | 124.9 | 0.398 | 2.836 | 506 | 71 | 1 | 506 | 71 | 5.17 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 330 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 2064.11 | 633.05 | 0.657 | 9.829 | 3144 | 210 | 2 | 1572 | 105 | 1.65 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 331 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 5726.3 | 1646.9 | 0.338 | 13.967 | 16954 | 410 | 2 | 8477 | 205 | 1.1 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 332 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 10309.67 | 2228.26 | 0.551 | 19.092 | 18718 | 540 | 2 | 9359 | 270 | 0.69 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 333 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 24565.67 | 3606.12 | 0.723 | 35.094 | 34000 | 700 | 2 | 17000 | 350 | 0.76 | FPS | FPS/$ | FPS/TDP | msec. | 0.93 | 12869.21 | |||||
| 334 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 28125.18 | 4909.95 | 1.313 | 40.179 | 21420 | 700 | 2 | 10710 | 350 | 0.74 | FPS | FPS/$ | FPS/TDP | msec. | 1 | 17557.7 | |||||
| 335 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 1974.99 | 612.04 | 0.977 | 9.405 | 2022 | 210 | 2 | 1011 | 105 | 1.78 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 336 | ssd_mobilenet_v1_coco | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 4848.98 | 1245.7 | 2.132 | 16.163 | 2274 | 300 | 2 | 1137 | 150 | 0.83 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 337 | ssd_mobilenet_v1_coco | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 4074.01 | 3472.83 | 2.116 | 27.16 | 1925 | 150 | 1 | 1925 | 150 | 3.62 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 338 | ssd_mobilenet_v1_coco | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 3480.39 | 2928.55 | 10.842 | 23.203 | 321 | 150 | 1 | 321 | 150 | 4.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 339 | ssd_mobilenet_v1_coco | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 984.2 | 781.88 | 0.518 | 13.123 | 1900 | 75 | 1 | 1900 | 75 | 16.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 340 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 226.24 | 134.9 | 3.901 | 18.853 | 58 | 12 | 1 | 58 | 12 | 17.46 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 341 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 96.58 | 100.18 | 1.441 | 8.048 | 67 | 12 | 1 | 67 | 12 | 40.94 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 342 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 409.69 | 222.42 | 3.829 | 27.313 | 107 | 15 | 1 | 107 | 15 | 9.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 343 | ssd_mobilenet_v1_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 500.03 | 312.32 | 1.174 | 17.858 | 426 | 28 | 1 | 426 | 28 | 7.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 344 | ssd_mobilenet_v1_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 379.18 | 226.11 | 0.774 | 25.279 | 490 | 15 | 1 | 490 | 15 | 10.12 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 345 | ssd_mobilenet_v1_coco | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 775.09 | 413.01 | 1.544 | 17.224 | 502 | 45 | 1 | 502 | 45 | 5.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 346 | ssd_mobilenet_v1_coco | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 912.24 | 651.17 | 1.983 | 32.580 | 460 | 28 | 1 | 460 | 28 | 1.39 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 347 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 245.08 | 84.77 | 4.226 | 20.423 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 348 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 115.54 | 65.27 | 1.724 | 9.628 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 349 | ssd_mobilenet_v1_coco | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 318.1 | 138.86 | 2.973 | 21.207 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 350 | ssd_mobilenet_v1_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 696.82 | 249.87 | 1.636 | 24.886 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 351 | ssd_mobilenet_v1_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 477.32 | 135.05 | 0.974 | 31.821 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 352 | ssd_mobilenet_v1_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 1006.42 | 351.52 | 2.005 | 22.365 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 353 | ssd_mobilenet_v1_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 692.74 | 316.15 | 1.506 | 24.741 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 354 | ssd_mobilenet_v1_coco | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 750.17 | 285.8 | 1.563 | 26.792 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 355 | end_rec | ||||||||||||||||||||||||
| 356 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 357 | unet-camvid-onnx-0001 | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 1.16 | 0.58 | 0.02 | 0.097 | 58 | 12 | 1 | 58 | 12 | 889.26 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 358 | unet-camvid-onnx-0001 | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 0.48 | 0.05 | 0.007 | 0.04 | 67 | 12 | 1 | 67 | 12 | 2079.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 359 | unet-camvid-onnx-0001 | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 1.49 | 0.37 | 0.014 | 0.099 | 107 | 15 | 1 | 107 | 15 | 675.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 360 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 2.42 | 1.54 | 0.021 | 0.037 | 117 | 65 | 1 | 117 | 65 | 421.22 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 361 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 3.6 | 2.27 | 0.017 | 0.103 | 214 | 35 | 1 | 214 | 35 | 322.24 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 362 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 12.67 | 4.38 | 0.039 | 0.101 | 329 | 125 | 1 | 329 | 125 | 96.97 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 363 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 3.74 | 2.35 | 0.019 | 0.058 | 192 | 65 | 1 | 192 | 65 | 261.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 364 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 6.6 | 1.66 | 0.015 | 0.236 | 426 | 28 | 1 | 426 | 28 | 155.79 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 365 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 4.94 | 1.23 | 0.01 | 0.329 | 490 | 15 | 1 | 490 | 15 | 202.15 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 366 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 9.65 | 3.3 | 0.019 | 0.214 | 502 | 45 | 1 | 502 | 45 | 127.88 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 367 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 5.44 | 1.88 | 0.012 | 0.194 | 460 | 28 | 1 | 460 | 28 | 193.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 368 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 7.04 | 2.56 | 0.015 | 0.251 | 480 | 28 | 1 | 480 | 28 | 190.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 369 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 3.01 | 1.83 | 0.01 | 0.086 | 303 | 35 | 1 | 303 | 35 | 387.77 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 370 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 3.73 | 2.32 | 0.008 | 0.107 | 488 | 35 | 1 | 488 | 35 | 282.55 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 371 | unet-camvid-onnx-0001 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 18.91 | 6.92 | 0.032 | 0.151 | 599 | 125 | 1 | 599 | 125 | 73.46 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 372 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 6.18 | 3.95 | 0.01 | 0.049 | 594 | 125 | 1 | 594 | 125 | 180.68 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 373 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 2.33 | 1.46 | 0.005 | 0.033 | 506 | 71 | 1 | 506 | 71 | 442.99 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 374 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 29.16 | 7.32 | 0.009 | 0.139 | 3144 | 210 | 2 | 1572 | 105 | 71.09 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 375 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 95.25 | 21.86 | 0.006 | 0.232 | 16954 | 410 | 2 | 8477 | 205 | 23.42 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 376 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 128.17 | 31.73 | 0.007 | 0.237 | 18718 | 540 | 2 | 9359 | 270 | 43.36 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 377 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 520.47 | 48.02 | 0.015 | 0.744 | 34000 | 700 | 2 | 17000 | 350 | 9.3 | FPS | FPS/$ | FPS/TDP | msec. | 14.63 | 221.87 | |||||
| 378 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 511.9 | 55.78 | 0.024 | 0.731 | 21420 | 700 | 2 | 10710 | 350 | 18.29 | FPS | FPS/$ | FPS/TDP | msec. | 27.74 | 243.6 | |||||
| 379 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 27.76 | 7 | 0.014 | 0.132 | 2022 | 210 | 2 | 1011 | 105 | 74.61 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 380 | unet-camvid-onnx-0001 | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 69.57 | 16.08 | 0.031 | 0.232 | 2274 | 300 | 2 | 1137 | 150 | 37.46 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 381 | unet-camvid-onnx-0001 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 303.46 | 205.28 | 0.158 | 2.023 | 1925 | 150 | 1 | 1925 | 150 | 52.47 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 382 | unet-camvid-onnx-0001 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 276.19 | 187.28 | 0.86 | 1.841 | 321 | 150 | 1 | 321 | 150 | 57.84 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 383 | unet-camvid-onnx-0001 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 55.71 | 32.59 | 0.029 | 0.743 | 1900 | 75 | 1 | 1900 | 75 | 287.24 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 384 | unet-camvid-onnx-0001 | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 3.43 | 1.96 | 0.059 | 0.286 | 58 | 12 | 1 | 58 | 12 | 1164.75 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 385 | unet-camvid-onnx-0001 | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 1.99 | 1.99 | 0.03 | 0.166 | 67 | 12 | 1 | 67 | 12 | 2003.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 386 | unet-camvid-onnx-0001 | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 8.34 | 4.43 | 0.078 | 0.556 | 107 | 15 | 1 | 107 | 15 | 478.94 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 387 | unet-camvid-onnx-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 14.77 | 7.63 | 0.035 | 0.528 | 426 | 28 | 1 | 426 | 28 | 270.28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 388 | unet-camvid-onnx-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 10.09 | 5.16 | 0.021 | 0.673 | 490 | 15 | 1 | 490 | 15 | 383.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 389 | unet-camvid-onnx-0001 | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 18.31 | 9.66 | 0.036 | 0.407 | 502 | 45 | 1 | 502 | 45 | 217.67 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 390 | unet-camvid-onnx-0001 | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 29.45 | 16.84 | 0.064 | 1.052 | 460 | 28 | 1 | 460 | 28 | 32.52 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 391 | unet-camvid-onnx-0001 | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 4 | 1.05 | 0.069 | 0.333 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 392 | unet-camvid-onnx-0001 | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 1.25 | 0.8 | 0.019 | 0.104 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 393 | unet-camvid-onnx-0001 | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 8.93 | 2.56 | 0.083 | 0.595 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 394 | unet-camvid-onnx-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 15.97 | 4.14 | 0.037 | 0.57 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 395 | unet-camvid-onnx-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 8.01 | 2.08 | 0.016 | 0.534 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 396 | unet-camvid-onnx-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 16.12 | 4.93 | 0.032 | 0.358 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 397 | unet-camvid-onnx-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 13.23 | 6.19 | 0.029 | 0.473 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 398 | unet-camvid-onnx-0001 | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 0.028 | 0.485 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||
| 399 | end_rec | ||||||||||||||||||||||||
| 400 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 401 | yolo_v3_tiny | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 52.55 | 25.74 | 0.906 | 4.379 | 58 | 12 | 1 | 58 | 12 | 20.26 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 402 | yolo_v3_tiny | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 22.84 | 10.28 | 0.341 | 1.903 | 67 | 12 | 1 | 67 | 12 | 44.98 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 403 | yolo_v3_tiny | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 54.9 | 18.22 | 0.513 | 3.66 | 107 | 15 | 1 | 107 | 15 | 18.42 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 404 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 111.17 | 62.67 | 0.95 | 1.71 | 117 | 65 | 1 | 117 | 65 | 9.04 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 405 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 167.07 | 90.01 | 0.781 | 4.773 | 214 | 35 | 1 | 214 | 35 | 6.5 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 406 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 632.16 | 205.66 | 1.921 | 5.057 | 329 | 125 | 1 | 329 | 125 | 2.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 407 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 173.6 | 94.91 | 0.904 | 2.671 | 192 | 65 | 1 | 192 | 65 | 6.05 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 408 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 247.98 | 77.27 | 0.582 | 8.856 | 426 | 28 | 1 | 426 | 28 | 4.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 409 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 186.03 | 55.35 | 0.38 | 12.402 | 490 | 15 | 1 | 490 | 15 | 5.63 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 410 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 472.59 | 145.67 | 0.941 | 10.502 | 502 | 45 | 1 | 502 | 45 | 3.08 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 411 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 275.83 | 79.01 | 0.6 | 9.851 | 460 | 28 | 1 | 460 | 28 | 5.54 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 412 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 335.4 | 109.29 | 0.699 | 11.979 | 480 | 28 | 1 | 480 | 28 | 4.38 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 413 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 137.35 | 74.99 | 0.453 | 3.924 | 303 | 35 | 1 | 303 | 35 | 8.25 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 414 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 178.48 | 91.64 | 0.366 | 5.099 | 488 | 35 | 1 | 488 | 35 | 6.34 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 415 | yolo_v3_tiny | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 897.62 | 298.58 | 1.499 | 7.181 | 599 | 125 | 1 | 599 | 125 | 1.8 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 416 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 297.46 | 147.52 | 0.501 | 2.38 | 594 | 125 | 1 | 594 | 125 | 4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 417 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 105.45 | 61.46 | 0.208 | 1.485 | 506 | 71 | 1 | 506 | 71 | 9.51 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 418 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 1032.83 | 337.52 | 0.329 | 4.918 | 3144 | 210 | 2 | 1572 | 105 | 2.55 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 419 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 2738.96 | 908.06 | 0.162 | 6.68 | 16954 | 410 | 2 | 8477 | 205 | 1.25 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 420 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 4527.43 | 1353.84 | 0.242 | 8.384 | 18718 | 540 | 2 | 9359 | 270 | 0.9 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 421 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 11351.7 | 2105.81 | 0.334 | 16.217 | 34000 | 700 | 2 | 17000 | 350 | 0.92 | FPS | FPS/$ | FPS/TDP | msec. | 0.86 | 8771.17 | |||||
| 422 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 14889.91 | 2545.6 | 0.695 | 21.271 | 21420 | 700 | 2 | 10710 | 350 | 0.85 | FPS | FPS/$ | FPS/TDP | msec. | 0.88 | 13920.15 | |||||
| 423 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 995.13 | 320.48 | 0.492 | 4.739 | 2022 | 210 | 2 | 1011 | 105 | 2.7 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 424 | yolo_v3_tiny | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 2210.72 | 698.38 | 0.972 | 7.369 | 2274 | 300 | 2 | 1137 | 150 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 425 | yolo_v3_tiny | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 3857.91 | 2885.6 | 2.004 | 25.719 | 1925 | 150 | 1 | 1925 | 150 | 3.83 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 426 | yolo_v3_tiny | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 3248.18 | 2468.81 | 10.119 | 21.655 | 321 | 150 | 1 | 321 | 150 | 4.86 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 427 | yolo_v3_tiny | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 749.79 | 659.03 | 0.395 | 9.997 | 1900 | 75 | 1 | 1900 | 75 | 21.3 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 428 | yolo_v3_tiny | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 144.84 | 76.94 | 2.497 | 12.07 | 58 | 12 | 1 | 58 | 12 | 27.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 429 | yolo_v3_tiny | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 67.09 | 67.69 | 1.001 | 5.591 | 67 | 12 | 1 | 67 | 12 | 59.15 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 430 | yolo_v3_tiny | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 315.81 | 157.38 | 2.951 | 21.054 | 107 | 15 | 1 | 107 | 15 | 12.58 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 431 | yolo_v3_tiny | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 442.07 | 249.34 | 1.038 | 15.788 | 426 | 28 | 1 | 426 | 28 | 8.76 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 432 | yolo_v3_tiny | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 322.2 | 163.14 | 0.658 | 21.48 | 490 | 15 | 1 | 490 | 15 | 11.77 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 433 | yolo_v3_tiny | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 599.94 | 318.3 | 1.195 | 13.332 | 502 | 45 | 1 | 502 | 45 | 6.45 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 434 | yolo_v3_tiny | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 848.13 | 486.75 | 1.844 | 30.290 | 460 | 28 | 1 | 460 | 28 | 1.49 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 435 | yolo_v3_tiny | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 385.72 | 295.7 | 0.839 | 13.776 | 460 | 28 | 1 | 460 | 28 | 3.49 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 436 | yolo_v3_tiny | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 157.69 | 44.37 | 2.719 | 13.141 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 437 | yolo_v3_tiny | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 76.67 | 39.39 | 1.144 | 6.389 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 438 | yolo_v3_tiny | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 278.96 | 94.29 | 2.607 | 18.597 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 439 | yolo_v3_tiny | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 463.1 | 156 | 1.087 | 16.539 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 440 | yolo_v3_tiny | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 268.09 | 83.42 | 0.547 | 17.873 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 441 | yolo_v3_tiny | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 637.55 | 196.89 | 1.27 | 14.168 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 442 | yolo_v3_tiny | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 385.39 | 145.52 | 0.838 | 13.764 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 443 | yolo_v3_tiny | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 0.913 | 15.648 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||
| 444 | end_rec | ||||||||||||||||||||||||
| 445 | begin_rec | FPS | FPS/$ | FPS/TDP | msec. | ||||||||||||||||||||
| 446 | yolo_v8n | OV-2024.1 | atom | Intel Atom® x7425E CPU-only | 21.78 | 12.67 | 0.376 | 1.815 | 58 | 12 | 1 | 58 | 12 | 47.42 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 447 | yolo_v8n | OV-2024.1 | atom | Intel® Atom® X6425E CPU-only | 10.31 | 5.12 | 0.154 | 0.859 | 67 | 12 | 1 | 67 | 12 | 100.34 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 448 | yolo_v8n | OV-2024.1 | atom | Intel® Celeron® 6305E CPU-only | 25.75 | 9.61 | 0.241 | 1.717 | 107 | 15 | 1 | 107 | 15 | 40.42 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 449 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i3-8100 CPU-only | 53.77 | 33.07 | 0.46 | 0.827 | 117 | 65 | 1 | 117 | 65 | 19.03 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 450 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i5-10500TE CPU-only | 81.47 | 47.23 | 0.381 | 2.328 | 214 | 35 | 1 | 214 | 35 | 13.51 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 451 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i5-13600K CPU-only | 274.23 | 104.01 | 0.834 | 2.194 | 329 | 125 | 1 | 329 | 125 | 5.24 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 452 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i5-8500 CPU-only | 84.95 | 50.55 | 0.442 | 1.307 | 192 | 65 | 1 | 192 | 65 | 11.79 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 453 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i7-1185G7 CPU-only | 111.72 | 40.8 | 0.262 | 3.99 | 426 | 28 | 1 | 426 | 28 | 10.32 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 454 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i7-1185GRE CPU-only | 76.65 | 27.77 | 0.156 | 5.11 | 490 | 15 | 1 | 490 | 15 | 13.29 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 455 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i7-12700H CPU-only | 200.31 | 78.26 | 0.399 | 4.451 | 502 | 45 | 1 | 502 | 45 | 6.6 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 456 | yolo_v8n | OV-2024.1 | core | Intel® Core Ultra 7-165H CPU-only | 111.98 | 43.58 | 0.243 | 3.999 | 460 | 28 | 1 | 460 | 28 | 15.57 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 457 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i7-1360P CPU-only | 146.27 | 58.61 | 0.305 | 5.224 | 480 | 28 | 1 | 480 | 28 | 9.38 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 458 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i7-8700T CPU-only | 71.7 | 42.55 | 0.237 | 2.049 | 303 | 35 | 1 | 303 | 35 | 16.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 459 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i9-10900TE CPU-only | 91.26 | 52.18 | 0.187 | 2.607 | 488 | 35 | 1 | 488 | 35 | 12.67 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 460 | yolo_v8n | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 399.04 | 160.07 | 0.666 | 3.192 | 599 | 125 | 1 | 599 | 125 | 4.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 461 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® W1290P CPU-only | 139.82 | 75.14 | 0.235 | 1.119 | 594 | 125 | 1 | 594 | 125 | 9.01 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 462 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® E-2124G CPU-only | 52.41 | 32.95 | 0.104 | 0.738 | 506 | 71 | 1 | 506 | 71 | 19.28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 463 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Gold 5218T CPU-only | 440.97 | 174.8 | 0.14 | 2.1 | 3144 | 210 | 2 | 1572 | 105 | 5.91 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 464 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Platinum 8270 CPU-only | 982.78 | 459.27 | 0.058 | 2.397 | 16954 | 410 | 2 | 8477 | 205 | 3.59 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 465 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 1691.89 | 591.34 | 0.09 | 3.133 | 18718 | 540 | 2 | 9359 | 270 | 2.4 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 466 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 2527.39 | 1003.33 | 0.074 | 3.611 | 34000 | 700 | 2 | 17000 | 350 | 3.37 | FPS | FPS/$ | FPS/TDP | msec. | 2.66 | 2510.06 | |||||
| 467 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 3515.52 | 1295.71 | 0.164 | 5.022 | 21420 | 700 | 2 | 10710 | 350 | 3.46 | FPS | FPS/$ | FPS/TDP | msec. | 2.9 | 3748.24 | |||||
| 468 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Silver 4216R CPU-only | 421.5 | 166.81 | 0.208 | 2.007 | 2022 | 210 | 2 | 1011 | 105 | 6.19 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 469 | yolo_v8n | OV-2024.1 | xeon | Intel® Xeon® Silver 4316 CPU-only | 850.58 | 344.09 | 0.374 | 2.835 | 2274 | 300 | 2 | 1137 | 150 | 3.28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 470 | yolo_v8n | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 1567.08 | 1461.72 | 0.814 | 10.447 | 1925 | 150 | 1 | 1925 | 150 | 10.02 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 471 | yolo_v8n | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 1319.65 | 1224.24 | 4.111 | 8.798 | 321 | 150 | 1 | 321 | 150 | 12.04 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 472 | yolo_v8n | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 305.49 | 304.48 | 0.161 | 4.073 | 1900 | 75 | 1 | 1900 | 75 | 52.35 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 473 | yolo_v8n | OV-2024.1 | atom-iGPU | Intel Atom® x7425E iGPU-only | 62.91 | 42.77 | 1.085 | 5.243 | 58 | 12 | 1 | 58 | 12 | 63.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 474 | yolo_v8n | OV-2024.1 | atom-iGPU | Intel® Atom® X6425E iGPU-only | 32.98 | 34.69 | 0.492 | 2.748 | 67 | 12 | 1 | 67 | 12 | 120.7 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 475 | yolo_v8n | OV-2024.1 | atom-iGPU | Intel® Celeron® 6305E iGPU-only | 124.24 | 82.5 | 1.161 | 8.283 | 107 | 15 | 1 | 107 | 15 | 32.05 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 476 | yolo_v8n | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185G7 iGPU-only | 168.65 | 115.68 | 0.396 | 6.023 | 426 | 28 | 1 | 426 | 28 | 23.26 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 477 | yolo_v8n | OV-2024.1 | core-iGPU | Intel® Core™ i7-1185GRE iGPU-only | 119.07 | 78.11 | 0.243 | 7.938 | 490 | 15 | 1 | 490 | 15 | 33.07 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 478 | yolo_v8n | OV-2024.1 | core-iGPU | Intel® Core™ i7-12700H iGPU-only | 219.57 | 148.58 | 0.437 | 4.879 | 502 | 45 | 1 | 502 | 45 | 17.93 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 479 | yolo_v8n | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H iGPU-only | 371.68 | 269.56 | 0.808 | 13.274 | 460 | 28 | 1 | 460 | 28 | 3.27 | FPS | FPS/$ | FPS/TDP | msec. | |||||||
| 480 | yolo_v8n | OV-2024.1 | core-iGPU | Intel® Core Ultra 7-165H NPU-only | 95.73 | 0 | 0 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | |||||||||
| 481 | yolo_v8n | OV-2024.1 | atom-CPU+iGPU | Intel Atom® x7425E CPU+iGPU | 70.5 | 25.48 | 1.216 | 5.875 | 58 | 12 | 1 | 58 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 482 | yolo_v8n | OV-2024.1 | atom-CPU+iGPU | Intel® Atom® X6425E CPU+iGPU | 37.59 | 22.29 | 0.561 | 3.133 | 67 | 12 | 1 | 67 | 12 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 483 | yolo_v8n | OV-2024.1 | atom-CPU+iGPU | Intel® Celeron® 6305E CPU+iGPU | 115.22 | 50.8 | 1.077 | 7.681 | 107 | 15 | 1 | 107 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 484 | yolo_v8n | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185G7 CPU+iGPU | 195.06 | 81.02 | 0.458 | 6.966 | 426 | 28 | 1 | 426 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 485 | yolo_v8n | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1185GRE CPU+iGPU | 105.21 | 41.22 | 0.215 | 7.014 | 490 | 15 | 1 | 490 | 15 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 486 | yolo_v8n | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-12700H CPU+iGPU | 275.44 | 104.07 | 0.549 | 6.121 | 502 | 45 | 1 | 502 | 45 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 487 | yolo_v8n | OV-2024.1 | core-CPU+iGPU | Intel® Core Ultra 7-165H CPU+iGPU | 191.74 | 112.77 | 0.417 | 6.848 | 460 | 28 | 1 | 460 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 488 | yolo_v8n | OV-2024.1 | core-CPU+iGPU | Intel® Core™ i7-1360P CPU+iGPU | 222.63 | 85.92 | 0.464 | 7.951 | 480 | 28 | 1 | 480 | 28 | FPS | FPS/$ | FPS/TDP | msec. | ||||||||
| 489 | end_rec | ||||||||||||||||||||||||
| 490 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||||||||||
| 491 | chatglm2-6b | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 10.2 | 2.6 | 599 | 125 | 1 | 599 | 125 | 98.16 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 380.32 | 71.01 | 14.1 | ||||||
| 492 | chatglm2-6b | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 9 | 4.7 | 18718 | 540 | 2 | 9359 | 270 | 110.86 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 212.03 | 75.89 | 13.2 | ||||||
| 493 | chatglm2-6b | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 23 | 16.3 | 34000 | 700 | 2 | 17000 | 350 | 43.57 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 61.52 | 32.6 | 30.7 | ||||||
| 494 | chatglm2-6b | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 28.4 | 18.8 | 21420 | 700 | 2 | 10710 | 350 | 35.2 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 53.3 | 27 | 37 | ||||||
| 495 | chatglm2-6b | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 22.2 | 1925 | 150 | 1 | 1925 | 150 | 45.07 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 44.31 | 22.6 | ||||||||
| 496 | chatglm2-6b | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 14.1 | 321 | 150 | 1 | 321 | 150 | 70.76 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 64.66 | 15.5 | ||||||||
| 497 | chatglm2-6b | OV-2024.1 | accel | Intel® Core Ultra 7-165H iGPU-only | 10.2 | 5.4 | 460 | 28 | 1 | 460 | 28 | 97.7 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 184.8 | 76.8 | 13 | ||||||
| 498 | end_rec | ||||||||||||||||||||||||
| 499 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||||||||||
| 500 | llama-2-7b-chat | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 8.5 | 2.2 | 599 | 125 | 1 | 599 | 125 | 117.23 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 456.25 | 80.37 | 12.4 | ||||||
| 501 | llama-2-7b-chat | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 9.3 | 3.6 | 18718 | 540 | 2 | 9359 | 270 | 107.25 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 275.08 | 62.45 | 16 | ||||||
| 502 | llama-2-7b-chat | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 19.2 | 13.4 | 34000 | 700 | 2 | 17000 | 350 | 52.04 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 74.82 | 38.42 | 26 | ||||||
| 503 | llama-2-7b-chat | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 23.3 | 15.7 | 21420 | 700 | 2 | 10710 | 350 | 43 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 63.7 | 33.1 | 30.2 | ||||||
| 504 | llama-2-7b-chat | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 15.1 | 321 | 150 | 1 | 321 | 150 | 66.12 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 58.42 | 17.1 | ||||||||
| 505 | llama-2-7b-chat | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 9.3 | 8.6 | 1925 | 150 | 1 | 1925 | 150 | 107.27 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 116.54 | 51 | 19.6 | ||||||
| 506 | llama-2-7b-chat | OV-2024.1 | accel | Intel® Core Ultra 7-165H iGPU-only | 8.3 | 3.9 | 460 | 28 | 1 | 460 | 28 | 119.9 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 255.3 | 87.9 | 11.4 | ||||||
| 507 | end_rec | ||||||||||||||||||||||||
| 508 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||||||||||
| 509 | mistral-7b-v0.1 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 8.4 | 2.1 | 599 | 125 | 1 | 599 | 125 | 119.7 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 475.69 | 69.39 | 14.4 | ||||||
| 510 | mistral-7b-v0.1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 6.8 | 3.7 | 18718 | 540 | 2 | 9359 | 270 | 147.9 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 268.34 | 81.12 | 12.3 | ||||||
| 511 | mistral-7b-v0.1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 19 | 12.8 | 34000 | 700 | 2 | 17000 | 350 | 52.76 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 78.25 | 36.25 | 27.6 | ||||||
| 512 | mistral-7b-v0.1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 22.2 | 14.9 | 21420 | 700 | 2 | 10710 | 350 | 45.1 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 66.9 | 31 | 32.2 | ||||||
| 513 | mistral-7b-v0.1 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 10.9 | 321 | 150 | 1 | 321 | 150 | 91.77 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 80.23 | 12.5 | ||||||||
| 514 | mistral-7b-v0.1 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 1900 | 75 | 1 | 1900 | 75 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 256.28 | 3.9 | ||||||||||
| 515 | mistral-7b-v0.1 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 10.9 | 1925 | 150 | 1 | 1925 | 150 | 91.77 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 80.23 | 12.5 | ||||||||
| 516 | mistral-7b-v0.1 | OV-2024.1 | accel | Intel® Core Ultra 7-165H iGPU-only | 5.4 | 3.5 | 460 | 28 | 1 | 460 | 28 | 184.4 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 288.3 | 132.9 | 7.5 | ||||||
| 517 | end_rec | ||||||||||||||||||||||||
| 518 | begin_rec | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||||||||||
| 519 | falcon-7b-instruct | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 8.1 | 599 | 125 | 1 | 599 | 125 | 123.8 | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||
| 520 | falcon-7b-instruct | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 18718 | 540 | 2 | 9359 | 270 | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||
| 521 | falcon-7b-instruct | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 20.4 | 34000 | 700 | 2 | 17000 | 350 | 49.1 | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||
| 522 | falcon-7b-instruct | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 24 | 16.1 | 21420 | 700 | 2 | 10710 | 350 | 41.7 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 62.1 | ||||||||
| 523 | falcon-7b-instruct | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 14.3 | 321 | 150 | 1 | 321 | 150 | 69.7 | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||
| 524 | falcon-7b-instruct | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 1900 | 75 | 1 | 1900 | 75 | msec/token | msec/token/$ | msec/token/TDP | msec/token | ||||||||||||
| 525 | falcon-7b-instruct | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 20.5 | 1925 | 150 | 1 | 1925 | 150 | 48.69 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 42.21 | 23.7 | ||||||||
| 526 | falcon-7b-instruct | OV-2024.1 | accel | Intel® Core Ultra 7-165H iGPU-only | 9 | 5.1 | 460 | 28 | 1 | 460 | 28 | 111.18 | msec/token | msec/token/$ | msec/token/TDP | msec/token | 197.6 | 76.6 | 13.1 | ||||||
| 527 | end_rec | ||||||||||||||||||||||||
| 528 | begin_rec | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | ||||||||||||||||||||
| 529 | stable-diffusion-v2-1 | OV-2024.1 | core | Intel® Core™ i9-13900K CPU-only | 599 | 125 | 1 | 599 | 125 | 42.45 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 41.87 | ||||||||||
| 530 | stable-diffusion-v2-1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8380 CPU-only | 18718 | 540 | 2 | 9359 | 270 | 21.71 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 20.79 | ||||||||||
| 531 | stable-diffusion-v2-1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8490H CPU-only | 34000 | 700 | 2 | 17000 | 350 | 4.15 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 4.03 | ||||||||||
| 532 | stable-diffusion-v2-1 | OV-2024.1 | xeon | Intel® Xeon® Platinum 8580 CPU-only | 21420 | 700 | 2 | 10710 | 350 | 3.9 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 3.7 | ||||||||||
| 533 | stable-diffusion-v2-1 | OV-2024.1 | accel | Intel® Arc™ A-770M Graphics dGPU | 321 | 150 | 1 | 321 | 150 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 4.43 | |||||||||||
| 534 | stable-diffusion-v2-1 | OV-2024.1 | accel | Intel® Data Center GPU Flex 140 dGPU | 1900 | 75 | 1 | 1900 | 75 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 37.45 | |||||||||||
| 535 | stable-diffusion-v2-1 | OV-2024.1 | accel | Intel® Data Center GPU Flex 170 dGPU | 1925 | 150 | 1 | 1925 | 150 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 4.42 | |||||||||||
| 536 | stable-diffusion-v2-1 | OV-2024.1 | accel | Intel® Core Ultra 7-165H iGPU-only | 460 | 28 | 1 | 460 | 28 | 16.6 | Generation time, sec. | Generation time/$ | Generation time/TDP | Generation time, sec. | 15.9 | ||||||||||
| 537 | end_rec |