4.8 KiB
4.8 KiB
| 1 | Network model | Release | IE-Type | Platform name | Throughput-OVMS-INT8 | Throughput-OV-INT8 | Throughput-OVMS-FP32 | Throughput-OV-FP32 | UOM_T |
|---|---|---|---|---|---|---|---|---|---|
| 2 | begin_rec | ||||||||
| 3 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 476.413 | 492.202 | 181.088 | 181.699 | FPS |
| 4 | bert-base-cased | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 426.087 | 444.057 | 161.123 | 163.048 | FPS |
| 5 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 162.953 | 177.975 | 53.133 | 58.18 | FPS |
| 6 | bert-base-cased | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 26.038 | 26.159 | 17.201 | 17.357 | FPS |
| 7 | end_rec | ||||||||
| 8 | begin_rec | ||||||||
| 9 | bert-large-uncased | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 41.919 | 42.236 | 14.896 | 14.33 | FPS |
| 10 | bert-large-uncased | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 37.289 | 37.704 | 13.063 | 12.897 | FPS |
| 11 | bert-large-uncased | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 14.046 | 14.276 | 5.033 | 4.96 | FPS |
| 12 | bert-large-uncased | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 2.428 | 2.401 | 1.446 | 1.432 | FPS |
| 13 | end_rec | ||||||||
| 14 | begin_rec | ||||||||
| 15 | Efficientdet-D0 | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 423.3 | 466.485 | 284.666 | 287.182 | FPS |
| 16 | Efficientdet-D0 | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 352.495 | 389.158 | 210.714 | 202.001 | FPS |
| 17 | Efficientdet-D0 | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 151.702 | 178.273 | 58.861 | 61.524 | FPS |
| 18 | Efficientdet-D0 | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 46.985 | 49.806 | 27.872 | 28.841 | FPS |
| 19 | end_rec | ||||||||
| 20 | begin_rec | ||||||||
| 21 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 6.472 | 6.468 | 1.97 | 1.889 | FPS |
| 22 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 5.443 | 5.46 | 1.743 | 1.62 | FPS |
| 23 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 2.035 | 2.023 | 0.555 | 0.531 | FPS |
| 24 | mask_rcnn_resnet50_atrous_coco | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 0.379 | 0.351 | 0.249 | 0.215 | FPS |
| 25 | end_rec | ||||||||
| 26 | begin_rec | ||||||||
| 27 | Mobilenet-V2 | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 7586.42 | 12368.284 | 3342.938 | 3909.837 | FPS |
| 28 | Mobilenet-V2 | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 7371.605 | 10620.061 | 2651.393 | 3168.019 | FPS |
| 29 | Mobilenet-V2 | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 1888.454 | 4239.691 | 877.888 | 1072.947 | FPS |
| 30 | Mobilenet-V2 | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 626.817 | 715.776 | 435.043 | 512.516 | FPS |
| 31 | end_rec | ||||||||
| 32 | begin_rec | ||||||||
| 33 | Resnet-50 | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 2353.23 | 2487.25 | 639.118 | 645.669 | FPS |
| 34 | Resnet-50 | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 2084.709 | 2248.889 | 558.128 | 546.481 | FPS |
| 35 | Resnet-50 | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 794.725 | 940.482 | 205.072 | 199.384 | FPS |
| 36 | Resnet-50 | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 114.636 | 118.435 | 59.034 | 60.112 | FPS |
| 37 | end_rec | ||||||||
| 38 | begin_rec | ||||||||
| 39 | SSD-Resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 44.428 | 47.308 | 12.103 | 12.229 | FPS |
| 40 | SSD-Resnet34-1200 | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 38.586 | 40.72 | 10.507 | 10.619 | FPS |
| 41 | SSD-Resnet34-1200 | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 16.863 | 17.476 | 4.217 | 4.271 | FPS |
| 42 | SSD-Resnet34-1200 | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 1.955 | 1.935 | 1.142 | 1.121 | FPS |
| 43 | end_rec | ||||||||
| 44 | begin_rec | ||||||||
| 45 | SSD_Mobilenet_V1_Coco | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 4720.423 | 4991.46 | 1364.141 | 1392.376 | FPS |
| 46 | SSD_Mobilenet_V1_Coco | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 4067.035 | 4228.271 | 1096.362 | 1112.343 | FPS |
| 47 | SSD_Mobilenet_V1_Coco | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 1519.287 | 1785.937 | 408.959 | 442.492 | FPS |
| 48 | SSD_Mobilenet_V1_Coco | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 256.837 | 265.931 | 135.537 | 139.551 | FPS |
| 49 | end_rec | ||||||||
| 50 | begin_rec | ||||||||
| 51 | Unet-Camvid--0001 | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 71.937 | 78.1 | 17.787 | 18.034 | FPS |
| 52 | Unet-Camvid--0001 | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 62.515 | 66.299 | 15.47 | 15.6 | FPS |
| 53 | Unet-Camvid--0001 | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 26.386 | 27.506 | 5.861 | 5.932 | FPS |
| 54 | Unet-Camvid--0001 | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 2.958 | 2.941 | 1.844 | 1.825 | FPS |
| 55 | end_rec | ||||||||
| 56 | begin_rec | ||||||||
| 57 | Yolo_V3_Tiny | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 1864.709 | 2323.356 | 776.774 | 786.171 | FPS |
| 58 | Yolo_V3_Tiny | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 1536.778 | 2031.428 | 594.33 | 602.848 | FPS |
| 59 | Yolo_V3_Tiny | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 480.953 | 863.418 | 211.699 | 248.475 | FPS |
| 60 | Yolo_V3_Tiny | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 119.656 | 133.278 | 70.525 | 75.039 | FPS |
| 61 | end_rec | ||||||||
| 62 | begin_rec | ||||||||
| 63 | Yolo_V8n | OV-2024.1 | xeon | Intel® Xeon® 8260M CPU-only | 676.683 | 836.562 | 315.786 | 388.673 | FPS |
| 64 | Yolo_V8n | OV-2024.1 | xeon | Intel® Xeon® Gold 6238M CPU-only | 500.88 | 702.198 | 264.887 | 318.088 | FPS |
| 65 | Yolo_V8n | OV-2024.1 | core | Intel® Core™ i9-10920X CPU-only | 176.708 | 269.617 | 91.142 | 112.079 | FPS |
| 66 | Yolo_V8n | OV-2024.1 | core | Intel® Core™ i3-10100 CPU-only | 57.891 | 67.784 | 37.688 | 40.711 | FPS |
| 67 | end_rec |