natas_hw
/
openvino
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[DOCS] benchmarks new page port 22.3 (#16620) (#17252) 

port 3 PRs to recreate the new benchmark page:
16984, 16620, 16862

Port css style, html modal, and fix 1 POT link for benchmarks from master.

port 1 install guide fix:
16572
This commit is contained in:
Karol Blaszczak 2023-04-27 15:46:27 +02:00 committed by GitHub
parent 2deaccc02f
commit bdadcd7583
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
16 changed files with 1564 additions and 1118 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

BIN
docs/_static/benchmarks_files/OV-2022.3-Performance-Data.xlsx vendored
View File

Binary file not shown.

BIN
docs/_static/benchmarks_files/OV-2022.3-system-info-detailed.xlsx vendored
View File

Binary file not shown.

932
docs/_static/benchmarks_files/benchmark-data.csv → docs/_static/benchmarks_files/OV-benchmark-data.csv vendored
View File

@ -1,421 +1,511 @@
Network model,Release,IE-Type,Platform name,Throughput-INT8,Throughput-FP16,Throughput-FP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency
begin_rec,,,,,,,,,,,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,96.06,,35.627,0.146,0.582,$658 ,165,1,$658 ,165,17.1432
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,53.093,,22.253,0.081,0.322,$658 ,165,1,$658 ,165,22.0002
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,108.306,,44.797,0.165,0.656,$658 ,165,1,$658 ,165,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,2.763,,1.332,0.081,0.291,$34 ,9.5,1,$34 ,9.5,350.2746
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.694,,2.002,0.085,0.475,$67 ,12,1,$67 ,12,183.1711
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,16.11,,10.009,0.24,1.343,$67 ,12,1,$67 ,12,79.7607
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.128,,11.81,0.315,1.761,$67 ,12,1,$67 ,12,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,14.212,,4.255,0.12,0.947,$118 ,15,1,$118 ,15,72.6516
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,18.983,,8.696,0.161,1.266,$118 ,15,1,$118 ,15,62.9729
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,30.866,,12.087,0.262,2.058,$118 ,15,1,$118 ,15,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,645.77,,213.877,0.138,1.745,"$4,678 ",370,2,"$2,339 ",185,6.7612
bert-base-cased ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,23.721,,14.457,0.203,0.365,$117 ,65,1,$117 ,65,44.0371
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,30.141,,16.38,0.141,0.861,$214 ,35,1,$214 ,35,46.6064
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,30.541,,19.319,0.159,0.47,$192 ,65,1,$192 ,65,27.8871
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,41.504,,22.75,0.137,1.186,$303 ,35,1,$303 ,35,27.974
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,32.073,,16.558,0.066,0.916,$488 ,35,1,$488 ,35,39.7617
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,69.053,,40.243,0.116,0.552,$594 ,125,1,$594 ,125,18.309
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,23.402,,14.614,0.094,0.33,$249 ,71,1,$249 ,71,44.8984
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,266.949,,79.033,0.085,1.271,"$3,144 ",210,2,"$1,572 ",105,12.4065
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,2090.76,,326.55,0.292,4.646,"$7,166 ",450,2,"$3,583 ",225,4.61
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,682.593,,225.713,0.04,1.665,"$16,954 ",410,2,"$8,477 ",205,6.9035
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,256.994,,75.502,0.128,1.028,"$2,004 ",250,2,"$1,002 ",125,13.0382
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.632,,18.394,0.138,2.308,$469 ,28,1,$469 ,28,17.638
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,95.656,,44.056,0.204,3.416,$469 ,28,1,$469 ,28,14.1005
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,128.005,,50.592,0.273,4.572,$469 ,28,1,$469 ,28,
bert-base-cased ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,906.3,348.52,,0.471,6.042,"$1,925 ",150,1,"$1,925 ",150,7.381
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,7.714,,3.093,0.012,0.047,$658 ,165,1,$658 ,165,155.3633
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,5.617,,1.978,0.009,0.034,$658 ,165,1,$658 ,165,181.8303
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,10.602,,3.753,0.016,0.064,$658 ,165,1,$658 ,165,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.272,,0.125,0.008,0.029,$34 ,9.5,1,$34 ,9.5,3861.0657
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.488,,0.188,0.007,0.041,$67 ,12,1,$67 ,12,2090.8266
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.395,,0.774,0.021,0.116,$67 ,12,1,$67 ,12,727.6781
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.827,,0.845,0.027,0.152,$67 ,12,1,$67 ,12,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.199,,0.377,0.01,0.08,$118 ,15,1,$118 ,15,831.301
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.051,,0.766,0.017,0.137,$118 ,15,1,$118 ,15,494.5363
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,3.118,,1.127,0.026,0.208,$118 ,15,1,$118 ,15,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,43.436,,17.379,0.009,0.117,"$4,678 ",370,2,"$2,339 ",185,52.2862
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.067,,1.278,0.018,0.032,$117 ,65,1,$117 ,65,495.0786
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,2.619,,1.536,0.012,0.075,$214 ,35,1,$214 ,35,502.3687
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.72,,1.679,0.014,0.042,$192 ,65,1,$192 ,65,320.168
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,3.625,,2.11,0.012,0.104,$303 ,35,1,$303 ,35,309.2848
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.906,,1.693,0.006,0.083,$488 ,35,1,$488 ,35,386.4947
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.801,,2.729,0.008,0.038,$594 ,125,1,$594 ,125,200.0794
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.098,,1.32,0.008,0.03,$249 ,71,1,$249 ,71,492.0938
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,21.062,,7.021,0.007,0.1,"$3,144 ",210,2,"$1,572 ",105,101.4694
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,651.95,,91.18,0.091,1.449,"$7,166 ",450,2,"$3,583 ",225,12.87
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.064,,19.051,0.003,0.112,"$16,954 ",410,2,"$8,477 ",205,49.4869
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,20.014,,6.726,0.01,0.08,"$2,004 ",250,2,"$1,002 ",125,105.9423
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,5.192,,1.626,0.011,0.185,$469 ,28,1,$469 ,28,203.6311
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,10.476,,3.914,0.022,0.374,$469 ,28,1,$469 ,28,95.6598
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,11.75,,4.168,0.025,0.42,$469 ,28,1,$469 ,28,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,74.47,25.77,,0.039,0.496,"$1,925 ",150,1,"$1,925 ",150,19.768
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,99.078,,36.552,0.151,0.6,$658 ,165,1,$658 ,165,11.269
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,57.707,,13.789,0.088,0.35,$658 ,165,1,$658 ,165,16.263
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,115.59,,39.82,0.176,0.701,$658 ,165,1,$658 ,165,
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.327,,1.496,0.098,0.35,$34 ,9.5,1,$34 ,9.5,308.0916
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,6.07,,3.041,0.091,0.506,$67 ,12,1,$67 ,12,166.5404
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,5.196,0,0,$67 ,12,1,$67 ,12,217.0439
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,9.877,,7.145,0.147,0.823,$67 ,12,1,$67 ,12,
deeplabv3,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,13.516,,4.681,0.115,0.901,$118 ,15,1,$118 ,15,74.1061
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,22.35,,4.635,0.189,1.49,$118 ,15,1,$118 ,15,42.9657
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,34.576,,8.955,0.293,2.305,$118 ,15,1,$118 ,15,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,559.145,,134.159,0.12,1.511,"$4,678 ",370,2,"$2,339 ",185,5.356
deeplabv3,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,27.171,,15.947,0.232,0.418,$117 ,65,1,$117 ,65,36.6584
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,34.907,,16.72,0.163,0.997,$214 ,35,1,$214 ,35,38.8986
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,35.07,,20.497,0.183,0.54,$192 ,65,1,$192 ,65,22.1865
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,47.647,,23.747,0.157,1.361,$303 ,35,1,$303 ,35,22.628
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,36.559,,18.235,0.075,1.045,$488 ,35,1,$488 ,35,27.138
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,79.42,,21.03,0.134,0.635,$594 ,125,1,$594 ,125,12.8397
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,26.173,,16.906,0.105,0.369,$249 ,71,1,$249 ,71,37.9245
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,248.049,,81.667,0.079,1.181,"$3,144 ",210,2,"$1,572 ",105,8.9485
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,1139.5,,271.62,0.159,2.532,"$7,166 ",450,2,"$3,583 ",225,2.47
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,632.113,,168.65,0.037,1.542,"$16,954 ",410,2,"$8,477 ",205,4.0073
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,241.703,,78.963,0.121,0.967,"$2,004 ",250,2,"$1,002 ",125,9.356
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.13,,18.519,0.137,2.29,$469 ,28,1,$469 ,28,16.6586
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,104.926,,24.592,0.224,3.747,$469 ,28,1,$469 ,28,9.1435
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,121.441,,30.498,0.259,4.337,$469 ,28,1,$469 ,28,
deeplabv3,OV-2022.3-8991,accel,Intel® Flex-170 GPU,882.04,98.95,,0.458,5.88,"$1,925 ",150,1,"$1,925 ",150,2.674
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,457.193,,165.166,0.695,2.771,$658 ,165,1,$658 ,165,3.141
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,203.417,,68.438,0.309,1.233,$658 ,165,1,$658 ,165,6.6728
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,575.442,,179.858,0.875,3.488,$658 ,165,1,$658 ,165,
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,13.344,,5.882,0.392,1.405,$34 ,9.5,1,$34 ,9.5,80.7014
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,24.172,,10.554,0.361,2.014,$67 ,12,1,$67 ,12,43.668
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,30.615,0,0,$67 ,12,1,$67 ,12,30.0241
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,39.365,,38.926,0.588,3.28,$67 ,12,1,$67 ,12,
densenet-121,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,58.965,,15.713,0.5,3.931,$118 ,15,1,$118 ,15,18.3425
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,86.162,,25.34,0.73,5.744,$118 ,15,1,$118 ,15,20.7907
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.891,,39.929,1.194,9.393,$118 ,15,1,$118 ,15,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,3094.742,,701.32,0.662,8.364,"$4,678 ",370,2,"$2,339 ",185,2.131
densenet-121,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,120.121,,66.624,1.027,1.848,$117 ,65,1,$117 ,65,9.3755
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,142.623,,80.872,0.666,4.075,$214 ,35,1,$214 ,35,10.2536
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,149.112,,85.051,0.777,2.294,$192 ,65,1,$192 ,65,6.0817
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,194.559,,111.988,0.642,5.559,$303 ,35,1,$303 ,35,6.1906
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,146.463,,69.186,0.3,4.185,$488 ,35,1,$488 ,35,8.6496
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,360.501,,182.543,0.607,2.884,$594 ,125,1,$594 ,125,3.6046
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,114.844,,67.188,0.461,1.618,$249 ,71,1,$249 ,71,9.7609
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1116.372,,295.952,0.355,5.316,"$3,144 ",210,2,"$1,572 ",105,3.9606
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,8279.14,,1137.41,1.155,18.398,"$7,166 ",450,2,"$3,583 ",225,2.39
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,3155.106,,815.725,0.186,7.695,"$16,954 ",410,2,"$8,477 ",205,2.8831
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1064.824,,283.423,0.531,4.259,"$2,004 ",250,2,"$1,002 ",125,4.0689
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,265.167,,74.501,0.565,9.47,$469 ,28,1,$469 ,28,4.7413
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,391.185,,123.519,0.834,13.971,$469 ,28,1,$469 ,28,6.5259
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,526.12,,150.35,1.122,18.79,$469 ,28,1,$469 ,28,
densenet-121,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3440.18,1178.68,,1.787,22.935,"$1,925 ",150,1,"$1,925 ",150,3.302
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,112.297,,64.06,0.171,0.681,$658 ,165,1,$658 ,165,11.8265
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,73.766,,38.742,0.112,0.447,$658 ,165,1,$658 ,165,21.403
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,128.735,,76.62,0.196,0.78,$658 ,165,1,$658 ,165,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.812,,2.565,0.112,0.401,$34 ,9.5,1,$34 ,9.5,274.5947
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,7.248,,5.17,0.108,0.604,$67 ,12,1,$67 ,12,143.7999
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,22.697,,15.635,0.339,1.891,$67 ,12,1,$67 ,12,59.0651
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,26.855,,17.296,0.401,2.238,$67 ,12,1,$67 ,12,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.949,,10.417,0.135,1.063,$118 ,15,1,$118 ,15,62.2765
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,25.936,,14.073,0.22,1.729,$118 ,15,1,$118 ,15,54.0166
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,32.767,,20.733,0.278,2.184,$118 ,15,1,$118 ,15,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,424.388,,256.503,0.091,1.147,"$4,678 ",370,2,"$2,339 ",185,
efficientdet-d0,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,36.666,,24.041,0.313,0.564,$117 ,65,1,$117 ,65,30.2521
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,45.331,,26.92,0.212,1.295,$214 ,35,1,$214 ,35,32.8946
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,44.921,,32.357,0.234,0.691,$192 ,65,1,$192 ,65,19.7048
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,62.749,,37.807,0.207,1.793,$303 ,35,1,$303 ,35,19.901
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,50.35,,29.935,0.103,1.439,$488 ,35,1,$488 ,35,24.2916
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,94.981,,36.434,0.16,0.76,$594 ,125,1,$594 ,125,12.658
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,35.831,,27.306,0.144,0.505,$249 ,71,1,$249 ,71,30.9469
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,239.06,,161.224,0.076,1.138,"$3,144 ",210,2,"$1,572 ",105,13.9735
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,875.53,,560.48,0.122,1.946,"$7,166 ",450,2,"$3,583 ",225,5.07
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,471.02,,300.291,0.028,1.149,"$16,954 ",410,2,"$8,477 ",205,9.3866
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,231.873,,156.285,0.116,0.927,"$2,004 ",250,2,"$1,002 ",125,14.1605
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.482,,41.123,0.152,2.553,$469 ,28,1,$469 ,28,16.6952
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,92.52,,50.538,0.197,3.304,$469 ,28,1,$469 ,28,17.295
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,107.688,,56.901,0.23,3.846,$469 ,28,1,$469 ,28,
efficientdet-d0,OV-2022.3-8991,accel,Intel® Flex-170 GPU,463.67,295.13,,0.241,3.091,"$1,925 ",150,1,"$1,925 ",150,5.603
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,12.921,,4.016,0.02,0.078,$658 ,165,1,$658 ,165,89.8929
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,6.802,,1.82,0.01,0.041,$658 ,165,1,$658 ,165,149.7396
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,15.679,,4.499,0.024,0.095,$658 ,165,1,$658 ,165,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.32,,0.131,0.009,0.034,$34 ,9.5,1,$34 ,9.5,3206.1652
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.592,,0.242,0.009,0.049,$67 ,12,1,$67 ,12,1727.27
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.301,,0.728,0.019,0.108,$67 ,12,1,$67 ,12,776.0692
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.683,,0.865,0.025,0.14,$67 ,12,1,$67 ,12,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.563,,0.417,0.013,0.104,$118 ,15,1,$118 ,15,640.0005
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.616,,0.725,0.022,0.174,$118 ,15,1,$118 ,15,389.3563
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.056,,1.107,0.034,0.27,$118 ,15,1,$118 ,15,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,74.93,,19.965,0.016,0.203,"$4,678 ",370,2,"$2,339 ",185,65.5753
faster_rcnn_resnet50_coco,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.988,,1.473,0.026,0.046,$117 ,65,1,$117 ,65,340.7313
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.633,,1.926,0.017,0.104,$214 ,35,1,$214 ,35,430.1967
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.852,,1.982,0.02,0.059,$192 ,65,1,$192 ,65,241.5513
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.999,,2.648,0.016,0.143,$303 ,35,1,$303 ,35,260.2284
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,3.71,,2.005,0.008,0.106,$488 ,35,1,$488 ,35,280.1493
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,8.977,,4.542,0.015,0.072,$594 ,125,1,$594 ,125,137.1747
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.867,,1.464,0.012,0.04,$249 ,71,1,$249 ,71,353.2042
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.332,,8.19,0.009,0.14,"$3,144 ",210,2,"$1,572 ",105,78.1722
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,282.45,,32.43,0.003,0.044,"$7,166 ",450,2,"$3,583 ",225,12.03
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,85.213,,22.066,0.005,0.208,"$16,954 ",410,2,"$8,477 ",205,30.4317
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.847,,7.786,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,78.6604
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,7.027,,1.855,0.015,0.251,$469 ,28,1,$469 ,28,151.8783
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,13.823,,3.545,0.029,0.494,$469 ,28,1,$469 ,28,70.7933
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,16.898,,4.191,0.036,0.604,$469 ,28,1,$469 ,28,
faster_rcnn_resnet50_coco,OV-2022.3-8991,accel,Intel® Flex-170 GPU,216.3,23.42,,0.112,1.442,"$1,925 ",150,1,"$1,925 ",150,9.137
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,121.813,,39.391,0.185,0.738,$658 ,165,1,$658 ,165,11.0425
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,71.229,,17.755,0.108,0.432,$658 ,165,1,$658 ,165,19.7132
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,175.049,,44.894,0.266,1.061,$658 ,165,1,$658 ,165,
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.12,,1.344,0.092,0.328,$34 ,9.5,1,$34 ,9.5,335.3712
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.677,,2.364,0.085,0.473,$67 ,12,1,$67 ,12,181.8897
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,17.009,,8.302,0.254,1.417,$67 ,12,1,$67 ,12,78.0548
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.713,,10.37,0.324,1.809,$67 ,12,1,$67 ,12,
Inception-V4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.576,,4.073,0.132,1.038,$118 ,15,1,$118 ,15,65.7272
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,28.105,,6.681,0.238,1.874,$118 ,15,1,$118 ,15,46.2616
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,41.918,,10.163,0.355,2.795,$118 ,15,1,$118 ,15,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,881.403,,205.296,0.188,2.382,"$4,678 ",370,2,"$2,339 ",185,4.7029
Inception-V4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,30.004,,15.51,0.256,0.462,$117 ,65,1,$117 ,65,35.0513
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,35.882,,19.222,0.168,1.025,$214 ,35,1,$214 ,35,37.6472
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,37.987,,19.998,0.198,0.584,$192 ,65,1,$192 ,65,21.5144
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,48.903,,26.356,0.161,1.397,$303 ,35,1,$303 ,35,22.2402
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,37.301,,19.475,0.076,1.066,$488 ,35,1,$488 ,35,28.572
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,92.646,,44.966,0.156,0.741,$594 ,125,1,$594 ,125,12.3153
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,28.537,,15.13,0.115,0.402,$249 ,71,1,$249 ,71,36.8888
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,301.215,,77.005,0.096,1.434,"$3,144 ",210,2,"$1,572 ",105,10.5711
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,3406.7,,331.56,0.475,7.57,"$7,166 ",450,2,"$3,583 ",225,3.23
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,937.139,,225.776,0.055,2.286,"$16,954 ",410,2,"$8,477 ",205,5.6984
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,287.767,,73.617,0.144,1.151,"$2,004 ",250,2,"$1,002 ",125,11.1114
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.295,,18.482,0.152,2.546,$469 ,28,1,$469 ,28,15.8294
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,158.282,,36.884,0.337,5.653,$469 ,28,1,$469 ,28,10.6245
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,182.132,,44.198,0.388,6.505,$469 ,28,1,$469 ,28,
Inception-V4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,2986.91,298.6,,1.552,19.913,"$1,925 ",150,1,"$1,925 ",150,3.968
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,1054.462,,346.546,1.603,6.391,$658 ,165,1,$658 ,165,1.4898
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,493.088,,145.503,0.749,2.988,$658 ,165,1,$658 ,165,2.472
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1056.241,,361.472,1.605,6.401,$658 ,165,1,$658 ,165,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,28.032,,12.691,0.824,2.951,$34 ,9.5,1,$34 ,9.5,38.1991
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,50.352,,23.675,0.752,4.196,$67 ,12,1,$67 ,12,20.8993
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,100.377,,60.647,1.498,8.365,$67 ,12,1,$67 ,12,11.6812
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,148.458,,79.575,2.216,12.372,$67 ,12,1,$67 ,12,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,123.806,,38.981,1.049,8.254,$118 ,15,1,$118 ,15,8.4121
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,168.473,,53.272,1.428,11.232,$118 ,15,1,$118 ,15,7.8961
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,238.511,,83.721,2.021,15.901,$118 ,15,1,$118 ,15,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,6730.68,,1634.937,1.439,18.191,"$4,678 ",370,2,"$2,339 ",185,0.7265
mobilenet-ssd ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,244.598,,140.009,2.091,3.763,$117 ,65,1,$117 ,65,4.4481
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,303.938,,173.562,1.42,8.684,$214 ,35,1,$214 ,35,4.7946
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,304.802,,185.045,1.588,4.689,$192 ,65,1,$192 ,65,2.8007
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,412.261,,241.37,1.361,11.779,$303 ,35,1,$303 ,35,2.8749
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,315.107,,152.342,0.646,9.003,$488 ,35,1,$488 ,35,3.5896
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,774.346,,345.309,1.304,6.195,$594 ,125,1,$594 ,125,1.5452
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,233.43,,147.098,0.937,3.288,$249 ,71,1,$249 ,71,4.5879
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2331.207,,691.743,0.741,11.101,"$3,144 ",210,2,"$1,572 ",105,1.4852
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,16445.75,,2736.2,2.295,36.546,"$7,166 ",450,2,"$3,583 ",225,0.65
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6691.915,,1796.357,0.395,16.322,"$16,954 ",410,2,"$8,477 ",205,1.0518
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,2225.935,,667.692,1.111,8.904,"$2,004 ",250,2,"$1,002 ",125,1.5444
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,579.307,,166.959,1.235,20.69,$469 ,28,1,$469 ,28,2.0215
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,582.636,,243.945,1.242,20.808,$469 ,28,1,$469 ,28,2.548
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,744.231,,292.071,1.587,26.58,$469 ,28,1,$469 ,28,
mobilenet-ssd ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3548.98,1412.68,,1.844,23.66,"$1,925 ",150,1,"$1,925 ",150,1.344
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,2446.221,,1003.129,3.718,14.826,$658 ,165,1,$658 ,165,0.7182
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,1265.969,,389.894,1.924,7.673,$658 ,165,1,$658 ,165,1.3894
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,2680.458,,1013.049,4.074,16.245,$658 ,165,1,$658 ,165,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,81.572,,45.013,2.399,8.587,$34 ,9.5,1,$34 ,9.5,13.4692
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,143.134,,81.991,2.136,11.928,$67 ,12,1,$67 ,12,7.609
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,164.945,0,0,$67 ,12,1,$67 ,12,7.0306
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,227.898,,202.181,3.401,18.992,$67 ,12,1,$67 ,12,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,316.763,,124.654,2.684,21.118,$118 ,15,1,$118 ,15,3.391
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,525.084,,141.61,4.45,35.006,$118 ,15,1,$118 ,15,4.9197
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,807.397,,255.964,6.842,53.826,$118 ,15,1,$118 ,15,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,14679.84,,4065.139,3.138,39.675,"$4,678 ",370,2,"$2,339 ",185,0.4828
mobilenet-v2 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,619.507,,452.366,5.295,9.531,$117 ,65,1,$117 ,65,1.8067
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,806.314,,441.904,3.768,23.038,$214 ,35,1,$214 ,35,2.1078
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,766.072,,558.975,3.99,11.786,$192 ,65,1,$192 ,65,1.2307
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,1081.253,,664.108,3.568,30.893,$303 ,35,1,$303 ,35,1.2788
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,825.071,,413.091,1.691,23.573,$488 ,35,1,$488 ,35,1.6818
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,2067.162,,868.25,3.48,16.537,$594 ,125,1,$594 ,125,0.7363
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,594.283,,479.567,2.387,8.37,$249 ,71,1,$249 ,71,1.8531
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,5882.455,,1895.498,1.871,28.012,"$3,144 ",210,2,"$1,572 ",105,1.3871
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,28383.76,,7254.28,3.961,63.075,"$7,166 ",450,2,"$3,583 ",225,0.55
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,15616.083,,4308.927,0.921,38.088,"$16,954 ",410,2,"$8,477 ",205,0.8685
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,5616.283,,1835.686,2.803,22.465,"$2,004 ",250,2,"$1,002 ",125,1.404
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,1463.21,,538.597,3.12,52.258,$469 ,28,1,$469 ,28,0.8864
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,2076.015,,544.641,4.426,74.143,$469 ,28,1,$469 ,28,1.7212
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,2677.374,,698.942,5.709,95.621,$469 ,28,1,$469 ,28,
mobilenet-v2 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,18371.95,4738.33,,9.544,122.48,"$1,925 ",150,1,"$1,925 ",150,1.15
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,804.771,,212.574,1.223,4.877,$658 ,165,1,$658 ,165,1.3886
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,491.337,,146.839,0.747,2.978,$658 ,165,1,$658 ,165,2.2655
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1180.984,,365.777,1.795,7.157,$658 ,165,1,$658 ,165,
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,22.96,,9.564,0.675,2.417,$34 ,9.5,1,$34 ,9.5,44.5491
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,40.944,,16.158,0.611,3.412,$67 ,12,1,$67 ,12,25.1377
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,161.381,,60.863,2.409,13.448,$67 ,12,1,$67 ,12,10.983
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,197.477,,73.927,2.947,16.456,$67 ,12,1,$67 ,12,
resnet-18 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,105.574,,28.914,0.895,7.038,$118 ,15,1,$118 ,15,9.6165
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,194.694,,55.341,1.65,12.98,$118 ,15,1,$118 ,15,6.643
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,291.441,,82.105,2.47,19.429,$118 ,15,1,$118 ,15,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,5761.961,,1431.864,1.232,15.573,"$4,678 ",370,2,"$2,339 ",185,0.6512
resnet-18 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,208.65,,103.699,1.783,3.21,$117 ,65,1,$117 ,65,5.0231
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,252.987,,127.448,1.182,7.228,$214 ,35,1,$214 ,35,5.2921
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,262.785,,134.002,1.369,4.043,$192 ,65,1,$192 ,65,3.0597
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,344.219,,175.433,1.136,9.835,$303 ,35,1,$303 ,35,3.1665
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,265.351,,130.166,0.544,7.581,$488 ,35,1,$488 ,35,4.0471
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,654.533,,307.741,1.102,5.236,$594 ,125,1,$594 ,125,1.6723
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,198.189,,101.399,0.796,2.791,$249 ,71,1,$249 ,71,5.2039
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2017.368,,547.47,0.642,9.607,"$3,144 ",210,2,"$1,572 ",105,1.2913
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,27331.02,,2329.12,3.814,60.736,"$7,166 ",450,2,"$3,583 ",225,0.38
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6320.391,,1582.817,0.373,15.416,"$16,954 ",410,2,"$8,477 ",205,0.667
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1940.935,,522.654,0.969,7.764,"$2,004 ",250,2,"$1,002 ",125,1.3451
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,480.992,,126.244,1.026,17.178,$469 ,28,1,$469 ,28,2.242
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,1061.591,,297.705,2.264,37.914,$469 ,28,1,$469 ,28,1.793
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,1237.94,,342.513,2.64,44.212,$469 ,28,1,$469 ,28,
resnet-18 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,27454.08,2264.67,,14.262,183.027,"$1,925 ",150,1,"$1,925 ",150,0.946
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,400.118,,133.834,0.608,2.425,$658 ,165,1,$658 ,165,3.0384
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,229.863,,66.122,0.349,1.393,$658 ,165,1,$658 ,165,5.2538
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,574.341,,155.749,0.873,3.481,$658 ,165,1,$658 ,165,
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,11.094,,4.516,0.326,1.168,$34 ,9.5,1,$34 ,9.5,92.6182
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,20.114,,8.254,0.3,1.676,$67 ,12,1,$67 ,12,51.0598
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.119,,29.408,0.987,5.51,$67 ,12,1,$67 ,12,21.6857
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,82.95,,35.81,1.238,6.913,$67 ,12,1,$67 ,12,
resnet-50,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,52.004,,14.152,0.441,3.467,$118 ,15,1,$118 ,15,19.6053
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,90.685,,24.633,0.769,6.046,$118 ,15,1,$118 ,15,14.6415
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.062,,37.864,1.187,9.337,$118 ,15,1,$118 ,15,-
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2793.997,,691.079,0.597,7.551,"$4,678 ",370,2,"$2,339 ",185,1.3288
resnet-50,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,102.328,,52.896,0.875,1.574,$117 ,65,1,$117 ,65,10.4475
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,123.574,,63.836,0.577,3.531,$214 ,35,1,$214 ,35,11.6252
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,129.174,,68.242,0.673,1.987,$192 ,65,1,$192 ,65,6.8498
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,168.016,,88.675,0.555,4.8,$303 ,35,1,$303 ,35,6.9723
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,129.371,,56.366,0.265,3.696,$488 ,35,1,$488 ,35,8.7659
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,317.744,,149.441,0.535,2.542,$594 ,125,1,$594 ,125,3.6469
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,97.606,,52.17,0.392,1.375,$249 ,71,1,$249 ,71,10.851
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,980.813,,268.009,0.312,4.671,"$3,144 ",210,2,"$1,572 ",105,2.9838
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2905.803,,748.583,0.405,6.457,"$7,166 ",450,2,"$3,583 ",225,1.475
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,11359.88,,1118.97,0.67,27.707,"$16,954 ",410,2,"$8,477 ",205,0.94
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,937.572,,255.866,0.468,3.75,"$2,004 ",250,2,"$1,002 ",125,3.0985
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,235.061,,63.241,0.501,8.395,$469 ,28,1,$469 ,28,4.7975
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,235.061,,63.241,0.501,8.395,$469 ,28,1,$469 ,28,4.7975
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,235.061,,63.241,0.501,8.395,$469 ,28,1,$469 ,28,4.7975
resnet-50,OV-2022.3-8991,accel,Intel® Flex-170 GPU,10810.92,1005.16,,5.616,72.073,"$1,925 ",150,1,"$1,925 ",150,1.624
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,6.712,,2.394,0.01,0.041,$658 ,165,1,$658 ,165,175.7493
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,4.228,,1.262,0.006,0.026,$658 ,165,1,$658 ,165,241.7838
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,6.666,,2.393,0.01,0.04,$658 ,165,1,$658 ,165,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.171,,0.081,0.005,0.018,$34 ,9.5,1,$34 ,9.5,5985.7525
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,3246.0878
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,0.965,,0.615,0.014,0.08,$67 ,12,1,$67 ,12,1053.0078
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,0.806,,0.23,0.007,0.054,$118 ,15,1,$118 ,15,1240.6212
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,1.582,,0.486,0.013,0.105,$118 ,15,1,$118 ,15,649.3806
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,0.806,,0.231,0.007,0.054,$118 ,15,1,$118 ,15,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,41.52,,12.672,0.009,0.112,"$4,678 ",370,2,"$2,339 ",185,79.0111
ssd-resnet34-1200 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,1.606,,0.959,0.014,0.025,$117 ,65,1,$117 ,65,644.0626
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,1.932,,1.177,0.009,0.055,$214 ,35,1,$214 ,35,712.3677
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.067,,1.248,0.011,0.032,$192 ,65,1,$192 ,65,401.8765
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,2.66,,1.606,0.009,0.076,$303 ,35,1,$303 ,35,434.9877
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.046,,1.242,0.004,0.058,$488 ,35,1,$488 ,35,485.4343
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.871,,2.935,0.008,0.039,$594 ,125,1,$594 ,125,239.8346
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,1.55,,0.919,0.006,0.022,$249 ,71,1,$249 ,71,665.2714
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,15.706,,4.572,0.005,0.075,"$3,144 ",210,2,"$1,572 ",105,132.0319
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,152.74,,20.32,0.021,0.339,"$7,166 ",450,2,"$3,583 ",225,14.48
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,47.365,,14.722,0.003,0.116,"$16,954 ",410,2,"$8,477 ",205,44.387
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,14.966,,4.35,0.007,0.06,"$2,004 ",250,2,"$1,002 ",125,138.9625
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,3.556,,1.015,0.008,0.127,$469 ,28,1,$469 ,28,284.2379
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,8.239,,2.545,0.018,0.294,$469 ,28,1,$469 ,28,122.4561
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,3.565,,1.01,0.008,0.127,$469 ,28,1,$469 ,28,
ssd-resnet34-1200 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,132.44,18.19,,0.069,0.883,"$1,925 ",150,1,"$1,925 ",150,19.933
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,10.652,,3.873,0.016,0.065,$658 ,165,1,$658 ,165,111.0757
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,7.059,,2.154,0.011,0.043,$658 ,165,1,$658 ,165,142.0745
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,14.933,,4.935,0.023,0.091,$658 ,165,1,$658 ,165,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.258,,0.039,0.008,0.027,$34 ,9.5,1,$34 ,9.5,3959.594
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.482,,0.061,0.007,0.04,$67 ,12,1,$67 ,12,2094.2569
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.994,,0.989,0.03,0.166,$67 ,12,1,$67 ,12,502.6095
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,2.242,,0.597,0.033,0.187,$67 ,12,1,$67 ,12,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.471,,0.374,0.012,0.098,$118 ,15,1,$118 ,15,678.4977
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.715,,0.802,0.023,0.181,$118 ,15,1,$118 ,15,368.8973
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.12,,1.142,0.035,0.275,$118 ,15,1,$118 ,15,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,81.838,,19.314,0.017,0.221,"$4,678 ",370,2,"$2,339 ",185,41.506
unet-camvid--0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.482,,1.54,0.021,0.038,$117 ,65,1,$117 ,65,412.1291
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.031,,1.9,0.014,0.087,$214 ,35,1,$214 ,35,457.5992
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.227,,2.018,0.017,0.05,$192 ,65,1,$192 ,65,256.5479
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.155,,2.6,0.014,0.119,$303 ,35,1,$303 ,35,277.7416
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.907,,2.004,0.006,0.083,$488 ,35,1,$488 ,35,319.7667
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,7.413,,4.615,0.012,0.059,$594 ,125,1,$594 ,125,157.3622
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.386,,1.481,0.01,0.034,$249 ,71,1,$249 ,71,422.1157
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.251,,7.301,0.009,0.139,"$3,144 ",210,2,"$1,572 ",105,69.3596
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,381.85,,30.96,0.053,0.849,"$7,166 ",450,2,"$3,583 ",225,7.95
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,93.081,,21.382,0.005,0.227,"$16,954 ",410,2,"$8,477 ",205,22.9476
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.814,,6.966,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,72.9773
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,6.54,,1.677,0.014,0.234,$469 ,28,1,$469 ,28,152.602
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,15.391,,4.571,0.033,0.55,$469 ,28,1,$469 ,28,61.6002
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,17.962,,4.848,0.038,0.642,$469 ,28,1,$469 ,28,
unet-camvid--0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,218.12,35.2,,0.113,1.454,"$1,925 ",150,1,"$1,925 ",150,7.149
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,428.506,,162.077,0.651,2.597,$658 ,165,1,$658 ,165,2.4778
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,245.738,,84.457,0.373,1.489,$658 ,165,1,$658 ,165,3.8792
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,598.947,,195.608,0.91,3.63,$658 ,165,1,$658 ,165,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,12.406,,6.124,0.365,1.306,$34 ,9.5,1,$34 ,9.5,83.8614
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,22.94,,10.395,0.342,1.912,$67 ,12,1,$67 ,12,44.6243
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.641,,38.178,0.995,5.553,$67 ,12,1,$67 ,12,15.7687
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,86.38,,45.819,1.289,7.198,$67 ,12,1,$67 ,12,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,55.629,,18.246,0.471,3.709,$118 ,15,1,$118 ,15,18.2291
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,106.588,,31.376,0.903,7.106,$118 ,15,1,$118 ,15,10.8727
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,153.471,,46.125,1.301,10.231,$118 ,15,1,$118 ,15,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2733.627,,761.534,0.584,7.388,"$4,678 ",370,2,"$2,339 ",185,1.1267
yolo_v3_tiny,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,114.701,,66.266,0.98,1.765,$117 ,65,1,$117 ,65,8.9295
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,141.001,,79.694,0.659,4.029,$214 ,35,1,$214 ,35,9.9196
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,145.659,,85.158,0.759,2.241,$192 ,65,1,$192 ,65,5.465
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,191.931,,109.625,0.633,5.484,$303 ,35,1,$303 ,35,5.5981
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,147.041,,84.448,0.301,4.201,$488 ,35,1,$488 ,35,7.0171
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,359.61,,173.635,0.605,2.877,$594 ,125,1,$594 ,125,2.9037
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,109.066,,64.87,0.438,1.536,$249 ,71,1,$249 ,71,9.3792
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1058.322,,337.035,0.337,5.04,"$3,144 ",210,2,"$1,572 ",105,2.4971
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,7344.88,,1405.51,1.025,16.322,"$7,166 ",450,2,"$3,583 ",225,1.06
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2931.242,,901.832,0.173,7.149,"$16,954 ",410,2,"$8,477 ",205,1.215
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1015.77,,321.263,0.507,4.063,"$2,004 ",250,2,"$1,002 ",125,2.6076
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,258.05,,79.963,0.55,9.216,$469 ,28,1,$469 ,28,4.1833
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,492.645,,157.98,1.05,17.594,$469 ,28,1,$469 ,28,2.5788
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,606.117,,186.339,1.292,21.647,$469 ,28,1,$469 ,28,
yolo_v3_tiny,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3634.16,1209.67,,1.888,24.228,"$1,925 ",150,1,"$1,925 ",150,1.293
end_rec,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,21.833,,7.096,0.033,0.132,$658 ,165,1,$658 ,165,58.4745
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,11.956,,3.869,0.018,0.072,$658 ,165,1,$658 ,165,85.1633
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,26.693,,8.644,0.041,0.162,$658 ,165,1,$658 ,165,
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.522,,0.248,0.015,0.055,$34 ,9.5,1,$34 ,9.5,1900.0218
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.99,,0.43,0.015,0.083,$67 ,12,1,$67 ,12,1019.82
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,3.413,,1.752,0.051,0.284,$67 ,12,1,$67 ,12,295.7702
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,3.999,,2.087,0.06,0.333,$67 ,12,1,$67 ,12,
yolo_v4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,2.453,,0.748,0.021,0.164,$118 ,15,1,$118 ,15,407.2474
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,4.758,,1.434,0.04,0.317,$118 ,15,1,$118 ,15,212.7987
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,7.048,,2.122,0.06,0.47,$118 ,15,1,$118 ,15,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,126.954,,35.481,0.027,0.343,"$4,678 ",370,2,"$2,339 ",185,37.8189
yolo_v4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,4.971,,2.885,0.042,0.076,$117 ,65,1,$117 ,65,203.4163
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,6.182,,3.532,0.029,0.177,$214 ,35,1,$214 ,35,227.5786
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,6.356,,3.757,0.033,0.098,$192 ,65,1,$192 ,65,123.3181
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,8.44,,4.868,0.028,0.241,$303 ,35,1,$303 ,35,135.9719
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,6.399,,3.765,0.013,0.183,$488 ,35,1,$488 ,35,155.642
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,15.614,,7.925,0.026,0.125,$594 ,125,1,$594 ,125,71.631
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,4.674,,2.804,0.019,0.066,$249 ,71,1,$249 ,71,214.0957
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,47.338,,14.464,0.015,0.225,"$3,144 ",210,2,"$1,572 ",105,45.7699
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,252.03,,58.12,0.035,0.56,"$7,166 ",450,2,"$3,583 ",225,15.01
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,131.466,,41.001,0.008,0.321,"$16,954 ",410,2,"$8,477 ",205,19.2807
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,45.047,,13.741,0.022,0.18,"$2,004 ",250,2,"$1,002 ",125,48.0344
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,11.067,,3.259,0.024,0.395,$469 ,28,1,$469 ,28,92.2912
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,25.048,,7.384,0.053,0.895,$469 ,28,1,$469 ,28,39.1492
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,29.658,,8.32,0.063,1.059,$469 ,28,1,$469 ,28,
yolo_v4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,454.49,56.78,,0.236,3.03,"$1,925 ",150,1,"$1,925 ",150,6.969
end_rec,,,,,,,,,,,,,,
Network model,Release,IE-Type,Platform name,Throughput-INT8,Throughput-FP16,Throughput-FP32,Value,Efficiency,Price,TDP,Sockets,Price/socket,TDP/socket,Latency,,,
begin_rec,,,,,,,,,,,,,,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,163.72,,57.83,0.273,1.310,$599 ,125,1,$599,125,15.53,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,56.07,,23.3,0.094,0.449,$599 ,125,1,$599,125,19.62,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,210.17,,85.83,0.351,1.681,$599 ,125,1,$599,125,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,128.05,,45.94,0.389,1.024,$329 ,125,1,$329,125,12.71,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,53.03,,21.9,0.161,0.424,$329 ,125,1,$329,125,20.81,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,163.33,,64.74,0.496,1.307,$329 ,125,1,$329,125,,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,96.06,,35.627,0.146,0.582,$658 ,165,1,$658 ,165,17.1432,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,53.093,,22.253,0.081,0.322,$658 ,165,1,$658 ,165,22.0002,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,108.306,,44.797,0.165,0.656,$658 ,165,1,$658 ,165,,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,2.763,,1.332,0.081,0.291,$34 ,9.5,1,$34 ,9.5,350.2746,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.694,,2.002,0.085,0.475,$67 ,12,1,$67 ,12,183.1711,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,16.11,,10.009,0.240,1.343,$67 ,12,1,$67 ,12,79.7607,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.128,,11.81,0.315,1.761,$67 ,12,1,$67 ,12,,,,
bert-base-cased ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,14.212,,4.255,0.120,0.947,$118 ,15,1,$118 ,15,72.6516,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,18.983,,8.696,0.161,1.266,$118 ,15,1,$118 ,15,62.9729,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,30.866,,12.087,0.262,2.058,$118 ,15,1,$118 ,15,,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,645.77,,213.877,0.138,1.745,"$4,678 ",370,2,"$2,339 ",185,6.7612,,,
bert-base-cased ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,23.721,,14.457,0.203,0.365,$117 ,65,1,$117 ,65,44.0371,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,30.141,,16.38,0.141,0.861,$214 ,35,1,$214 ,35,46.6064,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,30.541,,19.319,0.159,0.470,$192 ,65,1,$192 ,65,27.8871,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,41.504,,22.75,0.137,1.186,$303 ,35,1,$303 ,35,27.974,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,32.073,,16.558,0.066,0.916,$488 ,35,1,$488 ,35,39.7617,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,69.053,,40.243,0.116,0.552,$594 ,125,1,$594 ,125,18.309,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,23.402,,14.614,0.094,0.330,$249 ,71,1,$249 ,71,44.8984,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,266.949,,79.033,0.085,1.271,"$3,144 ",210,2,"$1,572 ",105,12.4065,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,2090.76,1372.2,1368.68,0.292,4.646,"$7,166 ",450,2,"$3,583 ",225,4.61,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,682.593,,225.713,0.040,1.665,"$16,954 ",410,2,"$8,477 ",205,6.9035,,,
bert-base-cased ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,256.994,,75.502,0.128,1.028,"$2,004 ",250,2,"$1,002 ",125,13.0382,,,
bert-base-cased ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.632,,18.394,0.138,2.308,$469 ,28,1,$469 ,28,17.638,,,
bert-base-cased ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,95.656,,44.056,0.204,3.416,$469 ,28,1,$469 ,28,14.1005,,,
bert-base-cased ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,128.005,,50.592,0.273,4.572,$469 ,28,1,$469 ,28,,,,
bert-base-cased ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,906.3,348.52,,0.471,6.042,"$1,925 ",150,1,"$1,925 ",150,7.381,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,51.72,,17.6,0.086,0.414,$599 ,125,1,$599 ,125,49.13,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,19.05,,6.88,0.032,0.152,$599 ,125,1,$599 ,125,55.82,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,53,,19.95,0.088,0.424,$599 ,125,1,$599 ,125,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,35.31,,11.04,0.107,0.282,$329 ,125,1,$329 ,125,41.56,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,17.93,,6.46,0.054,0.143,$329 ,125,1,$329 ,125,59.37,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,43.42,,16.19,0.132,0.347,$329 ,125,1,$329 ,125,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,7.714,,3.093,0.012,0.047,$658 ,165,1,$658 ,165,155.3633,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,5.617,,1.978,0.009,0.034,$658 ,165,1,$658 ,165,181.8303,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,10.602,,3.753,0.016,0.064,$658 ,165,1,$658 ,165,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.272,,0.125,0.008,0.029,$34 ,9.5,1,$34 ,9.5,3861.0657,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.488,,0.188,0.007,0.041,$67 ,12,1,$67 ,12,2090.8266,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.395,,0.774,0.021,0.116,$67 ,12,1,$67 ,12,727.6781,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.827,,0.845,0.027,0.152,$67 ,12,1,$67 ,12,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.199,,0.377,0.010,0.080,$118 ,15,1,$118 ,15,831.301,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.051,,0.766,0.017,0.137,$118 ,15,1,$118 ,15,494.5363,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,3.118,,1.127,0.026,0.208,$118 ,15,1,$118 ,15,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,43.436,,17.379,0.009,0.117,"$4,678 ",370,2,"$2,339 ",185,52.2862,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.067,,1.278,0.018,0.032,$117 ,65,1,$117 ,65,495.0786,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,2.619,,1.536,0.012,0.075,$214 ,35,1,$214 ,35,502.3687,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.72,,1.679,0.014,0.042,$192 ,65,1,$192 ,65,320.168,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,3.625,,2.11,0.012,0.104,$303 ,35,1,$303 ,35,309.2848,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.906,,1.693,0.006,0.083,$488 ,35,1,$488 ,35,386.4947,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.801,,2.729,0.008,0.038,$594 ,125,1,$594 ,125,200.0794,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.098,,1.32,0.008,0.030,$249 ,71,1,$249 ,71,492.0938,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,21.062,,7.021,0.007,0.100,"$3,144 ",210,2,"$1,572 ",105,101.4694,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,651.95,378.57,384.02,0.091,1.449,"$7,166 ",450,2,"$3,583 ",225,12.87,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,46.064,,19.051,0.003,0.112,"$16,954 ",410,2,"$8,477 ",205,49.4869,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,20.014,,6.726,0.010,0.080,"$2,004 ",250,2,"$1,002 ",125,105.9423,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,5.192,,1.626,0.011,0.185,$469 ,28,1,$469 ,28,203.6311,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,10.476,,3.914,0.022,0.374,$469 ,28,1,$469 ,28,95.6598,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,11.75,,4.168,0.025,0.420,$469 ,28,1,$469 ,28,,,,
bert-large-uncased-whole-word-masking-squad-0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,74.47,25.77,,0.039,0.496,"$1,925 ",150,1,"$1,925 ",150,19.768,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,184.93,,63.79,0.309,1.479,$599 ,125,1,$599 ,125,10.31,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,69.31,,22.67,0.116,0.554,$599 ,125,1,$599 ,125,15.02,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,191.48,,62.99,0.320,1.532,$599 ,125,1,$599 ,125,,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,139.02,,48.48,0.423,1.112,$329 ,125,1,$329 ,125,10.48,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,65.55,,21.24,0.199,0.524,$329 ,125,1,$329 ,125,16.12,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,154.19,,52.87,0.469,1.234,$329 ,125,1,$329 ,125,,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,99.078,,36.552,0.151,0.600,$658 ,165,1,$658 ,165,11.269,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,57.707,,13.789,0.088,0.350,$658 ,165,1,$658 ,165,16.263,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,115.59,,39.82,0.176,0.701,$658 ,165,1,$658 ,165,,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.327,,1.496,0.098,0.350,$34 ,9.5,1,$34 ,9.5,308.0916,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,6.07,,3.041,0.091,0.506,$67 ,12,1,$67 ,12,166.5404,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,5.196,0.000,0.000,$67 ,12,1,$67 ,12,217.0439,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,9.877,,7.145,0.147,0.823,$67 ,12,1,$67 ,12,,,,
deeplabv3,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,13.516,,4.681,0.115,0.901,$118 ,15,1,$118 ,15,74.1061,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,22.35,,4.635,0.189,1.490,$118 ,15,1,$118 ,15,42.9657,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,34.576,,8.955,0.293,2.305,$118 ,15,1,$118 ,15,,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,559.145,,134.159,0.120,1.511,"$4,678 ",370,2,"$2,339 ",185,5.356,,,
deeplabv3,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,27.171,,15.947,0.232,0.418,$117 ,65,1,$117 ,65,36.6584,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,34.907,,16.72,0.163,0.997,$214 ,35,1,$214 ,35,38.8986,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,35.07,,20.497,0.183,0.540,$192 ,65,1,$192 ,65,22.1865,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,47.647,,23.747,0.157,1.361,$303 ,35,1,$303 ,35,22.628,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,36.559,,18.235,0.075,1.045,$488 ,35,1,$488 ,35,27.138,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,79.42,,21.03,0.134,0.635,$594 ,125,1,$594 ,125,12.8397,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,26.173,,16.906,0.105,0.369,$249 ,71,1,$249 ,71,37.9245,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,248.049,,81.667,0.079,1.181,"$3,144 ",210,2,"$1,572 ",105,8.9485,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,1139.5,702.28,699.04,0.159,2.532,"$7,166 ",450,2,"$3,583 ",225,2.47,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,632.113,,168.65,0.037,1.542,"$16,954 ",410,2,"$8,477 ",205,4.0073,,,
deeplabv3,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,241.703,,78.963,0.121,0.967,"$2,004 ",250,2,"$1,002 ",125,9.356,,,
deeplabv3,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,64.13,,18.519,0.137,2.290,$469 ,28,1,$469 ,28,16.6586,,,
deeplabv3,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,104.926,,24.592,0.224,3.747,$469 ,28,1,$469 ,28,9.1435,,,
deeplabv3,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,121.441,,30.498,0.259,4.337,$469 ,28,1,$469 ,28,,,,
deeplabv3,OV-2022.3-8991,accel,Intel® Flex-170 GPU,882.04,98.95,,0.458,5.88,"$1,925 ",150,1,"$1,925 ",150,2.674,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,777.86,,284.56,1.299,6.223,$599 ,125,1,$599 ,125,3.26,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,195.3,,66.46,0.326,1.562,$599 ,125,1,$599 ,125,6.8,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,899.5,,293.29,1.502,7.196,$599 ,125,1,$599 ,125,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,612.99,,184.9,1.863,4.904,$329 ,125,1,$329 ,125,3.12,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,178.37,,62.69,0.542,1.427,$329 ,125,1,$329 ,125,8.37,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,707.99,,207.12,2.152,5.664,$329 ,125,1,$329 ,125,,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,457.193,,165.166,0.695,2.771,$658 ,165,1,$658 ,165,3.141,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,203.417,,68.438,0.309,1.233,$658 ,165,1,$658 ,165,6.6728,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,575.442,,179.858,0.875,3.488,$658 ,165,1,$658 ,165,,,,
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,13.344,,5.882,0.392,1.405,$34 ,9.5,1,$34 ,9.5,80.7014,,,
densenet-121,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,24.172,,10.554,0.361,2.014,$67 ,12,1,$67 ,12,43.668,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,30.615,0.000,0.000,$67 ,12,1,$67 ,12,30.0241,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,39.365,,38.926,0.588,3.280,$67 ,12,1,$67 ,12,,,,
densenet-121,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,58.965,,15.713,0.500,3.931,$118 ,15,1,$118 ,15,18.3425,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,86.162,,25.34,0.730,5.744,$118 ,15,1,$118 ,15,20.7907,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.891,,39.929,1.194,9.393,$118 ,15,1,$118 ,15,,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,3094.742,,701.32,0.662,8.364,"$4,678 ",370,2,"$2,339 ",185,2.131,,,
densenet-121,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,120.121,,66.624,1.027,1.848,$117 ,65,1,$117 ,65,9.3755,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,142.623,,80.872,0.666,4.075,$214 ,35,1,$214 ,35,10.2536,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,149.112,,85.051,0.777,2.294,$192 ,65,1,$192 ,65,6.0817,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,194.559,,111.988,0.642,5.559,$303 ,35,1,$303 ,35,6.1906,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,146.463,,69.186,0.300,4.185,$488 ,35,1,$488 ,35,8.6496,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,360.501,,182.543,0.607,2.884,$594 ,125,1,$594 ,125,3.6046,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,114.844,,67.188,0.461,1.618,$249 ,71,1,$249 ,71,9.7609,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1116.372,,295.952,0.355,5.316,"$3,144 ",210,2,"$1,572 ",105,3.9606,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,8279.14,4856.54,4862.51,1.155,18.398,"$7,166 ",450,2,"$3,583 ",225,2.39,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,3155.106,,815.725,0.186,7.695,"$16,954 ",410,2,"$8,477 ",205,2.8831,,,
densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1064.824,,283.423,0.531,4.259,"$2,004 ",250,2,"$1,002 ",125,4.0689,,,
densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,265.167,,74.501,0.565,9.470,$469 ,28,1,$469 ,28,4.7413,,,
densenet-121,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,391.185,,123.519,0.834,13.971,$469 ,28,1,$469 ,28,6.5259,,,
densenet-121,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,526.12,,150.35,1.122,18.790,$469 ,28,1,$469 ,28,,,,
densenet-121,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3440.18,1178.68,,1.787,22.935,"$1,925 ",150,1,"$1,925 ",150,3.302,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,209.26,,106.11,0.349,1.674,$599 ,125,1,$599 ,125,10.36,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,82.04,,47.85,0.137,0.656,$599 ,125,1,$599 ,125,22.35,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,197.85,,108.3,0.330,1.583,$599 ,125,1,$599 ,125,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,155.65,,90.91,0.473,1.245,$329 ,125,1,$329 ,125,9.92,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,77.28,,44.91,0.235,0.618,$329 ,125,1,$329 ,125,22.93,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,172.54,,95.94,0.524,1.380,$329 ,125,1,$329 ,125,,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,112.297,,64.06,0.171,0.681,$658 ,165,1,$658 ,165,11.8265,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,73.766,,38.742,0.112,0.447,$658 ,165,1,$658 ,165,21.403,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,128.735,,76.62,0.196,0.780,$658 ,165,1,$658 ,165,,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.812,,2.565,0.112,0.401,$34 ,9.5,1,$34 ,9.5,274.5947,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,7.248,,5.17,0.108,0.604,$67 ,12,1,$67 ,12,143.7999,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,22.697,,15.635,0.339,1.891,$67 ,12,1,$67 ,12,59.0651,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,26.855,,17.296,0.401,2.238,$67 ,12,1,$67 ,12,,,,
efficientdet-d0,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.949,,10.417,0.135,1.063,$118 ,15,1,$118 ,15,62.2765,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,25.936,,14.073,0.220,1.729,$118 ,15,1,$118 ,15,54.0166,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,32.767,,20.733,0.278,2.184,$118 ,15,1,$118 ,15,,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,424.388,,256.503,0.091,1.147,"$4,678 ",370,2,"$2,339 ",185,,,,
efficientdet-d0,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,36.666,,24.041,0.313,0.564,$117 ,65,1,$117 ,65,30.2521,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,45.331,,26.92,0.212,1.295,$214 ,35,1,$214 ,35,32.8946,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,44.921,,32.357,0.234,0.691,$192 ,65,1,$192 ,65,19.7048,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,62.749,,37.807,0.207,1.793,$303 ,35,1,$303 ,35,19.901,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,50.35,,29.935,0.103,1.439,$488 ,35,1,$488 ,35,24.2916,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,94.981,,36.434,0.160,0.760,$594 ,125,1,$594 ,125,12.658,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,35.831,,27.306,0.144,0.505,$249 ,71,1,$249 ,71,30.9469,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,239.06,,161.224,0.076,1.138,"$3,144 ",210,2,"$1,572 ",105,13.9735,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,875.53,495.04,492.93,0.122,1.946,"$7,166 ",450,2,"$3,583 ",225,5.07,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,471.02,,300.291,0.028,1.149,"$16,954 ",410,2,"$8,477 ",205,9.3866,,,
efficientdet-d0,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,231.873,,156.285,0.116,0.927,"$2,004 ",250,2,"$1,002 ",125,14.1605,,,
efficientdet-d0,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.482,,41.123,0.152,2.553,$469 ,28,1,$469 ,28,16.6952,,,
efficientdet-d0,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,92.52,,50.538,0.197,3.304,$469 ,28,1,$469 ,28,17.295,,,
efficientdet-d0,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,107.688,,56.901,0.230,3.846,$469 ,28,1,$469 ,28,,,,
efficientdet-d0,OV-2022.3-8991,accel,Intel® Flex-170 GPU,463.67,295.13,,0.241,3.091,"$1,925 ",150,1,"$1,925 ",150,5.603,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,5.94,,2.41,0.010,0.048,$599 ,125,1,$599 ,125,270.57,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,2.3,,0.71,0.004,0.018,$599 ,125,1,$599 ,125,437.94,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,6.45,,2.25,0.011,0.052,$599 ,125,1,$599 ,125,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,4.55,,1.88,0.014,0.036,$329 ,125,1,$329 ,125,310.58,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,2.17,,0.67,0.007,0.017,$329 ,125,1,$329 ,125,465.03,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,5.3,,2.01,0.016,0.042,$329 ,125,1,$329 ,125,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,12.921,,4.016,0.020,0.078,$658 ,165,1,$658 ,165,89.8929,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,6.802,,1.82,0.010,0.041,$658 ,165,1,$658 ,165,149.7396,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,15.679,,4.499,0.024,0.095,$658 ,165,1,$658 ,165,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.32,,0.131,0.009,0.034,$34 ,9.5,1,$34 ,9.5,3206.1652,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.592,,0.242,0.009,0.049,$67 ,12,1,$67 ,12,1727.27,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.301,,0.728,0.019,0.108,$67 ,12,1,$67 ,12,776.0692,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,1.683,,0.865,0.025,0.140,$67 ,12,1,$67 ,12,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.563,,0.417,0.013,0.104,$118 ,15,1,$118 ,15,640.0005,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.616,,0.725,0.022,0.174,$118 ,15,1,$118 ,15,389.3563,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.056,,1.107,0.034,0.270,$118 ,15,1,$118 ,15,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,74.93,,19.965,0.016,0.203,"$4,678 ",370,2,"$2,339 ",185,65.5753,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.988,,1.473,0.026,0.046,$117 ,65,1,$117 ,65,340.7313,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.633,,1.926,0.017,0.104,$214 ,35,1,$214 ,35,430.1967,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.852,,1.982,0.020,0.059,$192 ,65,1,$192 ,65,241.5513,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.999,,2.648,0.016,0.143,$303 ,35,1,$303 ,35,260.2284,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,3.71,,2.005,0.008,0.106,$488 ,35,1,$488 ,35,280.1493,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,8.977,,4.542,0.015,0.072,$594 ,125,1,$594 ,125,137.1747,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.867,,1.464,0.012,0.040,$249 ,71,1,$249 ,71,353.2042,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.332,,8.19,0.009,0.140,"$3,144 ",210,2,"$1,572 ",105,78.1722,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,19.71,18.01,18.15,0.003,0.044,"$7,166 ",450,2,"$3,583 ",225,129.2,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,85.213,,22.066,0.005,0.208,"$16,954 ",410,2,"$8,477 ",205,30.4317,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.847,,7.786,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,78.6604,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,7.027,,1.855,0.015,0.251,$469 ,28,1,$469 ,28,151.8783,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,13.823,,3.545,0.029,0.494,$469 ,28,1,$469 ,28,70.7933,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,16.898,,4.191,0.036,0.604,$469 ,28,1,$469 ,28,,,,
faster_rcnn_resnet50_coco,OV-2022.3-8991,accel,Intel® Flex-170 GPU,216.3,23.42,,0.112,1.442,"$1,925 ",150,1,"$1,925 ",150,9.137,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,219.06,,71.15,0.366,1.752,$599 ,125,1,$599 ,125,10.19,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,65.91,,18.1,0.110,0.527,$599 ,125,1,$599 ,125,16.55,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,279.58,,78.65,0.467,2.237,$599 ,125,1,$599 ,125,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,171.19,,45.8,0.520,1.370,$329 ,125,1,$329 ,125,9.14,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,62.45,,17.02,0.190,0.500,$329 ,125,1,$329 ,125,17.48,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,219.02,,52.56,0.666,1.752,$329 ,125,1,$329 ,125,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,121.813,,39.391,0.185,0.738,$658 ,165,1,$658 ,165,11.0425,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,71.229,,17.755,0.108,0.432,$658 ,165,1,$658 ,165,19.7132,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,175.049,,44.894,0.266,1.061,$658 ,165,1,$658 ,165,,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,3.12,,1.344,0.092,0.328,$34 ,9.5,1,$34 ,9.5,335.3712,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,5.677,,2.364,0.085,0.473,$67 ,12,1,$67 ,12,181.8897,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,17.009,,8.302,0.254,1.417,$67 ,12,1,$67 ,12,78.0548,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,21.713,,10.37,0.324,1.809,$67 ,12,1,$67 ,12,,,,
Inception-V4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,15.576,,4.073,0.132,1.038,$118 ,15,1,$118 ,15,65.7272,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,28.105,,6.681,0.238,1.874,$118 ,15,1,$118 ,15,46.2616,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,41.918,,10.163,0.355,2.795,$118 ,15,1,$118 ,15,,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,881.403,,205.296,0.188,2.382,"$4,678 ",370,2,"$2,339 ",185,4.7029,,,
Inception-V4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,30.004,,15.51,0.256,0.462,$117 ,65,1,$117 ,65,35.0513,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,35.882,,19.222,0.168,1.025,$214 ,35,1,$214 ,35,37.6472,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,37.987,,19.998,0.198,0.584,$192 ,65,1,$192 ,65,21.5144,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,48.903,,26.356,0.161,1.397,$303 ,35,1,$303 ,35,22.2402,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,37.301,,19.475,0.076,1.066,$488 ,35,1,$488 ,35,28.572,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,92.646,,44.966,0.156,0.741,$594 ,125,1,$594 ,125,12.3153,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,28.537,,15.13,0.115,0.402,$249 ,71,1,$249 ,71,36.8888,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,301.215,,77.005,0.096,1.434,"$3,144 ",210,2,"$1,572 ",105,10.5711,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,3406.7,1879.09,1867.99,0.475,7.570,"$7,166 ",450,2,"$3,583 ",225,3.23,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,937.139,,225.776,0.055,2.286,"$16,954 ",410,2,"$8,477 ",205,5.6984,,,
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,287.767,,73.617,0.144,1.151,"$2,004 ",250,2,"$1,002 ",125,11.1114,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,71.295,,18.482,0.152,2.546,$469 ,28,1,$469 ,28,15.8294,,,
Inception-V4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,158.282,,36.884,0.337,5.653,$469 ,28,1,$469 ,28,10.6245,,,
Inception-V4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,182.132,,44.198,0.388,6.505,$469 ,28,1,$469 ,28,,,,
Inception-V4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,2986.91,298.6,,1.552,19.913,"$1,925 ",150,1,"$1,925 ",150,3.968,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,1754.44,,664.82,2.929,14.036,$599 ,125,1,$599 ,125,1.4,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,528.03,,168.57,0.882,4.224,$599 ,125,1,$599 ,125,2.35,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,1568.83,,665.79,2.619,12.551,$599 ,125,1,$599 ,125,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,1240.01,,437.11,3.769,9.920,$329 ,125,1,$329 ,125,1.47,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,493.18,,157.94,1.499,3.945,$329 ,125,1,$329 ,125,2.43,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,1063.27,,454.21,3.232,8.506,$329 ,125,1,$329 ,125,,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,1054.462,,346.546,1.603,6.391,$658 ,165,1,$658 ,165,1.4898,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,493.088,,145.503,0.749,2.988,$658 ,165,1,$658 ,165,2.472,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1056.241,,361.472,1.605,6.401,$658 ,165,1,$658 ,165,,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,28.032,,12.691,0.824,2.951,$34 ,9.5,1,$34 ,9.5,38.1991,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,50.352,,23.675,0.752,4.196,$67 ,12,1,$67 ,12,20.8993,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,100.377,,60.647,1.498,8.365,$67 ,12,1,$67 ,12,11.6812,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,148.458,,79.575,2.216,12.372,$67 ,12,1,$67 ,12,,,,
mobilenet-ssd ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,123.806,,38.981,1.049,8.254,$118 ,15,1,$118 ,15,8.4121,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,168.473,,53.272,1.428,11.232,$118 ,15,1,$118 ,15,7.8961,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,238.511,,83.721,2.021,15.901,$118 ,15,1,$118 ,15,,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,6730.68,,1634.937,1.439,18.191,"$4,678 ",370,2,"$2,339 ",185,0.7265,,,
mobilenet-ssd ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,244.598,,140.009,2.091,3.763,$117 ,65,1,$117 ,65,4.4481,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,303.938,,173.562,1.420,8.684,$214 ,35,1,$214 ,35,4.7946,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,304.802,,185.045,1.588,4.689,$192 ,65,1,$192 ,65,2.8007,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,412.261,,241.37,1.361,11.779,$303 ,35,1,$303 ,35,2.8749,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,315.107,,152.342,0.646,9.003,$488 ,35,1,$488 ,35,3.5896,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,774.346,,345.309,1.304,6.195,$594 ,125,1,$594 ,125,1.5452,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,233.43,,147.098,0.937,3.288,$249 ,71,1,$249 ,71,4.5879,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2331.207,,691.743,0.741,11.101,"$3,144 ",210,2,"$1,572 ",105,1.4852,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,16445.75,8733.64,8626.42,2.295,36.546,"$7,166 ",450,2,"$3,583 ",225,0.65,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6691.915,,1796.357,0.395,16.322,"$16,954 ",410,2,"$8,477 ",205,1.0518,,,
mobilenet-ssd ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,2225.935,,667.692,1.111,8.904,"$2,004 ",250,2,"$1,002 ",125,1.5444,,,
mobilenet-ssd ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,579.307,,166.959,1.235,20.690,$469 ,28,1,$469 ,28,2.0215,,,
mobilenet-ssd ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,582.636,,243.945,1.242,20.808,$469 ,28,1,$469 ,28,2.548,,,
mobilenet-ssd ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,744.231,,292.071,1.587,26.580,$469 ,28,1,$469 ,28,,,,
mobilenet-ssd ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3548.98,1412.68,,1.844,23.66,"$1,925 ",150,1,"$1,925 ",150,1.344,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,4041.77,,2123.33,6.748,32.334,$599 ,125,1,$599 ,125,0.66,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,978.61,,424.34,1.634,7.829,$599 ,125,1,$599 ,125,1.21,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,4630.44,,1944.62,7.730,37.044,$599 ,125,1,$599 ,125,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,3306.92,,1403.57,10.051,26.455,$329 ,125,1,$329 ,125,0.65,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,919.85,,384.42,2.796,7.359,$329 ,125,1,$329 ,125,1.36,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,3556.06,,1332.32,10.809,28.448,$329 ,125,1,$329 ,125,,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,2446.221,,1003.129,3.718,14.826,$658 ,165,1,$658 ,165,0.7182,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,1265.969,,389.894,1.924,7.673,$658 ,165,1,$658 ,165,1.3894,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,2680.458,,1013.049,4.074,16.245,$658 ,165,1,$658 ,165,,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,81.572,,45.013,2.399,8.587,$34 ,9.5,1,$34 ,9.5,13.4692,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,143.134,,81.991,2.136,11.928,$67 ,12,1,$67 ,12,7.609,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,,,164.945,0.000,0.000,$67 ,12,1,$67 ,12,7.0306,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,227.898,,202.181,3.401,18.992,$67 ,12,1,$67 ,12,,,,
mobilenet-v2 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,316.763,,124.654,2.684,21.118,$118 ,15,1,$118 ,15,3.391,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,525.084,,141.61,4.450,35.006,$118 ,15,1,$118 ,15,4.9197,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,807.397,,255.964,6.842,53.826,$118 ,15,1,$118 ,15,,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,14679.84,,4065.139,3.138,39.675,"$4,678 ",370,2,"$2,339 ",185,0.4828,,,
mobilenet-v2 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,619.507,,452.366,5.295,9.531,$117 ,65,1,$117 ,65,1.8067,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,806.314,,441.904,3.768,23.038,$214 ,35,1,$214 ,35,2.1078,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,766.072,,558.975,3.990,11.786,$192 ,65,1,$192 ,65,1.2307,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,1081.253,,664.108,3.568,30.893,$303 ,35,1,$303 ,35,1.2788,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,825.071,,413.091,1.691,23.573,$488 ,35,1,$488 ,35,1.6818,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,2067.162,,868.25,3.480,16.537,$594 ,125,1,$594 ,125,0.7363,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,594.283,,479.567,2.387,8.370,$249 ,71,1,$249 ,71,1.8531,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,5882.455,,1895.498,1.871,28.012,"$3,144 ",210,2,"$1,572 ",105,1.3871,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,28383.76,16212.74,16065.38,3.961,63.075,"$7,166 ",450,2,"$3,583 ",225,0.55,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,15616.083,,4308.927,0.921,38.088,"$16,954 ",410,2,"$8,477 ",205,0.8685,,,
mobilenet-v2 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,5616.283,,1835.686,2.803,22.465,"$2,004 ",250,2,"$1,002 ",125,1.404,,,
mobilenet-v2 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,1463.21,,538.597,3.120,52.258,$469 ,28,1,$469 ,28,0.8864,,,
mobilenet-v2 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,2076.015,,544.641,4.426,74.143,$469 ,28,1,$469 ,28,1.7212,,,
mobilenet-v2 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,2677.374,,698.942,5.709,95.621,$469 ,28,1,$469 ,28,,,,
mobilenet-v2 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,18371.95,4738.33,,9.544,122.48,"$1,925 ",150,1,"$1,925 ",150,1.15,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,1495.77,,415.82,2.497,11.966,$599 ,125,1,$599 ,125,1.38,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,497.54,,150.99,0.831,3.980,$599 ,125,1,$599 ,125,2.19,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,1821.4,,615.14,3.041,14.571,$599 ,125,1,$599 ,125,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,1169.04,,336.09,3.553,9.352,$329 ,125,1,$329 ,125,1.5,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,467.43,,141.76,1.421,3.739,$329 ,125,1,$329 ,125,2.36,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,1443.42,,445.25,4.387,11.547,$329 ,125,1,$329 ,125,,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,804.771,,212.574,1.223,4.877,$658 ,165,1,$658 ,165,1.3886,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,491.337,,146.839,0.747,2.978,$658 ,165,1,$658 ,165,2.2655,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,1180.984,,365.777,1.795,7.157,$658 ,165,1,$658 ,165,,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,22.96,,9.564,0.675,2.417,$34 ,9.5,1,$34 ,9.5,44.5491,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,40.944,,16.158,0.611,3.412,$67 ,12,1,$67 ,12,25.1377,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,161.381,,60.863,2.409,13.448,$67 ,12,1,$67 ,12,10.983,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,197.477,,73.927,2.947,16.456,$67 ,12,1,$67 ,12,,,,
resnet-18 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,105.574,,28.914,0.895,7.038,$118 ,15,1,$118 ,15,9.6165,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,194.694,,55.341,1.650,12.980,$118 ,15,1,$118 ,15,6.643,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,291.441,,82.105,2.470,19.429,$118 ,15,1,$118 ,15,,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,5761.961,,1431.864,1.232,15.573,"$4,678 ",370,2,"$2,339 ",185,0.6512,,,
resnet-18 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,208.65,,103.699,1.783,3.210,$117 ,65,1,$117 ,65,5.0231,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,252.987,,127.448,1.182,7.228,$214 ,35,1,$214 ,35,5.2921,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,262.785,,134.002,1.369,4.043,$192 ,65,1,$192 ,65,3.0597,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,344.219,,175.433,1.136,9.835,$303 ,35,1,$303 ,35,3.1665,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,265.351,,130.166,0.544,7.581,$488 ,35,1,$488 ,35,4.0471,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,654.533,,307.741,1.102,5.236,$594 ,125,1,$594 ,125,1.6723,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,198.189,,101.399,0.796,2.791,$249 ,71,1,$249 ,71,5.2039,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,2017.368,,547.47,0.642,9.607,"$3,144 ",210,2,"$1,572 ",105,1.2913,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,27331.02,16095.24,16009.04,3.814,60.736,"$7,166 ",450,2,"$3,583 ",225,0.38,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,6320.391,,1582.817,0.373,15.416,"$16,954 ",410,2,"$8,477 ",205,0.667,,,
resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1940.935,,522.654,0.969,7.764,"$2,004 ",250,2,"$1,002 ",125,1.3451,,,
resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,480.992,,126.244,1.026,17.178,$469 ,28,1,$469 ,28,2.242,,,
resnet-18 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,1061.591,,297.705,2.264,37.914,$469 ,28,1,$469 ,28,1.793,,,
resnet-18 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,1237.94,,342.513,2.640,44.212,$469 ,28,1,$469 ,28,,,,
resnet-18 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,27454.08,2264.67,,14.262,183.027,"$1,925 ",150,1,"$1,925 ",150,0.946,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,729.93,,240.59,1.219,5.839,$599 ,125,1,$599 ,125,2.91,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,238.44,,68.18,0.398,1.908,$599 ,125,1,$599 ,125,4.74,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,895.28,,255.91,1.495,7.162,$599 ,125,1,$599 ,125,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,576.86,,153.71,1.753,4.615,$329 ,125,1,$329 ,125,3.04,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,216.97,,64.36,0.659,1.736,$329 ,125,1,$329 ,125,5.3,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,717.91,,188.59,2.182,5.743,$329 ,125,1,$329 ,125,,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,400.118,,133.834,0.608,2.425,$658 ,165,1,$658 ,165,3.0384,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,229.863,,66.122,0.349,1.393,$658 ,165,1,$658 ,165,5.2538,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,574.341,,155.749,0.873,3.481,$658 ,165,1,$658 ,165,,,,
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,11.094,,4.516,0.326,1.168,$34 ,9.5,1,$34 ,9.5,92.6182,,,
resnet-50,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,20.114,,8.254,0.300,1.676,$67 ,12,1,$67 ,12,51.0598,,,````
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.119,,29.408,0.987,5.510,$67 ,12,1,$67 ,12,21.6857,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,82.95,,35.81,1.238,6.913,$67 ,12,1,$67 ,12,,,,
resnet-50,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,52.004,,14.152,0.441,3.467,$118 ,15,1,$118 ,15,19.6053,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,90.685,,24.633,0.769,6.046,$118 ,15,1,$118 ,15,14.6415,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,140.062,,37.864,1.187,9.337,$118 ,15,1,$118 ,15,-,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2793.997,,691.079,0.597,7.551,"$4,678 ",370,2,"$2,339 ",185,1.3288,,,
resnet-50,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,102.328,,52.896,0.875,1.574,$117 ,65,1,$117 ,65,10.4475,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,123.574,,63.836,0.577,3.531,$214 ,35,1,$214 ,35,11.6252,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,129.174,,68.242,0.673,1.987,$192 ,65,1,$192 ,65,6.8498,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,168.016,,88.675,0.555,4.800,$303 ,35,1,$303 ,35,6.9723,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,129.371,,56.366,0.265,3.696,$488 ,35,1,$488 ,35,8.7659,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,317.744,,149.441,0.535,2.542,$594 ,125,1,$594 ,125,3.6469,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,97.606,,52.17,0.392,1.375,$249 ,71,1,$249 ,71,10.851,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,980.813,,268.009,0.312,4.671,"$3,144 ",210,2,"$1,572 ",105,2.9838,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2905.803,,748.583,0.405,6.457,"$7,166 ",450,2,"$3,583 ",225,1.475,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,11359.88,5494.15,5497.22,0.670,27.707,"$16,954 ",410,2,"$8,477 ",205,0.94,,,
resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,937.572,,255.866,0.468,3.750,"$2,004 ",250,2,"$1,002 ",125,3.0985,,,
resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,235.061,,63.241,0.501,8.395,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,504.247,,125.407,1.075,18.009,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,595.133,,150.024,1.269,21.255,$469 ,28,1,$469 ,28,4.7975,,,
resnet-50,OV-2022.3-8991,accel,Intel® Flex-170 GPU,10810.92,1005.16,,5.616,72.073,"$1,925 ",150,1,"$1,925 ",150,1.624,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,11.75,,4.24,0.020,0.094,$599 ,125,1,$599 ,125,162.07,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,4.5,,1.45,0.008,0.036,$599 ,125,1,$599 ,125,226.99,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,11.63,,4.24,0.019,0.093,$599 ,125,1,$599 ,125,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,8.21,,2.7,0.025,0.066,$329 ,125,1,$329 ,125,147.53,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,4.22,,1.36,0.013,0.034,$329 ,125,1,$329 ,125,241.92,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,8,,2.7,0.024,0.064,$329 ,125,1,$329 ,125,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,6.712,,2.394,0.010,0.041,$658 ,165,1,$658 ,165,175.7493,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,4.228,,1.262,0.006,0.026,$658 ,165,1,$658 ,165,241.7838,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,6.666,,2.393,0.010,0.040,$658 ,165,1,$658 ,165,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.171,,0.081,0.005,0.018,$34 ,9.5,1,$34 ,9.5,5985.7525,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,3246.0878,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,0.965,,0.615,0.014,0.080,$67 ,12,1,$67 ,12,1053.0078,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,0.31,,0.133,0.005,0.026,$67 ,12,1,$67 ,12,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,0.806,,0.23,0.007,0.054,$118 ,15,1,$118 ,15,1240.6212,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,1.582,,0.486,0.013,0.105,$118 ,15,1,$118 ,15,649.3806,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,0.806,,0.231,0.007,0.054,$118 ,15,1,$118 ,15,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,41.52,,12.672,0.009,0.112,"$4,678 ",370,2,"$2,339 ",185,79.0111,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,1.606,,0.959,0.014,0.025,$117 ,65,1,$117 ,65,644.0626,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,1.932,,1.177,0.009,0.055,$214 ,35,1,$214 ,35,712.3677,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.067,,1.248,0.011,0.032,$192 ,65,1,$192 ,65,401.8765,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,2.66,,1.606,0.009,0.076,$303 ,35,1,$303 ,35,434.9877,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.046,,1.242,0.004,0.058,$488 ,35,1,$488 ,35,485.4343,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,4.871,,2.935,0.008,0.039,$594 ,125,1,$594 ,125,239.8346,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,1.55,,0.919,0.006,0.022,$249 ,71,1,$249 ,71,665.2714,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,15.706,,4.572,0.005,0.075,"$3,144 ",210,2,"$1,572 ",105,132.0319,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,152.74,144.16,144.02,0.021,0.339,"$7,166 ",450,2,"$3,583 ",225,14.48,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,47.365,,14.722,0.003,0.116,"$16,954 ",410,2,"$8,477 ",205,44.387,,,
ssd-resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,14.966,,4.35,0.007,0.060,"$2,004 ",250,2,"$1,002 ",125,138.9625,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,3.556,,1.015,0.008,0.127,$469 ,28,1,$469 ,28,284.2379,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,8.239,,2.545,0.018,0.294,$469 ,28,1,$469 ,28,122.4561,,,
ssd-resnet34-1200 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,3.565,,1.01,0.008,0.127,$469 ,28,1,$469 ,28,,,,
ssd-resnet34-1200 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,132.44,18.19,,0.069,0.883,"$1,925 ",150,1,"$1,925 ",150,19.933,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,18.79,,6.86,0.031,0.150,$599 ,125,1,$599 ,125,99.01,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,7.59,,2.3,0.013,0.061,$599 ,125,1,$599 ,125,132.32,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,18.14,,7,0.030,0.145,$599 ,125,1,$599 ,125,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,12.91,,4.36,0.039,0.103,$329 ,125,1,$329 ,125,95.92,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,7.13,,2.16,0.022,0.057,$329 ,125,1,$329 ,125,140.88,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,16.63,,5.72,0.051,0.133,$329 ,125,1,$329 ,125,,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,10.652,,3.873,0.016,0.065,$658 ,165,1,$658 ,165,111.0757,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,7.059,,2.154,0.011,0.043,$658 ,165,1,$658 ,165,142.0745,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,14.933,,4.935,0.023,0.091,$658 ,165,1,$658 ,165,,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.258,,0.039,0.008,0.027,$34 ,9.5,1,$34 ,9.5,3959.594,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.482,,0.061,0.007,0.040,$67 ,12,1,$67 ,12,2094.2569,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,1.994,,0.989,0.030,0.166,$67 ,12,1,$67 ,12,502.6095,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,2.242,,0.597,0.033,0.187,$67 ,12,1,$67 ,12,,,,
unet-camvid--0001 ,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,1.471,,0.374,0.012,0.098,$118 ,15,1,$118 ,15,678.4977,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,2.715,,0.802,0.023,0.181,$118 ,15,1,$118 ,15,368.8973,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,4.12,,1.142,0.035,0.275,$118 ,15,1,$118 ,15,,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,81.838,,19.314,0.017,0.221,"$4,678 ",370,2,"$2,339 ",185,41.506,,,
unet-camvid--0001 ,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,2.482,,1.54,0.021,0.038,$117 ,65,1,$117 ,65,412.1291,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,3.031,,1.9,0.014,0.087,$214 ,35,1,$214 ,35,457.5992,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.227,,2.018,0.017,0.050,$192 ,65,1,$192 ,65,256.5479,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.155,,2.6,0.014,0.119,$303 ,35,1,$303 ,35,277.7416,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,2.907,,2.004,0.006,0.083,$488 ,35,1,$488 ,35,319.7667,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,7.413,,4.615,0.012,0.059,$594 ,125,1,$594 ,125,157.3622,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,2.386,,1.481,0.010,0.034,$249 ,71,1,$249 ,71,422.1157,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,29.251,,7.301,0.009,0.139,"$3,144 ",210,2,"$1,572 ",105,69.3596,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,381.85,151.97,151.98,0.053,0.849,"$7,166 ",450,2,"$3,583 ",225,7.95,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,93.081,,21.382,0.005,0.227,"$16,954 ",410,2,"$8,477 ",205,22.9476,,,
unet-camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,27.814,,6.966,0.014,0.111,"$2,004 ",250,2,"$1,002 ",125,72.9773,,,
unet-camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,6.54,,1.677,0.014,0.234,$469 ,28,1,$469 ,28,152.602,,,
unet-camvid--0001 ,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,15.391,,4.571,0.033,0.550,$469 ,28,1,$469 ,28,61.6002,,,
unet-camvid--0001 ,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,17.962,,4.848,0.038,0.642,$469 ,28,1,$469 ,28,,,,
unet-camvid--0001 ,OV-2022.3-8991,accel,Intel® Flex-170 GPU,218.12,35.2,,0.113,1.454,"$1,925 ",150,1,"$1,925 ",150,7.149,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,802.63,,252.57,1.340,6.421,$599 ,125,1,$599 ,125,2.69,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,249.5,,86.81,0.417,1.996,$599 ,125,1,$599 ,125,4.79,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,795.31,,247.17,1.328,6.362,$599 ,125,1,$599 ,125,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,638.25,,206.62,1.940,5.106,$329 ,125,1,$329 ,125,2.59,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,229.22,,81.49,0.697,1.834,$329 ,125,1,$329 ,125,5.22,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,631.71,,205.81,1.920,5.054,$329 ,125,1,$329 ,125,,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,428.506,,162.077,0.651,2.597,$658 ,165,1,$658 ,165,2.4778,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,245.738,,84.457,0.373,1.489,$658 ,165,1,$658 ,165,3.8792,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,598.947,,195.608,0.910,3.630,$658 ,165,1,$658 ,165,,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,12.406,,6.124,0.365,1.306,$34 ,9.5,1,$34 ,9.5,83.8614,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,22.94,,10.395,0.342,1.912,$67 ,12,1,$67 ,12,44.6243,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,66.641,,38.178,0.995,5.553,$67 ,12,1,$67 ,12,15.7687,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,86.38,,45.819,1.289,7.198,$67 ,12,1,$67 ,12,,,,
yolo_v3_tiny,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,55.629,,18.246,0.471,3.709,$118 ,15,1,$118 ,15,18.2291,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,106.588,,31.376,0.903,7.106,$118 ,15,1,$118 ,15,10.8727,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,153.471,,46.125,1.301,10.231,$118 ,15,1,$118 ,15,,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,2733.627,,761.534,0.584,7.388,"$4,678 ",370,2,"$2,339 ",185,1.1267,,,
yolo_v3_tiny,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,114.701,,66.266,0.980,1.765,$117 ,65,1,$117 ,65,8.9295,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,141.001,,79.694,0.659,4.029,$214 ,35,1,$214 ,35,9.9196,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,145.659,,85.158,0.759,2.241,$192 ,65,1,$192 ,65,5.465,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,191.931,,109.625,0.633,5.484,$303 ,35,1,$303 ,35,5.5981,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,147.041,,84.448,0.301,4.201,$488 ,35,1,$488 ,35,7.0171,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,359.61,,173.635,0.605,2.877,$594 ,125,1,$594 ,125,2.9037,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,109.066,,64.87,0.438,1.536,$249 ,71,1,$249 ,71,9.3792,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,1058.322,,337.035,0.337,5.040,"$3,144 ",210,2,"$1,572 ",105,2.4971,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,7344.88,5212.9,5236.28,1.025,16.322,"$7,166 ",450,2,"$3,583 ",225,1.06,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,2931.242,,901.832,0.173,7.149,"$16,954 ",410,2,"$8,477 ",205,1.215,,,
yolo_v3_tiny,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,1015.77,,321.263,0.507,4.063,"$2,004 ",250,2,"$1,002 ",125,2.6076,,,
yolo_v3_tiny,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,258.05,,79.963,0.550,9.216,$469 ,28,1,$469 ,28,4.1833,,,
yolo_v3_tiny,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,492.645,,157.98,1.050,17.594,$469 ,28,1,$469 ,28,2.5788,,,
yolo_v3_tiny,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,606.117,,186.339,1.292,21.647,$469 ,28,1,$469 ,28,,,,
yolo_v3_tiny,OV-2022.3-8991,accel,Intel® Flex-170 GPU,3634.16,1209.67,,1.888,24.228,"$1,925 ",150,1,"$1,925 ",150,1.293,,,
end_rec,,,,,,,,,,,,,,,,,
begin_rec,,,,,,,,,,,,,,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-13900K CPU-only,37.15,,13.03,0.062,0.297,$599 ,125,1,$599 ,125,55.96,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-13900K iGPU-only,12.92,,4.26,0.022,0.103,$599 ,125,1,$599 ,125,78.73,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-13900K CPU+iGPU,37.16,,13.54,0.062,0.297,$599 ,125,1,$599 ,125,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-13600K CPU-only,25.5,,8.36,0.078,0.204,$329 ,125,1,$329 ,125,53.79,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i5-13600K iGPU-only,12.15,,4,0.037,0.097,$329 ,125,1,$329 ,125,83.64,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i5-13600K CPU+iGPU,31.99,,10.82,0.097,0.256,$329 ,125,1,$329 ,125,,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-12900K CPU-only,21.833,,7.096,0.033,0.132,$658 ,165,1,$658 ,165,58.4745,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i9-12900K iGPU-only,11.956,,3.869,0.018,0.072,$658 ,165,1,$658 ,165,85.1633,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i9-12900K CPU+iGPU,26.693,,8.644,0.041,0.162,$658 ,165,1,$658 ,165,,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x5-E3940 CPU-only,0.522,,0.248,0.015,0.055,$34 ,9.5,1,$34 ,9.5,1900.0218,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Atom™ x6425E CPU-only,0.99,,0.43,0.015,0.083,$67 ,12,1,$67 ,12,1019.82,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Atom™ x6425E iGPU-only,3.413,,1.752,0.051,0.284,$67 ,12,1,$67 ,12,295.7702,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Atom™ x6425E CPU+iGPU,3.999,,2.087,0.060,0.333,$67 ,12,1,$67 ,12,,,,
yolo_v4,OV-2022.3-8991,atom,Intel® Celeron™ 6305E CPU-only,2.453,,0.748,0.021,0.164,$118 ,15,1,$118 ,15,407.2474,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Celeron™ 6305E iGPU-only,4.758,,1.434,0.040,0.317,$118 ,15,1,$118 ,15,212.7987,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Celeron™ 6305E CPU+iGPU,7.048,,2.122,0.060,0.470,$118 ,15,1,$118 ,15,,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6336Y CPU-only,126.954,,35.481,0.027,0.343,"$4,678 ",370,2,"$2,339 ",185,37.8189,,,
yolo_v4,OV-2022.3-8991,core ,Intel® Core™ i3-8100 CPU-only,4.971,,2.885,0.042,0.076,$117 ,65,1,$117 ,65,203.4163,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-10500TE CPU-only,6.182,,3.532,0.029,0.177,$214 ,35,1,$214 ,35,227.5786,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,6.356,,3.757,0.033,0.098,$192 ,65,1,$192 ,65,123.3181,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,8.44,,4.868,0.028,0.241,$303 ,35,1,$303 ,35,135.9719,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i9-10900TE CPU-only,6.399,,3.765,0.013,0.183,$488 ,35,1,$488 ,35,155.642,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® W1290P CPU-only,15.614,,7.925,0.026,0.125,$594 ,125,1,$594 ,125,71.631,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® E-2124G CPU-only,4.674,,2.804,0.019,0.066,$249 ,71,1,$249 ,71,214.0957,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 5218T CPU-only,47.338,,14.464,0.015,0.225,"$3,144 ",210,2,"$1,572 ",105,45.7699,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6448Y CPU-only,252.03,228.55,228.67,0.035,0.560,"$7,166 ",450,2,"$3,583 ",225,15.01,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Platinum 8270 CPU-only,131.466,,41.001,0.008,0.321,"$16,954 ",410,2,"$8,477 ",205,19.2807,,,
yolo_v4,OV-2022.3-8991,xeon,Intel® Xeon® Silver 4216R CPU-only,45.047,,13.741,0.022,0.180,"$2,004 ",250,2,"$1,002 ",125,48.0344,,,
yolo_v4,OV-2022.3-8991,core,Intel® Core™ i7-1165G7 CPU-only,11.067,,3.259,0.024,0.395,$469 ,28,1,$469 ,28,92.2912,,,
yolo_v4,OV-2022.3-8991,core-iGPU,Intel® Core™ i7-1165G7 iGPU-only,25.048,,7.384,0.053,0.895,$469 ,28,1,$469 ,28,39.1492,,,
yolo_v4,OV-2022.3-8991,core-CPU+iGPU,Intel® Core™ i7-1165G7 CPU+iGPU,29.658,,8.32,0.063,1.059,$469 ,28,1,$469 ,28,,,,
yolo_v4,OV-2022.3-8991,accel,Intel® Flex-170 GPU,454.49,56.78,,0.236,3.03,"$1,925 ",150,1,"$1,925 ",150,6.969,,,
end_rec,,,,,,,,,,,,,,,,,
1 Network model Release IE-Type Platform name Throughput-INT8 Throughput-FP16 Throughput-FP32 Value Efficiency Price TDP Sockets Price/socket TDP/socket Latency
2 begin_rec
3 bert-base-cased OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i9-13900K CPU-only 96.06 163.72 35.627 57.83 0.146 0.273 0.582 1.310 $658 $599 165 125 1 $658 $599 165 125 17.1432 15.53
4 bert-base-cased OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only Intel® Core™ i9-13900K iGPU-only 53.093 56.07 22.253 23.3 0.081 0.094 0.322 0.449 $658 $599 165 125 1 $658 $599 165 125 22.0002 19.62
5 bert-base-cased OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 108.306 210.17 44.797 85.83 0.165 0.351 0.656 1.681 $658 $599 165 125 1 $658 $599 165 125
6 bert-base-cased OV-2022.3-8991 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i5-13600K CPU-only 2.763 128.05 1.332 45.94 0.081 0.389 0.291 1.024 $34 $329 9.5 125 1 $34 $329 9.5 125 350.2746 12.71
7 bert-base-cased OV-2022.3-8991 atom core-iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i5-13600K iGPU-only 5.694 53.03 2.002 21.9 0.085 0.161 0.475 0.424 $67 $329 12 125 1 $67 $329 12 125 183.1711 20.81
8 bert-base-cased OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Atom™ x6425E iGPU-only Intel® Core™ i5-13600K CPU+iGPU 16.11 163.33 10.009 64.74 0.24 0.496 1.343 1.307 $67 $329 12 125 1 $67 $329 12 125 79.7607
9 bert-base-cased OV-2022.3-8991 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-12900K CPU-only 21.128 96.06 11.81 35.627 0.315 0.146 1.761 0.582 $67 $658 12 165 1 $67 $658 12 165 17.1432
10 bert-base-cased OV-2022.3-8991 atom core-iGPU Intel® Celeron™ 6305E CPU-only Intel® Core™ i9-12900K iGPU-only 14.212 53.093 4.255 22.253 0.12 0.081 0.947 0.322 $118 $658 15 165 1 $118 $658 15 165 72.6516 22.0002
11 bert-base-cased OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i9-12900K CPU+iGPU 18.983 108.306 8.696 44.797 0.161 0.165 1.266 0.656 $118 $658 15 165 1 $118 $658 15 165 62.9729
12 bert-base-cased OV-2022.3-8991 core-CPU+iGPU atom Intel® Celeron™ 6305E CPU+iGPU Intel® Atom™ x5-E3940 CPU-only 30.866 2.763 12.087 1.332 0.262 0.081 2.058 0.291 $118 $34 15 9.5 1 $118 $34 15 9.5 350.2746
13 bert-base-cased OV-2022.3-8991 xeon atom Intel® Xeon® Gold 6336Y CPU-only Intel® Atom™ x6425E CPU-only 645.77 5.694 213.877 2.002 0.138 0.085 1.745 0.475 $4,678 $67 370 12 2 1 $2,339 $67 185 12 6.7612 183.1711
14 bert-base-cased OV-2022.3-8991 core core-iGPU Intel® Core™ i3-8100 CPU-only Intel® Atom™ x6425E iGPU-only 23.721 16.11 14.457 10.009 0.203 0.240 0.365 1.343 $117 $67 65 12 1 $117 $67 65 12 44.0371 79.7607
15 bert-base-cased OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-10500TE CPU-only Intel® Atom™ x6425E CPU+iGPU 30.141 21.128 16.38 11.81 0.141 0.315 0.861 1.761 $214 $67 35 12 1 $214 $67 35 12 46.6064
16 bert-base-cased OV-2022.3-8991 core atom Intel® Core™ i5-8500 CPU-only Intel® Celeron™ 6305E CPU-only 30.541 14.212 19.319 4.255 0.159 0.120 0.47 0.947 $192 $118 65 15 1 $192 $118 65 15 27.8871 72.6516
17 bert-base-cased OV-2022.3-8991 core core-iGPU Intel® Core™ i7-8700T CPU-only Intel® Celeron™ 6305E iGPU-only 41.504 18.983 22.75 8.696 0.137 0.161 1.186 1.266 $303 $118 35 15 1 $303 $118 35 15 27.974 62.9729
18 bert-base-cased OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i9-10900TE CPU-only Intel® Celeron™ 6305E CPU+iGPU 32.073 30.866 16.558 12.087 0.066 0.262 0.916 2.058 $488 $118 35 15 1 $488 $118 35 15 39.7617
19 bert-base-cased OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® Gold 6336Y CPU-only 69.053 645.77 40.243 213.877 0.116 0.138 0.552 1.745 $594 $4,678 125 370 1 2 $594 $2,339 125 185 18.309 6.7612
20 bert-base-cased OV-2022.3-8991 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i3-8100 CPU-only 23.402 23.721 14.614 14.457 0.094 0.203 0.33 0.365 $249 $117 71 65 1 $249 $117 71 65 44.8984 44.0371
21 bert-base-cased OV-2022.3-8991 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i5-10500TE CPU-only 266.949 30.141 79.033 16.38 0.085 0.141 1.271 0.861 $3,144 $214 210 35 2 1 $1,572 $214 105 35 12.4065 46.6064
22 bert-base-cased OV-2022.3-8991 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i5-8500 CPU-only 2090.76 30.541 326.55 19.319 0.292 0.159 4.646 0.470 $7,166 $192 450 65 2 1 $3,583 $192 225 65 4.61 27.8871
23 bert-base-cased OV-2022.3-8991 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i7-8700T CPU-only 682.593 41.504 225.713 22.75 0.04 0.137 1.665 1.186 $16,954 $303 410 35 2 1 $8,477 $303 205 35 6.9035 27.974
24 bert-base-cased OV-2022.3-8991 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i9-10900TE CPU-only 256.994 32.073 75.502 16.558 0.128 0.066 1.028 0.916 $2,004 $488 250 35 2 1 $1,002 $488 125 35 13.0382 39.7617
25 bert-base-cased OV-2022.3-8991 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® W1290P CPU-only 64.632 69.053 18.394 40.243 0.138 0.116 2.308 0.552 $469 $594 28 125 1 $469 $594 28 125 17.638 18.309
26 bert-base-cased OV-2022.3-8991 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® E-2124G CPU-only 95.656 23.402 44.056 14.614 0.204 0.094 3.416 0.330 $469 $249 28 71 1 $469 $249 28 71 14.1005 44.8984
27 bert-base-cased OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® Gold 5218T CPU-only 128.005 266.949 50.592 79.033 0.273 0.085 4.572 1.271 $469 $3,144 28 210 1 2 $469 $1,572 28 105 12.4065
28 bert-base-cased OV-2022.3-8991 accel xeon Intel® Flex-170 GPU Intel® Xeon® Gold 6448Y CPU-only 906.3 2090.76 348.52 1372.2 1368.68 0.471 0.292 6.042 4.646 $1,925 $7,166 150 450 1 2 $1,925 $3,583 150 225 7.381 4.61
29 end_rec bert-base-cased OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 682.593 225.713 0.040 1.665 $16,954 410 2 $8,477 205 6.9035
30 begin_rec bert-base-cased OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 256.994 75.502 0.128 1.028 $2,004 250 2 $1,002 125 13.0382
31 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-1165G7 CPU-only 7.714 64.632 3.093 18.394 0.012 0.138 0.047 2.308 $658 $469 165 28 1 $658 $469 165 28 155.3633 17.638
32 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only Intel® Core™ i7-1165G7 iGPU-only 5.617 95.656 1.978 44.056 0.009 0.204 0.034 3.416 $658 $469 165 28 1 $658 $469 165 28 181.8303 14.1005
33 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 10.602 128.005 3.753 50.592 0.016 0.273 0.064 4.572 $658 $469 165 28 1 $658 $469 165 28
34 bert-large-uncased-whole-word-masking-squad-0001 bert-base-cased OV-2022.3-8991 atom accel Intel® Atom™ x5-E3940 CPU-only Intel® Flex-170 GPU 0.272 906.3 348.52 0.125 0.008 0.471 0.029 6.042 $34 $1,925 9.5 150 1 $34 $1,925 9.5 150 3861.0657 7.381
35 bert-large-uncased-whole-word-masking-squad-0001 end_rec OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 0.488 0.188 0.007 0.041 $67 12 1 $67 12 2090.8266
36 bert-large-uncased-whole-word-masking-squad-0001 begin_rec OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 1.395 0.774 0.021 0.116 $67 12 1 $67 12 727.6781
37 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-13900K CPU-only 1.827 51.72 0.845 17.6 0.027 0.086 0.152 0.414 $67 $599 12 125 1 $67 $599 12 125 49.13
38 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 atom core-iGPU Intel® Celeron™ 6305E CPU-only Intel® Core™ i9-13900K iGPU-only 1.199 19.05 0.377 6.88 0.01 0.032 0.08 0.152 $118 $599 15 125 1 $118 $599 15 125 831.301 55.82
39 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i9-13900K CPU+iGPU 2.051 53 0.766 19.95 0.017 0.088 0.137 0.424 $118 $599 15 125 1 $118 $599 15 125 494.5363
40 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i5-13600K CPU-only 3.118 35.31 1.127 11.04 0.026 0.107 0.208 0.282 $118 $329 15 125 1 $118 $329 15 125 41.56
41 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i5-13600K iGPU-only 43.436 17.93 17.379 6.46 0.009 0.054 0.117 0.143 $4,678 $329 370 125 2 1 $2,339 $329 185 125 52.2862 59.37
42 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i3-8100 CPU-only Intel® Core™ i5-13600K CPU+iGPU 2.067 43.42 1.278 16.19 0.018 0.132 0.032 0.347 $117 $329 65 125 1 $117 $329 65 125 495.0786
43 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-12900K CPU-only 2.619 7.714 1.536 3.093 0.012 0.075 0.047 $214 $658 35 165 1 $214 $658 35 165 502.3687 155.3633
44 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core core-iGPU Intel® Core™ i5-8500 CPU-only Intel® Core™ i9-12900K iGPU-only 2.72 5.617 1.679 1.978 0.014 0.009 0.042 0.034 $192 $658 65 165 1 $192 $658 65 165 320.168 181.8303
45 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i9-12900K CPU+iGPU 3.625 10.602 2.11 3.753 0.012 0.016 0.104 0.064 $303 $658 35 165 1 $303 $658 35 165 309.2848
46 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core atom Intel® Core™ i9-10900TE CPU-only Intel® Atom™ x5-E3940 CPU-only 2.906 0.272 1.693 0.125 0.006 0.008 0.083 0.029 $488 $34 35 9.5 1 $488 $34 35 9.5 386.4947 3861.0657
47 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon atom Intel® Xeon® W1290P CPU-only Intel® Atom™ x6425E CPU-only 4.801 0.488 2.729 0.188 0.008 0.007 0.038 0.041 $594 $67 125 12 1 $594 $67 125 12 200.0794 2090.8266
48 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® E-2124G CPU-only Intel® Atom™ x6425E iGPU-only 2.098 1.395 1.32 0.774 0.008 0.021 0.03 0.116 $249 $67 71 12 1 $249 $67 71 12 492.0938 727.6781
49 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Atom™ x6425E CPU+iGPU 21.062 1.827 7.021 0.845 0.007 0.027 0.1 0.152 $3,144 $67 210 12 2 1 $1,572 $67 105 12 101.4694
50 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon atom Intel® Xeon® Gold 6448Y CPU-only Intel® Celeron™ 6305E CPU-only 651.95 1.199 91.18 0.377 0.091 0.010 1.449 0.080 $7,166 $118 450 15 2 1 $3,583 $118 225 15 12.87 831.301
51 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Celeron™ 6305E iGPU-only 46.064 2.051 19.051 0.766 0.003 0.017 0.112 0.137 $16,954 $118 410 15 2 1 $8,477 $118 205 15 49.4869 494.5363
52 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Celeron™ 6305E CPU+iGPU 20.014 3.118 6.726 1.127 0.01 0.026 0.08 0.208 $2,004 $118 250 15 2 1 $1,002 $118 125 15 105.9423
53 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® Gold 6336Y CPU-only 5.192 43.436 1.626 17.379 0.011 0.009 0.185 0.117 $469 $4,678 28 370 1 2 $469 $2,339 28 185 203.6311 52.2862
54 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i3-8100 CPU-only 10.476 2.067 3.914 1.278 0.022 0.018 0.374 0.032 $469 $117 28 65 1 $469 $117 28 65 95.6598 495.0786
55 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i5-10500TE CPU-only 11.75 2.619 4.168 1.536 0.025 0.012 0.42 0.075 $469 $214 28 35 1 $469 $214 28 35 502.3687
56 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 accel core Intel® Flex-170 GPU Intel® Core™ i5-8500 CPU-only 74.47 2.72 25.77 1.679 0.039 0.014 0.496 0.042 $1,925 $192 150 65 1 $1,925 $192 150 65 19.768 320.168
57 end_rec bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 3.625 2.11 0.012 0.104 $303 35 1 $303 35 309.2848
58 begin_rec bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 2.906 1.693 0.006 0.083 $488 35 1 $488 35 386.4947
59 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® W1290P CPU-only 99.078 4.801 36.552 2.729 0.151 0.008 0.6 0.038 $658 $594 165 125 1 $658 $594 165 125 11.269 200.0794
60 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® E-2124G CPU-only 57.707 2.098 13.789 1.32 0.088 0.008 0.35 0.030 $658 $249 165 71 1 $658 $249 165 71 16.263 492.0938
61 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Gold 5218T CPU-only 115.59 21.062 39.82 7.021 0.176 0.007 0.701 0.100 $658 $3,144 165 210 1 2 $658 $1,572 165 105 101.4694
62 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® Gold 6448Y CPU-only 3.327 651.95 378.57 1.496 384.02 0.098 0.091 0.35 1.449 $34 $7,166 9.5 450 1 2 $34 $3,583 9.5 225 308.0916 12.87
63 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® Platinum 8270 CPU-only 6.07 46.064 3.041 19.051 0.091 0.003 0.506 0.112 $67 $16,954 12 410 1 2 $67 $8,477 12 205 166.5404 49.4869
64 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® Silver 4216R CPU-only 20.014 5.196 6.726 0 0.010 0 0.080 $67 $2,004 12 250 1 2 $67 $1,002 12 125 217.0439 105.9423
65 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i7-1165G7 CPU-only 9.877 5.192 7.145 1.626 0.147 0.011 0.823 0.185 $67 $469 12 28 1 $67 $469 12 28 203.6311
66 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 atom core-iGPU Intel® Celeron™ 6305E CPU-only Intel® Core™ i7-1165G7 iGPU-only 13.516 10.476 4.681 3.914 0.115 0.022 0.901 0.374 $118 $469 15 28 1 $118 $469 15 28 74.1061 95.6598
67 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i7-1165G7 CPU+iGPU 22.35 11.75 4.635 4.168 0.189 0.025 1.49 0.420 $118 $469 15 28 1 $118 $469 15 28 42.9657
68 deeplabv3 bert-large-uncased-whole-word-masking-squad-0001 OV-2022.3-8991 core-CPU+iGPU accel Intel® Celeron™ 6305E CPU+iGPU Intel® Flex-170 GPU 34.576 74.47 25.77 8.955 0.293 0.039 2.305 0.496 $118 $1,925 15 150 1 $118 $1,925 15 150 19.768
69 deeplabv3 end_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 559.145 134.159 0.12 1.511 $4,678 370 2 $2,339 185 5.356
70 deeplabv3 begin_rec OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 27.171 15.947 0.232 0.418 $117 65 1 $117 65 36.6584
71 deeplabv3 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-13900K CPU-only 34.907 184.93 16.72 63.79 0.163 0.309 0.997 1.479 $214 $599 35 125 1 $214 $599 35 125 38.8986 10.31
72 deeplabv3 OV-2022.3-8991 core core-iGPU Intel® Core™ i5-8500 CPU-only Intel® Core™ i9-13900K iGPU-only 35.07 69.31 20.497 22.67 0.183 0.116 0.54 0.554 $192 $599 65 125 1 $192 $599 65 125 22.1865 15.02
73 deeplabv3 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i9-13900K CPU+iGPU 47.647 191.48 23.747 62.99 0.157 0.320 1.361 1.532 $303 $599 35 125 1 $303 $599 35 125 22.628
74 deeplabv3 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i5-13600K CPU-only 36.559 139.02 18.235 48.48 0.075 0.423 1.045 1.112 $488 $329 35 125 1 $488 $329 35 125 27.138 10.48
75 deeplabv3 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i5-13600K iGPU-only 79.42 65.55 21.03 21.24 0.134 0.199 0.635 0.524 $594 $329 125 1 $594 $329 125 12.8397 16.12
76 deeplabv3 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® E-2124G CPU-only Intel® Core™ i5-13600K CPU+iGPU 26.173 154.19 16.906 52.87 0.105 0.469 0.369 1.234 $249 $329 71 125 1 $249 $329 71 125 37.9245
77 deeplabv3 OV-2022.3-8991 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-12900K CPU-only 248.049 99.078 81.667 36.552 0.079 0.151 1.181 0.600 $3,144 $658 210 165 2 1 $1,572 $658 105 165 8.9485 11.269
78 deeplabv3 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i9-12900K iGPU-only 1139.5 57.707 271.62 13.789 0.159 0.088 2.532 0.350 $7,166 $658 450 165 2 1 $3,583 $658 225 165 2.47 16.263
79 deeplabv3 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-12900K CPU+iGPU 632.113 115.59 168.65 39.82 0.037 0.176 1.542 0.701 $16,954 $658 410 165 2 1 $8,477 $658 205 165 4.0073
80 deeplabv3 OV-2022.3-8991 xeon atom Intel® Xeon® Silver 4216R CPU-only Intel® Atom™ x5-E3940 CPU-only 241.703 3.327 78.963 1.496 0.121 0.098 0.967 0.350 $2,004 $34 250 9.5 2 1 $1,002 $34 125 9.5 9.356 308.0916
81 deeplabv3 OV-2022.3-8991 core atom Intel® Core™ i7-1165G7 CPU-only Intel® Atom™ x6425E CPU-only 64.13 6.07 18.519 3.041 0.137 0.091 2.29 0.506 $469 $67 28 12 1 $469 $67 28 12 16.6586 166.5404
82 deeplabv3 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only Intel® Atom™ x6425E iGPU-only 104.926 24.592 5.196 0.224 0.000 3.747 0.000 $469 $67 28 12 1 $469 $67 28 12 9.1435 217.0439
83 deeplabv3 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 121.441 9.877 30.498 7.145 0.259 0.147 4.337 0.823 $469 $67 28 12 1 $469 $67 28 12
84 deeplabv3 OV-2022.3-8991 accel atom Intel® Flex-170 GPU Intel® Celeron™ 6305E CPU-only 882.04 13.516 98.95 4.681 0.458 0.115 5.88 0.901 $1,925 $118 150 15 1 $1,925 $118 150 15 2.674 74.1061
85 end_rec deeplabv3 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 22.35 4.635 0.189 1.490 $118 15 1 $118 15 42.9657
86 begin_rec deeplabv3 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 34.576 8.955 0.293 2.305 $118 15 1 $118 15
87 densenet-121 deeplabv3 OV-2022.3-8991 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Gold 6336Y CPU-only 457.193 559.145 165.166 134.159 0.695 0.120 2.771 1.511 $658 $4,678 165 370 1 2 $658 $2,339 165 185 3.141 5.356
88 densenet-121 deeplabv3 OV-2022.3-8991 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i3-8100 CPU-only 203.417 27.171 68.438 15.947 0.309 0.232 1.233 0.418 $658 $117 165 65 1 $658 $117 165 65 6.6728 36.6584
89 densenet-121 deeplabv3 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i5-10500TE CPU-only 575.442 34.907 179.858 16.72 0.875 0.163 3.488 0.997 $658 $214 165 35 1 $658 $214 165 35 38.8986
90 densenet-121 deeplabv3 OV-2022.3-8991 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i5-8500 CPU-only 13.344 35.07 5.882 20.497 0.392 0.183 1.405 0.540 $34 $192 9.5 65 1 $34 $192 9.5 65 80.7014 22.1865
91 densenet-121 deeplabv3 OV-2022.3-8991 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i7-8700T CPU-only 24.172 47.647 10.554 23.747 0.361 0.157 2.014 1.361 $67 $303 12 35 1 $67 $303 12 35 43.668 22.628
92 densenet-121 deeplabv3 OV-2022.3-8991 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i9-10900TE CPU-only 36.559 30.615 18.235 0 0.075 0 1.045 $67 $488 12 35 1 $67 $488 12 35 30.0241 27.138
93 densenet-121 deeplabv3 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® W1290P CPU-only 39.365 79.42 38.926 21.03 0.588 0.134 3.28 0.635 $67 $594 12 125 1 $67 $594 12 125 12.8397
94 densenet-121 deeplabv3 OV-2022.3-8991 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® E-2124G CPU-only 58.965 26.173 15.713 16.906 0.5 0.105 3.931 0.369 $118 $249 15 71 1 $118 $249 15 71 18.3425 37.9245
95 densenet-121 deeplabv3 OV-2022.3-8991 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Gold 5218T CPU-only 86.162 248.049 25.34 81.667 0.73 0.079 5.744 1.181 $118 $3,144 15 210 1 2 $118 $1,572 15 105 20.7907 8.9485
96 densenet-121 deeplabv3 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® Gold 6448Y CPU-only 140.891 1139.5 702.28 39.929 699.04 1.194 0.159 9.393 2.532 $118 $7,166 15 450 1 2 $118 $3,583 15 225 2.47
97 densenet-121 deeplabv3 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® Platinum 8270 CPU-only 3094.742 632.113 701.32 168.65 0.662 0.037 8.364 1.542 $4,678 $16,954 370 410 2 $2,339 $8,477 185 205 2.131 4.0073
98 densenet-121 deeplabv3 OV-2022.3-8991 core xeon Intel® Core™ i3-8100 CPU-only Intel® Xeon® Silver 4216R CPU-only 120.121 241.703 66.624 78.963 1.027 0.121 1.848 0.967 $117 $2,004 65 250 1 2 $117 $1,002 65 125 9.3755 9.356
99 densenet-121 deeplabv3 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i7-1165G7 CPU-only 142.623 64.13 80.872 18.519 0.666 0.137 4.075 2.290 $214 $469 35 28 1 $214 $469 35 28 10.2536 16.6586
100 densenet-121 deeplabv3 OV-2022.3-8991 core core-iGPU Intel® Core™ i5-8500 CPU-only Intel® Core™ i7-1165G7 iGPU-only 149.112 104.926 85.051 24.592 0.777 0.224 2.294 3.747 $192 $469 65 28 1 $192 $469 65 28 6.0817 9.1435
101 densenet-121 deeplabv3 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 194.559 121.441 111.988 30.498 0.642 0.259 5.559 4.337 $303 $469 35 28 1 $303 $469 35 28 6.1906
102 densenet-121 deeplabv3 OV-2022.3-8991 core accel Intel® Core™ i9-10900TE CPU-only Intel® Flex-170 GPU 146.463 882.04 98.95 69.186 0.3 0.458 4.185 5.88 $488 $1,925 35 150 1 $488 $1,925 35 150 8.6496 2.674
103 densenet-121 end_rec OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 360.501 182.543 0.607 2.884 $594 125 1 $594 125 3.6046
104 densenet-121 begin_rec OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 114.844 67.188 0.461 1.618 $249 71 1 $249 71 9.7609
105 densenet-121 OV-2022.3-8991 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-13900K CPU-only 1116.372 777.86 295.952 284.56 0.355 1.299 5.316 6.223 $3,144 $599 210 125 2 1 $1,572 $599 105 125 3.9606 3.26
106 densenet-121 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i9-13900K iGPU-only 8279.14 195.3 1137.41 66.46 1.155 0.326 18.398 1.562 $7,166 $599 450 125 2 1 $3,583 $599 225 125 2.39 6.8
107 densenet-121 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-13900K CPU+iGPU 3155.106 899.5 815.725 293.29 0.186 1.502 7.695 7.196 $16,954 $599 410 125 2 1 $8,477 $599 205 125 2.8831
108 densenet-121 OV-2022.3-8991 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i5-13600K CPU-only 1064.824 612.99 283.423 184.9 0.531 1.863 4.259 4.904 $2,004 $329 250 125 2 1 $1,002 $329 125 4.0689 3.12
109 densenet-121 OV-2022.3-8991 core core-iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i5-13600K iGPU-only 265.167 178.37 74.501 62.69 0.565 0.542 9.47 1.427 $469 $329 28 125 1 $469 $329 28 125 4.7413 8.37
110 densenet-121 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i5-13600K CPU+iGPU 391.185 707.99 123.519 207.12 0.834 2.152 13.971 5.664 $469 $329 28 125 1 $469 $329 28 125 6.5259
111 densenet-121 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i9-12900K CPU-only 526.12 457.193 150.35 165.166 1.122 0.695 18.79 2.771 $469 $658 28 165 1 $469 $658 28 165 3.141
112 densenet-121 OV-2022.3-8991 accel core-iGPU Intel® Flex-170 GPU Intel® Core™ i9-12900K iGPU-only 3440.18 203.417 1178.68 68.438 1.787 0.309 22.935 1.233 $1,925 $658 150 165 1 $1,925 $658 150 165 3.302 6.6728
113 end_rec densenet-121 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 575.442 179.858 0.875 3.488 $658 165 1 $658 165
114 begin_rec densenet-121 OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 13.344 5.882 0.392 1.405 $34 9.5 1 $34 9.5 80.7014
115 efficientdet-d0 densenet-121 OV-2022.3-8991 core atom Intel® Core™ i9-12900K CPU-only Intel® Atom™ x6425E CPU-only 112.297 24.172 64.06 10.554 0.171 0.361 0.681 2.014 $658 $67 165 12 1 $658 $67 165 12 11.8265 43.668
116 efficientdet-d0 densenet-121 OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only Intel® Atom™ x6425E iGPU-only 73.766 38.742 30.615 0.112 0.000 0.447 0.000 $658 $67 165 12 1 $658 $67 165 12 21.403 30.0241
117 efficientdet-d0 densenet-121 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 128.735 39.365 76.62 38.926 0.196 0.588 0.78 3.280 $658 $67 165 12 1 $658 $67 165 12
118 efficientdet-d0 densenet-121 OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only Intel® Celeron™ 6305E CPU-only 3.812 58.965 2.565 15.713 0.112 0.500 0.401 3.931 $34 $118 9.5 15 1 $34 $118 9.5 15 274.5947 18.3425
119 efficientdet-d0 densenet-121 OV-2022.3-8991 atom core-iGPU Intel® Atom™ x6425E CPU-only Intel® Celeron™ 6305E iGPU-only 7.248 86.162 5.17 25.34 0.108 0.730 0.604 5.744 $67 $118 12 15 1 $67 $118 12 15 143.7999 20.7907
120 efficientdet-d0 densenet-121 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Atom™ x6425E iGPU-only Intel® Celeron™ 6305E CPU+iGPU 22.697 140.891 15.635 39.929 0.339 1.194 1.891 9.393 $67 $118 12 15 1 $67 $118 12 15 59.0651
121 efficientdet-d0 densenet-121 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only 26.855 3094.742 17.296 701.32 0.401 0.662 2.238 8.364 $67 $4,678 12 370 1 2 $67 $2,339 12 185 2.131
122 efficientdet-d0 densenet-121 OV-2022.3-8991 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i3-8100 CPU-only 15.949 120.121 10.417 66.624 0.135 1.027 1.063 1.848 $118 $117 15 65 1 $118 $117 15 65 62.2765 9.3755
123 efficientdet-d0 densenet-121 OV-2022.3-8991 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i5-10500TE CPU-only 25.936 142.623 14.073 80.872 0.22 0.666 1.729 4.075 $118 $214 15 35 1 $118 $214 15 35 54.0166 10.2536
124 efficientdet-d0 densenet-121 OV-2022.3-8991 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i5-8500 CPU-only 32.767 149.112 20.733 85.051 0.278 0.777 2.184 2.294 $118 $192 15 65 1 $118 $192 15 65 6.0817
125 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-8700T CPU-only 424.388 194.559 256.503 111.988 0.091 0.642 1.147 5.559 $4,678 $303 370 35 2 1 $2,339 $303 185 35 6.1906
126 efficientdet-d0 densenet-121 OV-2022.3-8991 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i9-10900TE CPU-only 36.666 146.463 24.041 69.186 0.313 0.300 0.564 4.185 $117 $488 65 35 1 $117 $488 65 35 30.2521 8.6496
127 efficientdet-d0 densenet-121 OV-2022.3-8991 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® W1290P CPU-only 45.331 360.501 26.92 182.543 0.212 0.607 1.295 2.884 $214 $594 35 125 1 $214 $594 35 125 32.8946 3.6046
128 efficientdet-d0 densenet-121 OV-2022.3-8991 core xeon Intel® Core™ i5-8500 CPU-only Intel® Xeon® E-2124G CPU-only 44.921 114.844 32.357 67.188 0.234 0.461 0.691 1.618 $192 $249 65 71 1 $192 $249 65 71 19.7048 9.7609
129 efficientdet-d0 densenet-121 OV-2022.3-8991 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® Gold 5218T CPU-only 62.749 1116.372 37.807 295.952 0.207 0.355 1.793 5.316 $303 $3,144 35 210 1 2 $303 $1,572 35 105 19.901 3.9606
130 efficientdet-d0 densenet-121 OV-2022.3-8991 core xeon Intel® Core™ i9-10900TE CPU-only Intel® Xeon® Gold 6448Y CPU-only 50.35 8279.14 4856.54 29.935 4862.51 0.103 1.155 1.439 18.398 $488 $7,166 35 450 1 2 $488 $3,583 35 225 24.2916 2.39
131 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® Platinum 8270 CPU-only 94.981 3155.106 36.434 815.725 0.16 0.186 0.76 7.695 $594 $16,954 125 410 1 2 $594 $8,477 125 205 12.658 2.8831
132 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® Silver 4216R CPU-only 35.831 1064.824 27.306 283.423 0.144 0.531 0.505 4.259 $249 $2,004 71 250 1 2 $249 $1,002 71 125 30.9469 4.0689
133 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i7-1165G7 CPU-only 239.06 265.167 161.224 74.501 0.076 0.565 1.138 9.470 $3,144 $469 210 28 2 1 $1,572 $469 105 28 13.9735 4.7413
134 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i7-1165G7 iGPU-only 875.53 391.185 560.48 123.519 0.122 0.834 1.946 13.971 $7,166 $469 450 28 2 1 $3,583 $469 225 28 5.07 6.5259
135 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 471.02 526.12 300.291 150.35 0.028 1.122 1.149 18.790 $16,954 $469 410 28 2 1 $8,477 $469 205 28 9.3866
136 efficientdet-d0 densenet-121 OV-2022.3-8991 xeon accel Intel® Xeon® Silver 4216R CPU-only Intel® Flex-170 GPU 231.873 3440.18 1178.68 156.285 0.116 1.787 0.927 22.935 $2,004 $1,925 250 150 2 1 $1,002 $1,925 125 150 14.1605 3.302
137 efficientdet-d0 end_rec OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 71.482 41.123 0.152 2.553 $469 28 1 $469 28 16.6952
138 efficientdet-d0 begin_rec OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 92.52 50.538 0.197 3.304 $469 28 1 $469 28 17.295
139 efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i9-13900K CPU-only 107.688 209.26 56.901 106.11 0.23 0.349 3.846 1.674 $469 $599 28 125 1 $469 $599 28 125 10.36
140 efficientdet-d0 OV-2022.3-8991 accel core-iGPU Intel® Flex-170 GPU Intel® Core™ i9-13900K iGPU-only 463.67 82.04 295.13 47.85 0.241 0.137 3.091 0.656 $1,925 $599 150 125 1 $1,925 $599 150 125 5.603 22.35
141 end_rec efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 197.85 108.3 0.330 1.583 $599 125 1 $599 125
142 begin_rec efficientdet-d0 OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 155.65 90.91 0.473 1.245 $329 125 1 $329 125 9.92
143 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core core-iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i5-13600K iGPU-only 12.921 77.28 4.016 44.91 0.02 0.235 0.078 0.618 $658 $329 165 125 1 $658 $329 165 125 89.8929 22.93
144 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Core™ i9-12900K iGPU-only Intel® Core™ i5-13600K CPU+iGPU 6.802 172.54 1.82 95.94 0.01 0.524 0.041 1.380 $658 $329 165 125 1 $658 $329 165 125 149.7396
145 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i9-12900K CPU-only 15.679 112.297 4.499 64.06 0.024 0.171 0.095 0.681 $658 165 1 $658 165 11.8265
146 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 atom core-iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-12900K iGPU-only 0.32 73.766 0.131 38.742 0.009 0.112 0.034 0.447 $34 $658 9.5 165 1 $34 $658 9.5 165 3206.1652 21.403
147 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 atom core-CPU+iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i9-12900K CPU+iGPU 0.592 128.735 0.242 76.62 0.009 0.196 0.049 0.780 $67 $658 12 165 1 $67 $658 12 165 1727.27
148 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-iGPU atom Intel® Atom™ x6425E iGPU-only Intel® Atom™ x5-E3940 CPU-only 1.301 3.812 0.728 2.565 0.019 0.112 0.108 0.401 $67 $34 12 9.5 1 $67 $34 12 9.5 776.0692 274.5947
149 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU atom Intel® Atom™ x6425E CPU+iGPU Intel® Atom™ x6425E CPU-only 1.683 7.248 0.865 5.17 0.025 0.108 0.14 0.604 $67 12 1 $67 12 143.7999
150 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 atom core-iGPU Intel® Celeron™ 6305E CPU-only Intel® Atom™ x6425E iGPU-only 1.563 22.697 0.417 15.635 0.013 0.339 0.104 1.891 $118 $67 15 12 1 $118 $67 15 12 640.0005 59.0651
151 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Celeron™ 6305E iGPU-only Intel® Atom™ x6425E CPU+iGPU 2.616 26.855 0.725 17.296 0.022 0.401 0.174 2.238 $118 $67 15 12 1 $118 $67 15 12 389.3563
152 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU atom Intel® Celeron™ 6305E CPU+iGPU Intel® Celeron™ 6305E CPU-only 4.056 15.949 1.107 10.417 0.034 0.135 0.27 1.063 $118 15 1 $118 15 62.2765
153 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Celeron™ 6305E iGPU-only 74.93 25.936 19.965 14.073 0.016 0.220 0.203 1.729 $4,678 $118 370 15 2 1 $2,339 $118 185 15 65.5753 54.0166
154 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i3-8100 CPU-only Intel® Celeron™ 6305E CPU+iGPU 2.988 32.767 1.473 20.733 0.026 0.278 0.046 2.184 $117 $118 65 15 1 $117 $118 65 15 340.7313
155 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® Gold 6336Y CPU-only 3.633 424.388 1.926 256.503 0.017 0.091 0.104 1.147 $214 $4,678 35 370 1 2 $214 $2,339 35 185 430.1967
156 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core core Intel® Core™ i5-8500 CPU-only Intel® Core™ i3-8100 CPU-only 3.852 36.666 1.982 24.041 0.02 0.313 0.059 0.564 $192 $117 65 1 $192 $117 65 241.5513 30.2521
157 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i5-10500TE CPU-only 4.999 45.331 2.648 26.92 0.016 0.212 0.143 1.295 $303 $214 35 1 $303 $214 35 260.2284 32.8946
158 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i5-8500 CPU-only 3.71 44.921 2.005 32.357 0.008 0.234 0.106 0.691 $488 $192 35 65 1 $488 $192 35 65 280.1493 19.7048
159 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i7-8700T CPU-only 8.977 62.749 4.542 37.807 0.015 0.207 0.072 1.793 $594 $303 125 35 1 $594 $303 125 35 137.1747 19.901
160 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-10900TE CPU-only 2.867 50.35 1.464 29.935 0.012 0.103 0.04 1.439 $249 $488 71 35 1 $249 $488 71 35 353.2042 24.2916
161 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® W1290P CPU-only 29.332 94.981 8.19 36.434 0.009 0.160 0.14 0.760 $3,144 $594 210 125 2 1 $1,572 $594 105 125 78.1722 12.658
162 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only Intel® Xeon® E-2124G CPU-only 282.45 35.831 32.43 27.306 0.003 0.144 0.044 0.505 $7,166 $249 450 71 2 1 $3,583 $249 225 71 12.03 30.9469
163 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Gold 5218T CPU-only 85.213 239.06 22.066 161.224 0.005 0.076 0.208 1.138 $16,954 $3,144 410 210 2 $8,477 $1,572 205 105 30.4317 13.9735
164 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® Gold 6448Y CPU-only 27.847 875.53 495.04 7.786 492.93 0.014 0.122 0.111 1.946 $2,004 $7,166 250 450 2 $1,002 $3,583 125 225 78.6604 5.07
165 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® Platinum 8270 CPU-only 7.027 471.02 1.855 300.291 0.015 0.028 0.251 1.149 $469 $16,954 28 410 1 2 $469 $8,477 28 205 151.8783 9.3866
166 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® Silver 4216R CPU-only 13.823 231.873 3.545 156.285 0.029 0.116 0.494 0.927 $469 $2,004 28 250 1 2 $469 $1,002 28 125 70.7933 14.1605
167 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i7-1165G7 CPU-only 16.898 71.482 4.191 41.123 0.036 0.152 0.604 2.553 $469 28 1 $469 28 16.6952
168 faster_rcnn_resnet50_coco efficientdet-d0 OV-2022.3-8991 accel core-iGPU Intel® Flex-170 GPU Intel® Core™ i7-1165G7 iGPU-only 216.3 92.52 23.42 50.538 0.112 0.197 1.442 3.304 $1,925 $469 150 28 1 $1,925 $469 150 28 9.137 17.295
169 end_rec efficientdet-d0 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 107.688 56.901 0.230 3.846 $469 28 1 $469 28
170 begin_rec efficientdet-d0 OV-2022.3-8991 accel Intel® Flex-170 GPU 463.67 295.13 0.241 3.091 $1,925 150 1 $1,925 150 5.603
171 Inception-V4 end_rec OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 121.813 39.391 0.185 0.738 $658 165 1 $658 165 11.0425
172 Inception-V4 begin_rec OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 71.229 17.755 0.108 0.432 $658 165 1 $658 165 19.7132
173 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i9-13900K CPU-only 175.049 5.94 44.894 2.41 0.266 0.010 1.061 0.048 $658 $599 165 125 1 $658 $599 165 125 270.57
174 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 atom core-iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-13900K iGPU-only 3.12 2.3 1.344 0.71 0.092 0.004 0.328 0.018 $34 $599 9.5 125 1 $34 $599 9.5 125 335.3712 437.94
175 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 atom core-CPU+iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i9-13900K CPU+iGPU 5.677 6.45 2.364 2.25 0.085 0.011 0.473 0.052 $67 $599 12 125 1 $67 $599 12 125 181.8897
176 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i5-13600K CPU-only 17.009 4.55 8.302 1.88 0.254 0.014 1.417 0.036 $67 $329 12 125 1 $67 $329 12 125 78.0548 310.58
177 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i5-13600K iGPU-only 21.713 2.17 10.37 0.67 0.324 0.007 1.809 0.017 $67 $329 12 125 1 $67 $329 12 125 465.03
178 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 atom core-CPU+iGPU Intel® Celeron™ 6305E CPU-only Intel® Core™ i5-13600K CPU+iGPU 15.576 5.3 4.073 2.01 0.132 0.016 1.038 0.042 $118 $329 15 125 1 $118 $329 15 125 65.7272
179 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i9-12900K CPU-only 28.105 12.921 6.681 4.016 0.238 0.020 1.874 0.078 $118 $658 15 165 1 $118 $658 15 165 46.2616 89.8929
180 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i9-12900K iGPU-only 41.918 6.802 10.163 1.82 0.355 0.010 2.795 0.041 $118 $658 15 165 1 $118 $658 15 165 149.7396
181 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i9-12900K CPU+iGPU 881.403 15.679 205.296 4.499 0.188 0.024 2.382 0.095 $4,678 $658 370 165 2 1 $2,339 $658 185 165 4.7029
182 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core atom Intel® Core™ i3-8100 CPU-only Intel® Atom™ x5-E3940 CPU-only 30.004 0.32 15.51 0.131 0.256 0.009 0.462 0.034 $117 $34 65 9.5 1 $117 $34 65 9.5 35.0513 3206.1652
183 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core atom Intel® Core™ i5-10500TE CPU-only Intel® Atom™ x6425E CPU-only 35.882 0.592 19.222 0.242 0.168 0.009 1.025 0.049 $214 $67 35 12 1 $214 $67 35 12 37.6472 1727.27
184 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core core-iGPU Intel® Core™ i5-8500 CPU-only Intel® Atom™ x6425E iGPU-only 37.987 1.301 19.998 0.728 0.198 0.019 0.584 0.108 $192 $67 65 12 1 $192 $67 65 12 21.5144 776.0692
185 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-8700T CPU-only Intel® Atom™ x6425E CPU+iGPU 48.903 1.683 26.356 0.865 0.161 0.025 1.397 0.140 $303 $67 35 12 1 $303 $67 35 12 22.2402
186 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core atom Intel® Core™ i9-10900TE CPU-only Intel® Celeron™ 6305E CPU-only 37.301 1.563 19.475 0.417 0.076 0.013 1.066 0.104 $488 $118 35 15 1 $488 $118 35 15 28.572 640.0005
187 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core-iGPU Intel® Xeon® W1290P CPU-only Intel® Celeron™ 6305E iGPU-only 92.646 2.616 44.966 0.725 0.156 0.022 0.741 0.174 $594 $118 125 15 1 $594 $118 125 15 12.3153 389.3563
188 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® E-2124G CPU-only Intel® Celeron™ 6305E CPU+iGPU 28.537 4.056 15.13 1.107 0.115 0.034 0.402 0.270 $249 $118 71 15 1 $249 $118 71 15 36.8888
189 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® Gold 6336Y CPU-only 301.215 74.93 77.005 19.965 0.096 0.016 1.434 0.203 $3,144 $4,678 210 370 2 $1,572 $2,339 105 185 10.5711 65.5753
190 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i3-8100 CPU-only 3406.7 2.988 331.56 1.473 0.475 0.026 7.57 0.046 $7,166 $117 450 65 2 1 $3,583 $117 225 65 3.23 340.7313
191 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i5-10500TE CPU-only 937.139 3.633 225.776 1.926 0.055 0.017 2.286 0.104 $16,954 $214 410 35 2 1 $8,477 $214 205 35 5.6984 430.1967
192 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i5-8500 CPU-only 287.767 3.852 73.617 1.982 0.144 0.020 1.151 0.059 $2,004 $192 250 65 2 1 $1,002 $192 125 65 11.1114 241.5513
193 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i7-8700T CPU-only 71.295 4.999 18.482 2.648 0.152 0.016 2.546 0.143 $469 $303 28 35 1 $469 $303 28 35 15.8294 260.2284
194 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i9-10900TE CPU-only 158.282 3.71 36.884 2.005 0.337 0.008 5.653 0.106 $469 $488 28 35 1 $469 $488 28 35 10.6245 280.1493
195 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® W1290P CPU-only 182.132 8.977 44.198 4.542 0.388 0.015 6.505 0.072 $469 $594 28 125 1 $469 $594 28 125 137.1747
196 Inception-V4 faster_rcnn_resnet50_coco OV-2022.3-8991 accel xeon Intel® Flex-170 GPU Intel® Xeon® E-2124G CPU-only 2986.91 2.867 298.6 1.464 1.552 0.012 19.913 0.040 $1,925 $249 150 71 1 $1,925 $249 150 71 3.968 353.2042
197 end_rec faster_rcnn_resnet50_coco OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 29.332 8.19 0.009 0.140 $3,144 210 2 $1,572 105 78.1722
198 begin_rec faster_rcnn_resnet50_coco OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 19.71 18.01 18.15 0.003 0.044 $7,166 450 2 $3,583 225 129.2
199 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Platinum 8270 CPU-only 1054.462 85.213 346.546 22.066 1.603 0.005 6.391 0.208 $658 $16,954 165 410 1 2 $658 $8,477 165 205 1.4898 30.4317
200 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® Silver 4216R CPU-only 493.088 27.847 145.503 7.786 0.749 0.014 2.988 0.111 $658 $2,004 165 250 1 2 $658 $1,002 165 125 2.472 78.6604
201 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-1165G7 CPU-only 1056.241 7.027 361.472 1.855 1.605 0.015 6.401 0.251 $658 $469 165 28 1 $658 $469 165 28 151.8783
202 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 atom core-iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i7-1165G7 iGPU-only 28.032 13.823 12.691 3.545 0.824 0.029 2.951 0.494 $34 $469 9.5 28 1 $34 $469 9.5 28 38.1991 70.7933
203 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 atom core-CPU+iGPU Intel® Atom™ x6425E CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 50.352 16.898 23.675 4.191 0.752 0.036 4.196 0.604 $67 $469 12 28 1 $67 $469 12 28 20.8993
204 mobilenet-ssd faster_rcnn_resnet50_coco OV-2022.3-8991 core-iGPU accel Intel® Atom™ x6425E iGPU-only Intel® Flex-170 GPU 100.377 216.3 23.42 60.647 1.498 0.112 8.365 1.442 $67 $1,925 12 150 1 $67 $1,925 12 150 11.6812 9.137
205 mobilenet-ssd end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 148.458 79.575 2.216 12.372 $67 12 1 $67 12
206 mobilenet-ssd begin_rec OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 123.806 38.981 1.049 8.254 $118 15 1 $118 15 8.4121
207 mobilenet-ssd Inception-V4 OV-2022.3-8991 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i9-13900K CPU-only 168.473 219.06 53.272 71.15 1.428 0.366 11.232 1.752 $118 $599 15 125 1 $118 $599 15 125 7.8961 10.19
208 mobilenet-ssd Inception-V4 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i9-13900K iGPU-only 238.511 65.91 83.721 18.1 2.021 0.110 15.901 0.527 $118 $599 15 125 1 $118 $599 15 125 16.55
209 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i9-13900K CPU+iGPU 6730.68 279.58 1634.937 78.65 1.439 0.467 18.191 2.237 $4,678 $599 370 125 2 1 $2,339 $599 185 125 0.7265
210 mobilenet-ssd Inception-V4 OV-2022.3-8991 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i5-13600K CPU-only 244.598 171.19 140.009 45.8 2.091 0.520 3.763 1.370 $117 $329 65 125 1 $117 $329 65 125 4.4481 9.14
211 mobilenet-ssd Inception-V4 OV-2022.3-8991 core core-iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i5-13600K iGPU-only 303.938 62.45 173.562 17.02 1.42 0.190 8.684 0.500 $214 $329 35 125 1 $214 $329 35 125 4.7946 17.48
212 mobilenet-ssd Inception-V4 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-13600K CPU+iGPU 304.802 219.02 185.045 52.56 1.588 0.666 4.689 1.752 $192 $329 65 125 1 $192 $329 65 125 2.8007
213 mobilenet-ssd Inception-V4 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i9-12900K CPU-only 412.261 121.813 241.37 39.391 1.361 0.185 11.779 0.738 $303 $658 35 165 1 $303 $658 35 165 2.8749 11.0425
214 mobilenet-ssd Inception-V4 OV-2022.3-8991 core core-iGPU Intel® Core™ i9-10900TE CPU-only Intel® Core™ i9-12900K iGPU-only 315.107 71.229 152.342 17.755 0.646 0.108 9.003 0.432 $488 $658 35 165 1 $488 $658 35 165 3.5896 19.7132
215 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900K CPU+iGPU 774.346 175.049 345.309 44.894 1.304 0.266 6.195 1.061 $594 $658 125 165 1 $594 $658 125 165 1.5452
216 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon atom Intel® Xeon® E-2124G CPU-only Intel® Atom™ x5-E3940 CPU-only 233.43 3.12 147.098 1.344 0.937 0.092 3.288 0.328 $249 $34 71 9.5 1 $249 $34 71 9.5 4.5879 335.3712
217 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon atom Intel® Xeon® Gold 5218T CPU-only Intel® Atom™ x6425E CPU-only 2331.207 5.677 691.743 2.364 0.741 0.085 11.101 0.473 $3,144 $67 210 12 2 1 $1,572 $67 105 12 1.4852 181.8897
218 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Atom™ x6425E iGPU-only 16445.75 17.009 2736.2 8.302 2.295 0.254 36.546 1.417 $7,166 $67 450 12 2 1 $3,583 $67 225 12 0.65 78.0548
219 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Atom™ x6425E CPU+iGPU 6691.915 21.713 1796.357 10.37 0.395 0.324 16.322 1.809 $16,954 $67 410 12 2 1 $8,477 $67 205 12 1.0518
220 mobilenet-ssd Inception-V4 OV-2022.3-8991 xeon atom Intel® Xeon® Silver 4216R CPU-only Intel® Celeron™ 6305E CPU-only 2225.935 15.576 667.692 4.073 1.111 0.132 8.904 1.038 $2,004 $118 250 15 2 1 $1,002 $118 125 15 1.5444 65.7272
221 mobilenet-ssd Inception-V4 OV-2022.3-8991 core core-iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Celeron™ 6305E iGPU-only 579.307 28.105 166.959 6.681 1.235 0.238 20.69 1.874 $469 $118 28 15 1 $469 $118 28 15 2.0215 46.2616
222 mobilenet-ssd Inception-V4 OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Core™ i7-1165G7 iGPU-only Intel® Celeron™ 6305E CPU+iGPU 582.636 41.918 243.945 10.163 1.242 0.355 20.808 2.795 $469 $118 28 15 1 $469 $118 28 15 2.548
223 mobilenet-ssd Inception-V4 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only 744.231 881.403 292.071 205.296 1.587 0.188 26.58 2.382 $469 $4,678 28 370 1 2 $469 $2,339 28 185 4.7029
224 mobilenet-ssd Inception-V4 OV-2022.3-8991 accel core Intel® Flex-170 GPU Intel® Core™ i3-8100 CPU-only 3548.98 30.004 1412.68 15.51 1.844 0.256 23.66 0.462 $1,925 $117 150 65 1 $1,925 $117 150 65 1.344 35.0513
225 end_rec Inception-V4 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 35.882 19.222 0.168 1.025 $214 35 1 $214 35 37.6472
226 begin_rec Inception-V4 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 37.987 19.998 0.198 0.584 $192 65 1 $192 65 21.5144
227 mobilenet-v2 Inception-V4 OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-8700T CPU-only 2446.221 48.903 1003.129 26.356 3.718 0.161 14.826 1.397 $658 $303 165 35 1 $658 $303 165 35 0.7182 22.2402
228 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i9-10900TE CPU-only 1265.969 37.301 389.894 19.475 1.924 0.076 7.673 1.066 $658 $488 165 35 1 $658 $488 165 35 1.3894 28.572
229 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® W1290P CPU-only 2680.458 92.646 1013.049 44.966 4.074 0.156 16.245 0.741 $658 $594 165 125 1 $658 $594 165 125 12.3153
230 mobilenet-v2 Inception-V4 OV-2022.3-8991 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® E-2124G CPU-only 81.572 28.537 45.013 15.13 2.399 0.115 8.587 0.402 $34 $249 9.5 71 1 $34 $249 9.5 71 13.4692 36.8888
231 mobilenet-v2 Inception-V4 OV-2022.3-8991 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® Gold 5218T CPU-only 143.134 301.215 81.991 77.005 2.136 0.096 11.928 1.434 $67 $3,144 12 210 1 2 $67 $1,572 12 105 7.609 10.5711
232 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® Gold 6448Y CPU-only 3406.7 1879.09 164.945 1867.99 0 0.475 0 7.570 $67 $7,166 12 450 1 2 $67 $3,583 12 225 7.0306 3.23
233 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 227.898 937.139 202.181 225.776 3.401 0.055 18.992 2.286 $67 $16,954 12 410 1 2 $67 $8,477 12 205 5.6984
234 mobilenet-v2 Inception-V4 OV-2022.3-8991 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Silver 4216R CPU-only 316.763 287.767 124.654 73.617 2.684 0.144 21.118 1.151 $118 $2,004 15 250 1 2 $118 $1,002 15 125 3.391 11.1114
235 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-iGPU core Intel® Celeron™ 6305E iGPU-only Intel® Core™ i7-1165G7 CPU-only 525.084 71.295 141.61 18.482 4.45 0.152 35.006 2.546 $118 $469 15 28 1 $118 $469 15 28 4.9197 15.8294
236 mobilenet-v2 Inception-V4 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i7-1165G7 iGPU-only 807.397 158.282 255.964 36.884 6.842 0.337 53.826 5.653 $118 $469 15 28 1 $118 $469 15 28 10.6245
237 mobilenet-v2 Inception-V4 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 14679.84 182.132 4065.139 44.198 3.138 0.388 39.675 6.505 $4,678 $469 370 28 2 1 $2,339 $469 185 28 0.4828
238 mobilenet-v2 Inception-V4 OV-2022.3-8991 core accel Intel® Core™ i3-8100 CPU-only Intel® Flex-170 GPU 619.507 2986.91 298.6 452.366 5.295 1.552 9.531 19.913 $117 $1,925 65 150 1 $117 $1,925 65 150 1.8067 3.968
239 mobilenet-v2 end_rec OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 806.314 441.904 3.768 23.038 $214 35 1 $214 35 2.1078
240 mobilenet-v2 begin_rec OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 766.072 558.975 3.99 11.786 $192 65 1 $192 65 1.2307
241 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i9-13900K CPU-only 1081.253 1754.44 664.108 664.82 3.568 2.929 30.893 14.036 $303 $599 35 125 1 $303 $599 35 125 1.2788 1.4
242 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 core core-iGPU Intel® Core™ i9-10900TE CPU-only Intel® Core™ i9-13900K iGPU-only 825.071 528.03 413.091 168.57 1.691 0.882 23.573 4.224 $488 $599 35 125 1 $488 $599 35 125 1.6818 2.35
243 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i9-13900K CPU+iGPU 2067.162 1568.83 868.25 665.79 3.48 2.619 16.537 12.551 $594 $599 125 1 $594 $599 125 0.7363
244 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i5-13600K CPU-only 594.283 1240.01 479.567 437.11 2.387 3.769 8.37 9.920 $249 $329 71 125 1 $249 $329 71 125 1.8531 1.47
245 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i5-13600K iGPU-only 5882.455 493.18 1895.498 157.94 1.871 1.499 28.012 3.945 $3,144 $329 210 125 2 1 $1,572 $329 105 125 1.3871 2.43
246 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i5-13600K CPU+iGPU 28383.76 1063.27 7254.28 454.21 3.961 3.232 63.075 8.506 $7,166 $329 450 125 2 1 $3,583 $329 225 125 0.55
247 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-12900K CPU-only 15616.083 1054.462 4308.927 346.546 0.921 1.603 38.088 6.391 $16,954 $658 410 165 2 1 $8,477 $658 205 165 0.8685 1.4898
248 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i9-12900K iGPU-only 5616.283 493.088 1835.686 145.503 2.803 0.749 22.465 2.988 $2,004 $658 250 165 2 1 $1,002 $658 125 165 1.404 2.472
249 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i9-12900K CPU+iGPU 1463.21 1056.241 538.597 361.472 3.12 1.605 52.258 6.401 $469 $658 28 165 1 $469 $658 28 165 0.8864
250 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 core-iGPU atom Intel® Core™ i7-1165G7 iGPU-only Intel® Atom™ x5-E3940 CPU-only 2076.015 28.032 544.641 12.691 4.426 0.824 74.143 2.951 $469 $34 28 9.5 1 $469 $34 28 9.5 1.7212 38.1991
251 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 core-CPU+iGPU atom Intel® Core™ i7-1165G7 CPU+iGPU Intel® Atom™ x6425E CPU-only 2677.374 50.352 698.942 23.675 5.709 0.752 95.621 4.196 $469 $67 28 12 1 $469 $67 28 12 20.8993
252 mobilenet-v2 mobilenet-ssd OV-2022.3-8991 accel core-iGPU Intel® Flex-170 GPU Intel® Atom™ x6425E iGPU-only 18371.95 100.377 4738.33 60.647 9.544 1.498 122.48 8.365 $1,925 $67 150 12 1 $1,925 $67 150 12 1.15 11.6812
253 end_rec mobilenet-ssd OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 148.458 79.575 2.216 12.372 $67 12 1 $67 12
254 begin_rec mobilenet-ssd OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 123.806 38.981 1.049 8.254 $118 15 1 $118 15 8.4121
255 resnet-18 mobilenet-ssd OV-2022.3-8991 core core-iGPU Intel® Core™ i9-12900K CPU-only Intel® Celeron™ 6305E iGPU-only 804.771 168.473 212.574 53.272 1.223 1.428 4.877 11.232 $658 $118 165 15 1 $658 $118 165 15 1.3886 7.8961
256 resnet-18 mobilenet-ssd OV-2022.3-8991 core-iGPU core-CPU+iGPU Intel® Core™ i9-12900K iGPU-only Intel® Celeron™ 6305E CPU+iGPU 491.337 238.511 146.839 83.721 0.747 2.021 2.978 15.901 $658 $118 165 15 1 $658 $118 165 15 2.2655
257 resnet-18 mobilenet-ssd OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only 1180.984 6730.68 365.777 1634.937 1.795 1.439 7.157 18.191 $658 $4,678 165 370 1 2 $658 $2,339 165 185 0.7265
258 resnet-18 mobilenet-ssd OV-2022.3-8991 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i3-8100 CPU-only 22.96 244.598 9.564 140.009 0.675 2.091 2.417 3.763 $34 $117 9.5 65 1 $34 $117 9.5 65 44.5491 4.4481
259 resnet-18 mobilenet-ssd OV-2022.3-8991 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i5-10500TE CPU-only 40.944 303.938 16.158 173.562 0.611 1.420 3.412 8.684 $67 $214 12 35 1 $67 $214 12 35 25.1377 4.7946
260 resnet-18 mobilenet-ssd OV-2022.3-8991 core-iGPU core Intel® Atom™ x6425E iGPU-only Intel® Core™ i5-8500 CPU-only 161.381 304.802 60.863 185.045 2.409 1.588 13.448 4.689 $67 $192 12 65 1 $67 $192 12 65 10.983 2.8007
261 resnet-18 mobilenet-ssd OV-2022.3-8991 core-CPU+iGPU core Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i7-8700T CPU-only 197.477 412.261 73.927 241.37 2.947 1.361 16.456 11.779 $67 $303 12 35 1 $67 $303 12 35 2.8749
262 resnet-18 mobilenet-ssd OV-2022.3-8991 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i9-10900TE CPU-only 105.574 315.107 28.914 152.342 0.895 0.646 7.038 9.003 $118 $488 15 35 1 $118 $488 15 35 9.6165 3.5896
263 resnet-18 mobilenet-ssd OV-2022.3-8991 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® W1290P CPU-only 194.694 774.346 55.341 345.309 1.65 1.304 12.98 6.195 $118 $594 15 125 1 $118 $594 15 125 6.643 1.5452
264 resnet-18 mobilenet-ssd OV-2022.3-8991 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® E-2124G CPU-only 291.441 233.43 82.105 147.098 2.47 0.937 19.429 3.288 $118 $249 15 71 1 $118 $249 15 71 4.5879
265 resnet-18 mobilenet-ssd OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only Intel® Xeon® Gold 5218T CPU-only 5761.961 2331.207 1431.864 691.743 1.232 0.741 15.573 11.101 $4,678 $3,144 370 210 2 $2,339 $1,572 185 105 0.6512 1.4852
266 resnet-18 mobilenet-ssd OV-2022.3-8991 core xeon Intel® Core™ i3-8100 CPU-only Intel® Xeon® Gold 6448Y CPU-only 208.65 16445.75 8733.64 103.699 8626.42 1.783 2.295 3.21 36.546 $117 $7,166 65 450 1 2 $117 $3,583 65 225 5.0231 0.65
267 resnet-18 mobilenet-ssd OV-2022.3-8991 core xeon Intel® Core™ i5-10500TE CPU-only Intel® Xeon® Platinum 8270 CPU-only 252.987 6691.915 127.448 1796.357 1.182 0.395 7.228 16.322 $214 $16,954 35 410 1 2 $214 $8,477 35 205 5.2921 1.0518
268 resnet-18 mobilenet-ssd OV-2022.3-8991 core xeon Intel® Core™ i5-8500 CPU-only Intel® Xeon® Silver 4216R CPU-only 262.785 2225.935 134.002 667.692 1.369 1.111 4.043 8.904 $192 $2,004 65 250 1 2 $192 $1,002 65 125 3.0597 1.5444
269 resnet-18 mobilenet-ssd OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only Intel® Core™ i7-1165G7 CPU-only 344.219 579.307 175.433 166.959 1.136 1.235 9.835 20.690 $303 $469 35 28 1 $303 $469 35 28 3.1665 2.0215
270 resnet-18 mobilenet-ssd OV-2022.3-8991 core core-iGPU Intel® Core™ i9-10900TE CPU-only Intel® Core™ i7-1165G7 iGPU-only 265.351 582.636 130.166 243.945 0.544 1.242 7.581 20.808 $488 $469 35 28 1 $488 $469 35 28 4.0471 2.548
271 resnet-18 mobilenet-ssd OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® W1290P CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 654.533 744.231 307.741 292.071 1.102 1.587 5.236 26.580 $594 $469 125 28 1 $594 $469 125 28 1.6723
272 resnet-18 mobilenet-ssd OV-2022.3-8991 xeon accel Intel® Xeon® E-2124G CPU-only Intel® Flex-170 GPU 198.189 3548.98 1412.68 101.399 0.796 1.844 2.791 23.66 $249 $1,925 71 150 1 $249 $1,925 71 150 5.2039 1.344
273 resnet-18 end_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 2017.368 547.47 0.642 9.607 $3,144 210 2 $1,572 105 1.2913
274 resnet-18 begin_rec OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 27331.02 2329.12 3.814 60.736 $7,166 450 2 $3,583 225 0.38
275 resnet-18 mobilenet-v2 OV-2022.3-8991 xeon core Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i9-13900K CPU-only 6320.391 4041.77 1582.817 2123.33 0.373 6.748 15.416 32.334 $16,954 $599 410 125 2 1 $8,477 $599 205 125 0.667 0.66
276 resnet-18 mobilenet-v2 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i9-13900K iGPU-only 1940.935 978.61 522.654 424.34 0.969 1.634 7.764 7.829 $2,004 $599 250 125 2 1 $1,002 $599 125 1.3451 1.21
277 resnet-18 mobilenet-v2 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i9-13900K CPU+iGPU 480.992 4630.44 126.244 1944.62 1.026 7.730 17.178 37.044 $469 $599 28 125 1 $469 $599 28 125 2.242
278 resnet-18 mobilenet-v2 OV-2022.3-8991 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i5-13600K CPU-only 1061.591 3306.92 297.705 1403.57 2.264 10.051 37.914 26.455 $469 $329 28 125 1 $469 $329 28 125 1.793 0.65
279 resnet-18 mobilenet-v2 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i5-13600K iGPU-only 1237.94 919.85 342.513 384.42 2.64 2.796 44.212 7.359 $469 $329 28 125 1 $469 $329 28 125 1.36
280 resnet-18 mobilenet-v2 OV-2022.3-8991 accel core-CPU+iGPU Intel® Flex-170 GPU Intel® Core™ i5-13600K CPU+iGPU 27454.08 3556.06 2264.67 1332.32 14.262 10.809 183.027 28.448 $1,925 $329 150 125 1 $1,925 $329 150 125 0.946
281 end_rec mobilenet-v2 OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 2446.221 1003.129 3.718 14.826 $658 165 1 $658 165 0.7182
282 begin_rec mobilenet-v2 OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 1265.969 389.894 1.924 7.673 $658 165 1 $658 165 1.3894
283 resnet-50 mobilenet-v2 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i9-12900K CPU+iGPU 400.118 2680.458 133.834 1013.049 0.608 4.074 2.425 16.245 $658 165 1 $658 165 3.0384
284 resnet-50 mobilenet-v2 OV-2022.3-8991 core-iGPU atom Intel® Core™ i9-12900K iGPU-only Intel® Atom™ x5-E3940 CPU-only 229.863 81.572 66.122 45.013 0.349 2.399 1.393 8.587 $658 $34 165 9.5 1 $658 $34 165 9.5 5.2538 13.4692
285 resnet-50 mobilenet-v2 OV-2022.3-8991 core-CPU+iGPU atom Intel® Core™ i9-12900K CPU+iGPU Intel® Atom™ x6425E CPU-only 574.341 143.134 155.749 81.991 0.873 2.136 3.481 11.928 $658 $67 165 12 1 $658 $67 165 12 7.609
286 resnet-50 mobilenet-v2 OV-2022.3-8991 atom core-iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Atom™ x6425E iGPU-only 11.094 4.516 164.945 0.326 0.000 1.168 0.000 $34 $67 9.5 12 1 $34 $67 9.5 12 92.6182 7.0306
287 resnet-50 mobilenet-v2 OV-2022.3-8991 atom core-CPU+iGPU Intel® Atom™ x6425E CPU-only Intel® Atom™ x6425E CPU+iGPU 20.114 227.898 8.254 202.181 0.3 3.401 1.676 18.992 $67 12 1 $67 12 51.0598
288 resnet-50 mobilenet-v2 OV-2022.3-8991 core-iGPU atom Intel® Atom™ x6425E iGPU-only Intel® Celeron™ 6305E CPU-only 66.119 316.763 29.408 124.654 0.987 2.684 5.51 21.118 $67 $118 12 15 1 $67 $118 12 15 21.6857 3.391
289 resnet-50 mobilenet-v2 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Celeron™ 6305E iGPU-only 82.95 525.084 35.81 141.61 1.238 4.450 6.913 35.006 $67 $118 12 15 1 $67 $118 12 15 4.9197
290 resnet-50 mobilenet-v2 OV-2022.3-8991 atom core-CPU+iGPU Intel® Celeron™ 6305E CPU-only Intel® Celeron™ 6305E CPU+iGPU 52.004 807.397 14.152 255.964 0.441 6.842 3.467 53.826 $118 15 1 $118 15 19.6053
291 resnet-50 mobilenet-v2 OV-2022.3-8991 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Gold 6336Y CPU-only 90.685 14679.84 24.633 4065.139 0.769 3.138 6.046 39.675 $118 $4,678 15 370 1 2 $118 $2,339 15 185 14.6415 0.4828
292 resnet-50 mobilenet-v2 OV-2022.3-8991 core-CPU+iGPU core Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i3-8100 CPU-only 140.062 619.507 37.864 452.366 1.187 5.295 9.337 9.531 $118 $117 15 65 1 $118 $117 15 65 - 1.8067
293 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i5-10500TE CPU-only 2793.997 806.314 691.079 441.904 0.597 3.768 7.551 23.038 $4,678 $214 370 35 2 1 $2,339 $214 185 35 1.3288 2.1078
294 resnet-50 mobilenet-v2 OV-2022.3-8991 core core Intel® Core™ i3-8100 CPU-only Intel® Core™ i5-8500 CPU-only 102.328 766.072 52.896 558.975 0.875 3.990 1.574 11.786 $117 $192 65 1 $117 $192 65 10.4475 1.2307
295 resnet-50 mobilenet-v2 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only Intel® Core™ i7-8700T CPU-only 123.574 1081.253 63.836 664.108 0.577 3.568 3.531 30.893 $214 $303 35 1 $214 $303 35 11.6252 1.2788
296 resnet-50 mobilenet-v2 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i9-10900TE CPU-only 129.174 825.071 68.242 413.091 0.673 1.691 1.987 23.573 $192 $488 65 35 1 $192 $488 65 35 6.8498 1.6818
297 resnet-50 mobilenet-v2 OV-2022.3-8991 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® W1290P CPU-only 168.016 2067.162 88.675 868.25 0.555 3.480 4.8 16.537 $303 $594 35 125 1 $303 $594 35 125 6.9723 0.7363
298 resnet-50 mobilenet-v2 OV-2022.3-8991 core xeon Intel® Core™ i9-10900TE CPU-only Intel® Xeon® E-2124G CPU-only 129.371 594.283 56.366 479.567 0.265 2.387 3.696 8.370 $488 $249 35 71 1 $488 $249 35 71 8.7659 1.8531
299 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only Intel® Xeon® Gold 5218T CPU-only 317.744 5882.455 149.441 1895.498 0.535 1.871 2.542 28.012 $594 $3,144 125 210 1 2 $594 $1,572 125 105 3.6469 1.3871
300 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only Intel® Xeon® Gold 6448Y CPU-only 97.606 28383.76 16212.74 52.17 16065.38 0.392 3.961 1.375 63.075 $249 $7,166 71 450 1 2 $249 $3,583 71 225 10.851 0.55
301 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only Intel® Xeon® Platinum 8270 CPU-only 980.813 15616.083 268.009 4308.927 0.312 0.921 4.671 38.088 $3,144 $16,954 210 410 2 $1,572 $8,477 105 205 2.9838 0.8685
302 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Silver 4216R CPU-only 2905.803 5616.283 748.583 1835.686 0.405 2.803 6.457 22.465 $7,166 $2,004 450 250 2 $3,583 $1,002 225 125 1.475 1.404
303 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i7-1165G7 CPU-only 11359.88 1463.21 1118.97 538.597 0.67 3.120 27.707 52.258 $16,954 $469 410 28 2 1 $8,477 $469 205 28 0.94 0.8864
304 resnet-50 mobilenet-v2 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i7-1165G7 iGPU-only 937.572 2076.015 255.866 544.641 0.468 4.426 3.75 74.143 $2,004 $469 250 28 2 1 $1,002 $469 125 28 3.0985 1.7212
305 resnet-50 mobilenet-v2 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 235.061 2677.374 63.241 698.942 0.501 5.709 8.395 95.621 $469 28 1 $469 28 4.7975
306 resnet-50 mobilenet-v2 OV-2022.3-8991 core-iGPU accel Intel® Core™ i7-1165G7 iGPU-only Intel® Flex-170 GPU 235.061 18371.95 4738.33 63.241 0.501 9.544 8.395 122.48 $469 $1,925 28 150 1 $469 $1,925 28 150 4.7975 1.15
307 resnet-50 end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 235.061 63.241 0.501 8.395 $469 28 1 $469 28 4.7975
308 resnet-50 begin_rec OV-2022.3-8991 accel Intel® Flex-170 GPU 10810.92 1005.16 5.616 72.073 $1,925 150 1 $1,925 150 1.624
309 end_rec resnet-18 OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 1495.77 415.82 2.497 11.966 $599 125 1 $599 125 1.38
310 begin_rec resnet-18 OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 497.54 150.99 0.831 3.980 $599 125 1 $599 125 2.19
311 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i9-13900K CPU+iGPU 6.712 1821.4 2.394 615.14 0.01 3.041 0.041 14.571 $658 $599 165 125 1 $658 $599 165 125 175.7493
312 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i5-13600K CPU-only 4.228 1169.04 1.262 336.09 0.006 3.553 0.026 9.352 $658 $329 165 125 1 $658 $329 165 125 241.7838 1.5
313 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i5-13600K iGPU-only 6.666 467.43 2.393 141.76 0.01 1.421 0.04 3.739 $658 $329 165 125 1 $658 $329 165 125 2.36
314 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 atom core-CPU+iGPU Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i5-13600K CPU+iGPU 0.171 1443.42 0.081 445.25 0.005 4.387 0.018 11.547 $34 $329 9.5 125 1 $34 $329 9.5 125 5985.7525
315 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i9-12900K CPU-only 0.31 804.771 0.133 212.574 0.005 1.223 0.026 4.877 $67 $658 12 165 1 $67 $658 12 165 3246.0878 1.3886
316 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only Intel® Core™ i9-12900K iGPU-only 0.965 491.337 0.615 146.839 0.014 0.747 0.08 2.978 $67 $658 12 165 1 $67 $658 12 165 1053.0078 2.2655
317 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 0.31 1180.984 0.133 365.777 0.005 1.795 0.026 7.157 $67 $658 12 165 1 $67 $658 12 165
318 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only Intel® Atom™ x5-E3940 CPU-only 0.806 22.96 0.23 9.564 0.007 0.675 0.054 2.417 $118 $34 15 9.5 1 $118 $34 15 9.5 1240.6212 44.5491
319 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-iGPU atom Intel® Celeron™ 6305E iGPU-only Intel® Atom™ x6425E CPU-only 1.582 40.944 0.486 16.158 0.013 0.611 0.105 3.412 $118 $67 15 12 1 $118 $67 15 12 649.3806 25.1377
320 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Atom™ x6425E iGPU-only 0.806 161.381 0.231 60.863 0.007 2.409 0.054 13.448 $118 $67 15 12 1 $118 $67 15 12 10.983
321 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6336Y CPU-only Intel® Atom™ x6425E CPU+iGPU 41.52 197.477 12.672 73.927 0.009 2.947 0.112 16.456 $4,678 $67 370 12 2 1 $2,339 $67 185 12 79.0111
322 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core atom Intel® Core™ i3-8100 CPU-only Intel® Celeron™ 6305E CPU-only 1.606 105.574 0.959 28.914 0.014 0.895 0.025 7.038 $117 $118 65 15 1 $117 $118 65 15 644.0626 9.6165
323 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core core-iGPU Intel® Core™ i5-10500TE CPU-only Intel® Celeron™ 6305E iGPU-only 1.932 194.694 1.177 55.341 0.009 1.650 0.055 12.980 $214 $118 35 15 1 $214 $118 35 15 712.3677 6.643
324 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-8500 CPU-only Intel® Celeron™ 6305E CPU+iGPU 2.067 291.441 1.248 82.105 0.011 2.470 0.032 19.429 $192 $118 65 15 1 $192 $118 65 15 401.8765
325 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core xeon Intel® Core™ i7-8700T CPU-only Intel® Xeon® Gold 6336Y CPU-only 2.66 5761.961 1.606 1431.864 0.009 1.232 0.076 15.573 $303 $4,678 35 370 1 2 $303 $2,339 35 185 434.9877 0.6512
326 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core core Intel® Core™ i9-10900TE CPU-only Intel® Core™ i3-8100 CPU-only 2.046 208.65 1.242 103.699 0.004 1.783 0.058 3.210 $488 $117 35 65 1 $488 $117 35 65 485.4343 5.0231
327 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i5-10500TE CPU-only 4.871 252.987 2.935 127.448 0.008 1.182 0.039 7.228 $594 $214 125 35 1 $594 $214 125 35 239.8346 5.2921
328 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon core Intel® Xeon® E-2124G CPU-only Intel® Core™ i5-8500 CPU-only 1.55 262.785 0.919 134.002 0.006 1.369 0.022 4.043 $249 $192 71 65 1 $249 $192 71 65 665.2714 3.0597
329 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon core Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i7-8700T CPU-only 15.706 344.219 4.572 175.433 0.005 1.136 0.075 9.835 $3,144 $303 210 35 2 1 $1,572 $303 105 35 132.0319 3.1665
330 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i9-10900TE CPU-only 152.74 265.351 20.32 130.166 0.021 0.544 0.339 7.581 $7,166 $488 450 35 2 1 $3,583 $488 225 35 14.48 4.0471
331 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® W1290P CPU-only 47.365 654.533 14.722 307.741 0.003 1.102 0.116 5.236 $16,954 $594 410 125 2 1 $8,477 $594 205 125 44.387 1.6723
332 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only Intel® Xeon® E-2124G CPU-only 14.966 198.189 4.35 101.399 0.007 0.796 0.06 2.791 $2,004 $249 250 71 2 1 $1,002 $249 125 71 138.9625 5.2039
333 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core xeon Intel® Core™ i7-1165G7 CPU-only Intel® Xeon® Gold 5218T CPU-only 3.556 2017.368 1.015 547.47 0.008 0.642 0.127 9.607 $469 $3,144 28 210 1 2 $469 $1,572 28 105 284.2379 1.2913
334 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-iGPU xeon Intel® Core™ i7-1165G7 iGPU-only Intel® Xeon® Gold 6448Y CPU-only 8.239 27331.02 16095.24 2.545 16009.04 0.018 3.814 0.294 60.736 $469 $7,166 28 450 1 2 $469 $3,583 28 225 122.4561 0.38
335 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i7-1165G7 CPU+iGPU Intel® Xeon® Platinum 8270 CPU-only 3.565 6320.391 1.01 1582.817 0.008 0.373 0.127 15.416 $469 $16,954 28 410 1 2 $469 $8,477 28 205 0.667
336 ssd-resnet34-1200 resnet-18 OV-2022.3-8991 accel xeon Intel® Flex-170 GPU Intel® Xeon® Silver 4216R CPU-only 132.44 1940.935 18.19 522.654 0.069 0.969 0.883 7.764 $1,925 $2,004 150 250 1 2 $1,925 $1,002 150 125 19.933 1.3451
337 end_rec resnet-18 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 480.992 126.244 1.026 17.178 $469 28 1 $469 28 2.242
338 begin_rec resnet-18 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 1061.591 297.705 2.264 37.914 $469 28 1 $469 28 1.793
339 unet-camvid--0001 resnet-18 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i9-12900K CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 10.652 1237.94 3.873 342.513 0.016 2.640 0.065 44.212 $658 $469 165 28 1 $658 $469 165 28 111.0757
340 unet-camvid--0001 resnet-18 OV-2022.3-8991 core-iGPU accel Intel® Core™ i9-12900K iGPU-only Intel® Flex-170 GPU 7.059 27454.08 2264.67 2.154 0.011 14.262 0.043 183.027 $658 $1,925 165 150 1 $658 $1,925 165 150 142.0745 0.946
341 unet-camvid--0001 end_rec OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 14.933 4.935 0.023 0.091 $658 165 1 $658 165
342 unet-camvid--0001 begin_rec OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 0.258 0.039 0.008 0.027 $34 9.5 1 $34 9.5 3959.594
343 unet-camvid--0001 resnet-50 OV-2022.3-8991 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i9-13900K CPU-only 0.482 729.93 0.061 240.59 0.007 1.219 0.04 5.839 $67 $599 12 125 1 $67 $599 12 125 2094.2569 2.91
344 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only Intel® Core™ i9-13900K iGPU-only 1.994 238.44 0.989 68.18 0.03 0.398 0.166 1.908 $67 $599 12 125 1 $67 $599 12 125 502.6095 4.74
345 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 2.242 895.28 0.597 255.91 0.033 1.495 0.187 7.162 $67 $599 12 125 1 $67 $599 12 125
346 unet-camvid--0001 resnet-50 OV-2022.3-8991 atom core Intel® Celeron™ 6305E CPU-only Intel® Core™ i5-13600K CPU-only 1.471 576.86 0.374 153.71 0.012 1.753 0.098 4.615 $118 $329 15 125 1 $118 $329 15 125 678.4977 3.04
347 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only Intel® Core™ i5-13600K iGPU-only 2.715 216.97 0.802 64.36 0.023 0.659 0.181 1.736 $118 $329 15 125 1 $118 $329 15 125 368.8973 5.3
348 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU 4.12 717.91 1.142 188.59 0.035 2.182 0.275 5.743 $118 $329 15 125 1 $118 $329 15 125
349 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i9-12900K CPU-only 81.838 400.118 19.314 133.834 0.017 0.608 0.221 2.425 $4,678 $658 370 165 2 1 $2,339 $658 185 165 41.506 3.0384
350 unet-camvid--0001 resnet-50 OV-2022.3-8991 core core-iGPU Intel® Core™ i3-8100 CPU-only Intel® Core™ i9-12900K iGPU-only 2.482 229.863 1.54 66.122 0.021 0.349 0.038 1.393 $117 $658 65 165 1 $117 $658 65 165 412.1291 5.2538
351 unet-camvid--0001 resnet-50 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-12900K CPU+iGPU 3.031 574.341 1.9 155.749 0.014 0.873 0.087 3.481 $214 $658 35 165 1 $214 $658 35 165 457.5992
352 unet-camvid--0001 resnet-50 OV-2022.3-8991 core atom Intel® Core™ i5-8500 CPU-only Intel® Atom™ x5-E3940 CPU-only 3.227 11.094 2.018 4.516 0.017 0.326 0.05 1.168 $192 $34 65 9.5 1 $192 $34 65 9.5 256.5479 92.6182
353 unet-camvid--0001 resnet-50 OV-2022.3-8991 core atom Intel® Core™ i7-8700T CPU-only Intel® Atom™ x6425E CPU-only 4.155 20.114 2.6 8.254 0.014 0.300 0.119 1.676 $303 $67 35 12 1 $303 $67 35 12 277.7416 51.0598 ````
354 unet-camvid--0001 resnet-50 OV-2022.3-8991 core core-iGPU Intel® Core™ i9-10900TE CPU-only Intel® Atom™ x6425E iGPU-only 2.907 66.119 2.004 29.408 0.006 0.987 0.083 5.510 $488 $67 35 12 1 $488 $67 35 12 319.7667 21.6857
355 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® W1290P CPU-only Intel® Atom™ x6425E CPU+iGPU 7.413 82.95 4.615 35.81 0.012 1.238 0.059 6.913 $594 $67 125 12 1 $594 $67 125 12 157.3622
356 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon atom Intel® Xeon® E-2124G CPU-only Intel® Celeron™ 6305E CPU-only 2.386 52.004 1.481 14.152 0.01 0.441 0.034 3.467 $249 $118 71 15 1 $249 $118 71 15 422.1157 19.6053
357 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Celeron™ 6305E iGPU-only 29.251 90.685 7.301 24.633 0.009 0.769 0.139 6.046 $3,144 $118 210 15 2 1 $1,572 $118 105 15 69.3596 14.6415
358 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 6448Y CPU-only Intel® Celeron™ 6305E CPU+iGPU 381.85 140.062 30.96 37.864 0.053 1.187 0.849 9.337 $7,166 $118 450 15 2 1 $3,583 $118 225 15 7.95 -
359 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only Intel® Xeon® Gold 6336Y CPU-only 93.081 2793.997 21.382 691.079 0.005 0.597 0.227 7.551 $16,954 $4,678 410 370 2 $8,477 $2,339 205 185 22.9476 1.3288
360 unet-camvid--0001 resnet-50 OV-2022.3-8991 xeon core Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i3-8100 CPU-only 27.814 102.328 6.966 52.896 0.014 0.875 0.111 1.574 $2,004 $117 250 65 2 1 $1,002 $117 125 65 72.9773 10.4475
361 unet-camvid--0001 resnet-50 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i5-10500TE CPU-only 6.54 123.574 1.677 63.836 0.014 0.577 0.234 3.531 $469 $214 28 35 1 $469 $214 28 35 152.602 11.6252
362 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-iGPU core Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i5-8500 CPU-only 15.391 129.174 4.571 68.242 0.033 0.673 0.55 1.987 $469 $192 28 65 1 $469 $192 28 65 61.6002 6.8498
363 unet-camvid--0001 resnet-50 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i7-8700T CPU-only 17.962 168.016 4.848 88.675 0.038 0.555 0.642 4.800 $469 $303 28 35 1 $469 $303 28 35 6.9723
364 unet-camvid--0001 resnet-50 OV-2022.3-8991 accel core Intel® Flex-170 GPU Intel® Core™ i9-10900TE CPU-only 218.12 129.371 35.2 56.366 0.113 0.265 1.454 3.696 $1,925 $488 150 35 1 $1,925 $488 150 35 7.149 8.7659
365 end_rec resnet-50 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 317.744 149.441 0.535 2.542 $594 125 1 $594 125 3.6469
366 begin_rec resnet-50 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 97.606 52.17 0.392 1.375 $249 71 1 $249 71 10.851
367 yolo_v3_tiny resnet-50 OV-2022.3-8991 core xeon Intel® Core™ i9-12900K CPU-only Intel® Xeon® Gold 5218T CPU-only 428.506 980.813 162.077 268.009 0.651 0.312 2.597 4.671 $658 $3,144 165 210 1 2 $658 $1,572 165 105 2.4778 2.9838
368 yolo_v3_tiny resnet-50 OV-2022.3-8991 core-iGPU xeon Intel® Core™ i9-12900K iGPU-only Intel® Xeon® Platinum 8270 CPU-only 245.738 2905.803 84.457 748.583 0.373 0.405 1.489 6.457 $658 $7,166 165 450 1 2 $658 $3,583 165 225 3.8792 1.475
369 yolo_v3_tiny resnet-50 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Core™ i9-12900K CPU+iGPU Intel® Xeon® Gold 6448Y CPU-only 598.947 11359.88 5494.15 195.608 5497.22 0.91 0.670 3.63 27.707 $658 $16,954 165 410 1 2 $658 $8,477 165 205 0.94
370 yolo_v3_tiny resnet-50 OV-2022.3-8991 atom xeon Intel® Atom™ x5-E3940 CPU-only Intel® Xeon® Silver 4216R CPU-only 12.406 937.572 6.124 255.866 0.365 0.468 1.306 3.750 $34 $2,004 9.5 250 1 2 $34 $1,002 9.5 125 83.8614 3.0985
371 yolo_v3_tiny resnet-50 OV-2022.3-8991 atom core Intel® Atom™ x6425E CPU-only Intel® Core™ i7-1165G7 CPU-only 22.94 235.061 10.395 63.241 0.342 0.501 1.912 8.395 $67 $469 12 28 1 $67 $469 12 28 44.6243 4.7975
372 yolo_v3_tiny resnet-50 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only Intel® Core™ i7-1165G7 iGPU-only 66.641 504.247 38.178 125.407 0.995 1.075 5.553 18.009 $67 $469 12 28 1 $67 $469 12 28 15.7687 4.7975
373 yolo_v3_tiny resnet-50 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 86.38 595.133 45.819 150.024 1.289 1.269 7.198 21.255 $67 $469 12 28 1 $67 $469 12 28 4.7975
374 yolo_v3_tiny resnet-50 OV-2022.3-8991 atom accel Intel® Celeron™ 6305E CPU-only Intel® Flex-170 GPU 55.629 10810.92 1005.16 18.246 0.471 5.616 3.709 72.073 $118 $1,925 15 150 1 $118 $1,925 15 150 18.2291 1.624
375 yolo_v3_tiny end_rec OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 106.588 31.376 0.903 7.106 $118 15 1 $118 15 10.8727
376 yolo_v3_tiny begin_rec OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 153.471 46.125 1.301 10.231 $118 15 1 $118 15
377 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i9-13900K CPU-only 2733.627 11.75 761.534 4.24 0.584 0.020 7.388 0.094 $4,678 $599 370 125 2 1 $2,339 $599 185 125 1.1267 162.07
378 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core core-iGPU Intel® Core™ i3-8100 CPU-only Intel® Core™ i9-13900K iGPU-only 114.701 4.5 66.266 1.45 0.98 0.008 1.765 0.036 $117 $599 65 125 1 $117 $599 65 125 8.9295 226.99
379 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i9-13900K CPU+iGPU 141.001 11.63 79.694 4.24 0.659 0.019 4.029 0.093 $214 $599 35 125 1 $214 $599 35 125 9.9196
380 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only Intel® Core™ i5-13600K CPU-only 145.659 8.21 85.158 2.7 0.759 0.025 2.241 0.066 $192 $329 65 125 1 $192 $329 65 125 5.465 147.53
381 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core core-iGPU Intel® Core™ i7-8700T CPU-only Intel® Core™ i5-13600K iGPU-only 191.931 4.22 109.625 1.36 0.633 0.013 5.484 0.034 $303 $329 35 125 1 $303 $329 35 125 5.5981 241.92
382 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i9-10900TE CPU-only Intel® Core™ i5-13600K CPU+iGPU 147.041 8 84.448 2.7 0.301 0.024 4.201 0.064 $488 $329 35 125 1 $488 $329 35 125 7.0171
383 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-12900K CPU-only 359.61 6.712 173.635 2.394 0.605 0.010 2.877 0.041 $594 $658 125 165 1 $594 $658 125 165 2.9037 175.7493
384 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-12900K iGPU-only 109.066 4.228 64.87 1.262 0.438 0.006 1.536 0.026 $249 $658 71 165 1 $249 $658 71 165 9.3792 241.7838
385 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-12900K CPU+iGPU 1058.322 6.666 337.035 2.393 0.337 0.010 5.04 0.040 $3,144 $658 210 165 2 1 $1,572 $658 105 165 2.4971
386 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon atom Intel® Xeon® Gold 6448Y CPU-only Intel® Atom™ x5-E3940 CPU-only 7344.88 0.171 1405.51 0.081 1.025 0.005 16.322 0.018 $7,166 $34 450 9.5 2 1 $3,583 $34 225 9.5 1.06 5985.7525
387 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon atom Intel® Xeon® Platinum 8270 CPU-only Intel® Atom™ x6425E CPU-only 2931.242 0.31 901.832 0.133 0.173 0.005 7.149 0.026 $16,954 $67 410 12 2 1 $8,477 $67 205 12 1.215 3246.0878
388 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Atom™ x6425E iGPU-only 1015.77 0.965 321.263 0.615 0.507 0.014 4.063 0.080 $2,004 $67 250 12 2 1 $1,002 $67 125 12 2.6076 1053.0078
389 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i7-1165G7 CPU-only Intel® Atom™ x6425E CPU+iGPU 258.05 0.31 79.963 0.133 0.55 0.005 9.216 0.026 $469 $67 28 12 1 $469 $67 28 12 4.1833
390 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core-iGPU atom Intel® Core™ i7-1165G7 iGPU-only Intel® Celeron™ 6305E CPU-only 492.645 0.806 157.98 0.23 1.05 0.007 17.594 0.054 $469 $118 28 15 1 $469 $118 28 15 2.5788 1240.6212
391 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 core-CPU+iGPU core-iGPU Intel® Core™ i7-1165G7 CPU+iGPU Intel® Celeron™ 6305E iGPU-only 606.117 1.582 186.339 0.486 1.292 0.013 21.647 0.105 $469 $118 28 15 1 $469 $118 28 15 649.3806
392 yolo_v3_tiny ssd-resnet34-1200 OV-2022.3-8991 accel core-CPU+iGPU Intel® Flex-170 GPU Intel® Celeron™ 6305E CPU+iGPU 3634.16 0.806 1209.67 0.231 1.888 0.007 24.228 0.054 $1,925 $118 150 15 1 $1,925 $118 150 15 1.293
393 end_rec ssd-resnet34-1200 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 41.52 12.672 0.009 0.112 $4,678 370 2 $2,339 185 79.0111
394 begin_rec ssd-resnet34-1200 OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 1.606 0.959 0.014 0.025 $117 65 1 $117 65 644.0626
395 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only Intel® Core™ i5-10500TE CPU-only 21.833 1.932 7.096 1.177 0.033 0.009 0.132 0.055 $658 $214 165 35 1 $658 $214 165 35 58.4745 712.3677
396 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-iGPU core Intel® Core™ i9-12900K iGPU-only Intel® Core™ i5-8500 CPU-only 11.956 2.067 3.869 1.248 0.018 0.011 0.072 0.032 $658 $192 165 65 1 $658 $192 165 65 85.1633 401.8765
397 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-CPU+iGPU core Intel® Core™ i9-12900K CPU+iGPU Intel® Core™ i7-8700T CPU-only 26.693 2.66 8.644 1.606 0.041 0.009 0.162 0.076 $658 $303 165 35 1 $658 $303 165 35 434.9877
398 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 atom core Intel® Atom™ x5-E3940 CPU-only Intel® Core™ i9-10900TE CPU-only 0.522 2.046 0.248 1.242 0.015 0.004 0.055 0.058 $34 $488 9.5 35 1 $34 $488 9.5 35 1900.0218 485.4343
399 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 atom xeon Intel® Atom™ x6425E CPU-only Intel® Xeon® W1290P CPU-only 0.99 4.871 0.43 2.935 0.015 0.008 0.083 0.039 $67 $594 12 125 1 $67 $594 12 125 1019.82 239.8346
400 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-iGPU xeon Intel® Atom™ x6425E iGPU-only Intel® Xeon® E-2124G CPU-only 3.413 1.55 1.752 0.919 0.051 0.006 0.284 0.022 $67 $249 12 71 1 $67 $249 12 71 295.7702 665.2714
401 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Atom™ x6425E CPU+iGPU Intel® Xeon® Gold 5218T CPU-only 3.999 15.706 2.087 4.572 0.06 0.005 0.333 0.075 $67 $3,144 12 210 1 2 $67 $1,572 12 105 132.0319
402 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 atom xeon Intel® Celeron™ 6305E CPU-only Intel® Xeon® Gold 6448Y CPU-only 2.453 152.74 144.16 0.748 144.02 0.021 0.164 0.339 $118 $7,166 15 450 1 2 $118 $3,583 15 225 407.2474 14.48
403 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-iGPU xeon Intel® Celeron™ 6305E iGPU-only Intel® Xeon® Platinum 8270 CPU-only 4.758 47.365 1.434 14.722 0.04 0.003 0.317 0.116 $118 $16,954 15 410 1 2 $118 $8,477 15 205 212.7987 44.387
404 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core-CPU+iGPU xeon Intel® Celeron™ 6305E CPU+iGPU Intel® Xeon® Silver 4216R CPU-only 7.048 14.966 2.122 4.35 0.06 0.007 0.47 0.060 $118 $2,004 15 250 1 2 $118 $1,002 15 125 138.9625
405 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6336Y CPU-only Intel® Core™ i7-1165G7 CPU-only 126.954 3.556 35.481 1.015 0.027 0.008 0.343 0.127 $4,678 $469 370 28 2 1 $2,339 $469 185 28 37.8189 284.2379
406 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core core-iGPU Intel® Core™ i3-8100 CPU-only Intel® Core™ i7-1165G7 iGPU-only 4.971 8.239 2.885 2.545 0.042 0.018 0.076 0.294 $117 $469 65 28 1 $117 $469 65 28 203.4163 122.4561
407 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core core-CPU+iGPU Intel® Core™ i5-10500TE CPU-only Intel® Core™ i7-1165G7 CPU+iGPU 6.182 3.565 3.532 1.01 0.029 0.008 0.177 0.127 $214 $469 35 28 1 $214 $469 35 28 227.5786
408 yolo_v4 ssd-resnet34-1200 OV-2022.3-8991 core accel Intel® Core™ i5-8500 CPU-only Intel® Flex-170 GPU 6.356 132.44 18.19 3.757 0.033 0.069 0.098 0.883 $192 $1,925 65 150 1 $192 $1,925 65 150 123.3181 19.933
409 yolo_v4 end_rec OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 8.44 4.868 0.028 0.241 $303 35 1 $303 35 135.9719
410 yolo_v4 begin_rec OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 6.399 3.765 0.013 0.183 $488 35 1 $488 35 155.642
411 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core Intel® Xeon® W1290P CPU-only Intel® Core™ i9-13900K CPU-only 15.614 18.79 7.925 6.86 0.026 0.031 0.125 0.150 $594 $599 125 1 $594 $599 125 71.631 99.01
412 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® E-2124G CPU-only Intel® Core™ i9-13900K iGPU-only 4.674 7.59 2.804 2.3 0.019 0.013 0.066 0.061 $249 $599 71 125 1 $249 $599 71 125 214.0957 132.32
413 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Gold 5218T CPU-only Intel® Core™ i9-13900K CPU+iGPU 47.338 18.14 14.464 7 0.015 0.030 0.225 0.145 $3,144 $599 210 125 2 1 $1,572 $599 105 125 45.7699
414 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core Intel® Xeon® Gold 6448Y CPU-only Intel® Core™ i5-13600K CPU-only 252.03 12.91 58.12 4.36 0.035 0.039 0.56 0.103 $7,166 $329 450 125 2 1 $3,583 $329 225 125 15.01 95.92
415 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core-iGPU Intel® Xeon® Platinum 8270 CPU-only Intel® Core™ i5-13600K iGPU-only 131.466 7.13 41.001 2.16 0.008 0.022 0.321 0.057 $16,954 $329 410 125 2 1 $8,477 $329 205 125 19.2807 140.88
416 yolo_v4 unet-camvid--0001 OV-2022.3-8991 xeon core-CPU+iGPU Intel® Xeon® Silver 4216R CPU-only Intel® Core™ i5-13600K CPU+iGPU 45.047 16.63 13.741 5.72 0.022 0.051 0.18 0.133 $2,004 $329 250 125 2 1 $1,002 $329 125 48.0344
417 yolo_v4 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only Intel® Core™ i9-12900K CPU-only 11.067 10.652 3.259 3.873 0.024 0.016 0.395 0.065 $469 $658 28 165 1 $469 $658 28 165 92.2912 111.0757
418 yolo_v4 unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only Intel® Core™ i9-12900K iGPU-only 25.048 7.059 7.384 2.154 0.053 0.011 0.895 0.043 $469 $658 28 165 1 $469 $658 28 165 39.1492 142.0745
419 yolo_v4 unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 29.658 14.933 8.32 4.935 0.063 0.023 1.059 0.091 $469 $658 28 165 1 $469 $658 28 165
420 yolo_v4 unet-camvid--0001 OV-2022.3-8991 accel atom Intel® Flex-170 GPU Intel® Atom™ x5-E3940 CPU-only 454.49 0.258 56.78 0.039 0.236 0.008 3.03 0.027 $1,925 $34 150 9.5 1 $1,925 $34 150 9.5 6.969 3959.594
421 end_rec unet-camvid--0001 OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 0.482 0.061 0.007 0.040 $67 12 1 $67 12 2094.2569
422 unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 1.994 0.989 0.030 0.166 $67 12 1 $67 12 502.6095
423 unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 2.242 0.597 0.033 0.187 $67 12 1 $67 12
424 unet-camvid--0001 OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 1.471 0.374 0.012 0.098 $118 15 1 $118 15 678.4977
425 unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 2.715 0.802 0.023 0.181 $118 15 1 $118 15 368.8973
426 unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 4.12 1.142 0.035 0.275 $118 15 1 $118 15
427 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 81.838 19.314 0.017 0.221 $4,678 370 2 $2,339 185 41.506
428 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 2.482 1.54 0.021 0.038 $117 65 1 $117 65 412.1291
429 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 3.031 1.9 0.014 0.087 $214 35 1 $214 35 457.5992
430 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 3.227 2.018 0.017 0.050 $192 65 1 $192 65 256.5479
431 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 4.155 2.6 0.014 0.119 $303 35 1 $303 35 277.7416
432 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 2.907 2.004 0.006 0.083 $488 35 1 $488 35 319.7667
433 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 7.413 4.615 0.012 0.059 $594 125 1 $594 125 157.3622
434 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 2.386 1.481 0.010 0.034 $249 71 1 $249 71 422.1157
435 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 29.251 7.301 0.009 0.139 $3,144 210 2 $1,572 105 69.3596
436 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 381.85 151.97 151.98 0.053 0.849 $7,166 450 2 $3,583 225 7.95
437 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 93.081 21.382 0.005 0.227 $16,954 410 2 $8,477 205 22.9476
438 unet-camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 27.814 6.966 0.014 0.111 $2,004 250 2 $1,002 125 72.9773
439 unet-camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 6.54 1.677 0.014 0.234 $469 28 1 $469 28 152.602
440 unet-camvid--0001 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 15.391 4.571 0.033 0.550 $469 28 1 $469 28 61.6002
441 unet-camvid--0001 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 17.962 4.848 0.038 0.642 $469 28 1 $469 28
442 unet-camvid--0001 OV-2022.3-8991 accel Intel® Flex-170 GPU 218.12 35.2 0.113 1.454 $1,925 150 1 $1,925 150 7.149
443 end_rec
444 begin_rec
445 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 802.63 252.57 1.340 6.421 $599 125 1 $599 125 2.69
446 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 249.5 86.81 0.417 1.996 $599 125 1 $599 125 4.79
447 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 795.31 247.17 1.328 6.362 $599 125 1 $599 125
448 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 638.25 206.62 1.940 5.106 $329 125 1 $329 125 2.59
449 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i5-13600K iGPU-only 229.22 81.49 0.697 1.834 $329 125 1 $329 125 5.22
450 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU 631.71 205.81 1.920 5.054 $329 125 1 $329 125
451 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 428.506 162.077 0.651 2.597 $658 165 1 $658 165 2.4778
452 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 245.738 84.457 0.373 1.489 $658 165 1 $658 165 3.8792
453 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 598.947 195.608 0.910 3.630 $658 165 1 $658 165
454 yolo_v3_tiny OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 12.406 6.124 0.365 1.306 $34 9.5 1 $34 9.5 83.8614
455 yolo_v3_tiny OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 22.94 10.395 0.342 1.912 $67 12 1 $67 12 44.6243
456 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 66.641 38.178 0.995 5.553 $67 12 1 $67 12 15.7687
457 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 86.38 45.819 1.289 7.198 $67 12 1 $67 12
458 yolo_v3_tiny OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 55.629 18.246 0.471 3.709 $118 15 1 $118 15 18.2291
459 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 106.588 31.376 0.903 7.106 $118 15 1 $118 15 10.8727
460 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 153.471 46.125 1.301 10.231 $118 15 1 $118 15
461 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 2733.627 761.534 0.584 7.388 $4,678 370 2 $2,339 185 1.1267
462 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 114.701 66.266 0.980 1.765 $117 65 1 $117 65 8.9295
463 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 141.001 79.694 0.659 4.029 $214 35 1 $214 35 9.9196
464 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 145.659 85.158 0.759 2.241 $192 65 1 $192 65 5.465
465 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 191.931 109.625 0.633 5.484 $303 35 1 $303 35 5.5981
466 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 147.041 84.448 0.301 4.201 $488 35 1 $488 35 7.0171
467 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 359.61 173.635 0.605 2.877 $594 125 1 $594 125 2.9037
468 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 109.066 64.87 0.438 1.536 $249 71 1 $249 71 9.3792
469 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 1058.322 337.035 0.337 5.040 $3,144 210 2 $1,572 105 2.4971
470 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 7344.88 5212.9 5236.28 1.025 16.322 $7,166 450 2 $3,583 225 1.06
471 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 2931.242 901.832 0.173 7.149 $16,954 410 2 $8,477 205 1.215
472 yolo_v3_tiny OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 1015.77 321.263 0.507 4.063 $2,004 250 2 $1,002 125 2.6076
473 yolo_v3_tiny OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 258.05 79.963 0.550 9.216 $469 28 1 $469 28 4.1833
474 yolo_v3_tiny OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 492.645 157.98 1.050 17.594 $469 28 1 $469 28 2.5788
475 yolo_v3_tiny OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 606.117 186.339 1.292 21.647 $469 28 1 $469 28
476 yolo_v3_tiny OV-2022.3-8991 accel Intel® Flex-170 GPU 3634.16 1209.67 1.888 24.228 $1,925 150 1 $1,925 150 1.293
477 end_rec
478 begin_rec
479 yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-13900K CPU-only 37.15 13.03 0.062 0.297 $599 125 1 $599 125 55.96
480 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i9-13900K iGPU-only 12.92 4.26 0.022 0.103 $599 125 1 $599 125 78.73
481 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-13900K CPU+iGPU 37.16 13.54 0.062 0.297 $599 125 1 $599 125
482 yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-13600K CPU-only 25.5 8.36 0.078 0.204 $329 125 1 $329 125 53.79
483 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i5-13600K iGPU-only 12.15 4 0.037 0.097 $329 125 1 $329 125 83.64
484 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i5-13600K CPU+iGPU 31.99 10.82 0.097 0.256 $329 125 1 $329 125
485 yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-12900K CPU-only 21.833 7.096 0.033 0.132 $658 165 1 $658 165 58.4745
486 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i9-12900K iGPU-only 11.956 3.869 0.018 0.072 $658 165 1 $658 165 85.1633
487 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i9-12900K CPU+iGPU 26.693 8.644 0.041 0.162 $658 165 1 $658 165
488 yolo_v4 OV-2022.3-8991 atom Intel® Atom™ x5-E3940 CPU-only 0.522 0.248 0.015 0.055 $34 9.5 1 $34 9.5 1900.0218
489 yolo_v4 OV-2022.3-8991 atom Intel® Atom™ x6425E CPU-only 0.99 0.43 0.015 0.083 $67 12 1 $67 12 1019.82
490 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Atom™ x6425E iGPU-only 3.413 1.752 0.051 0.284 $67 12 1 $67 12 295.7702
491 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Atom™ x6425E CPU+iGPU 3.999 2.087 0.060 0.333 $67 12 1 $67 12
492 yolo_v4 OV-2022.3-8991 atom Intel® Celeron™ 6305E CPU-only 2.453 0.748 0.021 0.164 $118 15 1 $118 15 407.2474
493 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Celeron™ 6305E iGPU-only 4.758 1.434 0.040 0.317 $118 15 1 $118 15 212.7987
494 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Celeron™ 6305E CPU+iGPU 7.048 2.122 0.060 0.470 $118 15 1 $118 15
495 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6336Y CPU-only 126.954 35.481 0.027 0.343 $4,678 370 2 $2,339 185 37.8189
496 yolo_v4 OV-2022.3-8991 core Intel® Core™ i3-8100 CPU-only 4.971 2.885 0.042 0.076 $117 65 1 $117 65 203.4163
497 yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-10500TE CPU-only 6.182 3.532 0.029 0.177 $214 35 1 $214 35 227.5786
498 yolo_v4 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 6.356 3.757 0.033 0.098 $192 65 1 $192 65 123.3181
499 yolo_v4 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 8.44 4.868 0.028 0.241 $303 35 1 $303 35 135.9719
500 yolo_v4 OV-2022.3-8991 core Intel® Core™ i9-10900TE CPU-only 6.399 3.765 0.013 0.183 $488 35 1 $488 35 155.642
501 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® W1290P CPU-only 15.614 7.925 0.026 0.125 $594 125 1 $594 125 71.631
502 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® E-2124G CPU-only 4.674 2.804 0.019 0.066 $249 71 1 $249 71 214.0957
503 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 5218T CPU-only 47.338 14.464 0.015 0.225 $3,144 210 2 $1,572 105 45.7699
504 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6448Y CPU-only 252.03 228.55 228.67 0.035 0.560 $7,166 450 2 $3,583 225 15.01
505 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Platinum 8270 CPU-only 131.466 41.001 0.008 0.321 $16,954 410 2 $8,477 205 19.2807
506 yolo_v4 OV-2022.3-8991 xeon Intel® Xeon® Silver 4216R CPU-only 45.047 13.741 0.022 0.180 $2,004 250 2 $1,002 125 48.0344
507 yolo_v4 OV-2022.3-8991 core Intel® Core™ i7-1165G7 CPU-only 11.067 3.259 0.024 0.395 $469 28 1 $469 28 92.2912
508 yolo_v4 OV-2022.3-8991 core-iGPU Intel® Core™ i7-1165G7 iGPU-only 25.048 7.384 0.053 0.895 $469 28 1 $469 28 39.1492
509 yolo_v4 OV-2022.3-8991 core-CPU+iGPU Intel® Core™ i7-1165G7 CPU+iGPU 29.658 8.32 0.063 1.059 $469 28 1 $469 28
510 yolo_v4 OV-2022.3-8991 accel Intel® Flex-170 GPU 454.49 56.78 0.236 3.03 $1,925 150 1 $1,925 150 6.969
511 end_rec

105
docs/_static/benchmarks_files/OVMS-benchmark-data.csv vendored Normal file
View File

@ -0,0 +1,105 @@
Network model,Release,IE-Type,Platform name,Throughput-OVMS-INT8,Throughput-OV-INT8,Throughput-OVMS-FP32,Throughput-OV-FP32
begin_rec,,,,,,,
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,19.05,19.24,12.84,13.02
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,21.75,22.97,17.16,17.32
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,18.00,18.33,11.91,12.06
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,81.48,87.59,46.81,48.37
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,207.39,231.10,104.07,125.89
bert-small-uncased-whole-word-masking-squad-0002,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,282.09,287.81,159.05,162.28
end_rec,,,,,,,
begin_rec,,,,,,,
DeeplabV3,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,28.29,31.56,15.94,16.90
DeeplabV3,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,37.92,40.93,19.35,20.38
DeeplabV3,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,26.10,27.99,15.33,15.78
DeeplabV3,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,118.32,142.36,26.18,27.37
DeeplabV3,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,347.24,391.34,53.95,73.45
DeeplabV3,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,425.70,538.96,125.09,132.23
end_rec,,,,,,,
begin_rec,,,,,,,
Densenet-121,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,117.68,123.85,68.41,71.42
Densenet-121,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,151.83,161.15,90.37,94.03
Densenet-121,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,97.49,101.95,61.08,62.79
Densenet-121,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,765.57,857.26,205.00,225.97
Densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,2039.41,2205.00,582.14,600.78
Densenet-121,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,2316.39,2501.85,662.25,686.40
end_rec,,,,,,,
begin_rec,,,,,,,
Efficientdet-D0,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,42.26,43.69,25.09,26.62
Efficientdet-D0,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,49.48,50.11,29.37,30.93
Efficientdet-D0,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,37.48,38.96,26.29,27.90
Efficientdet-D0,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,125.90,143.68,51.04,55.33
Efficientdet-D0,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,302.06,335.20,168.52,177.62
Efficientdet-D0,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,362.66,415.28,244.88,254.03
end_rec,,,,,,,
begin_rec,,,,,,,
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,29.95,33.16,16.58,17.08
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,43.60,44.77,22.21,22.39
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,27.76,28.08,14.16,14.41
Inception-V4,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,253.30,275.06,60.19,63.55
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,656.23,690.46,158.05,161.39
Inception-V4,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,747.08,782.74,185.16,187.21
end_rec,,,,,,,
begin_rec,,,,,,,
Mobilenet-SSD ,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,247.50,275.77,133.42,148.03
Mobilenet-SSD ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,311.96,358.32,176.63,199.53
Mobilenet-SSD ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,213.07,237.43,128.63,138.09
Mobilenet-SSD ,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,1382.37,1935.88,391.43,484.28
Mobilenet-SSD ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,3578.49,4790.04,1062.88,1141.50
Mobilenet-SSD ,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,4131.44,5693.82,1319.32,1494.70
end_rec,,,,,,,
begin_rec,,,,,,,
Mobilenet-V2 ,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,470.51,546.68,286.64,336.47
Mobilenet-V2 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,567.21,690.80,378.24,462.46
Mobilenet-V2 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,399.15,470.87,283.32,318.23
Mobilenet-V2 ,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,2493.12,3426.14,765.45,941.54
Mobilenet-V2 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,6679.14,9143.29,2302.78,2511.31
Mobilenet-V2 ,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,7371.67,10494.29,2672.91,3192.44
end_rec,,,,,,,
begin_rec,,,,,,,
Resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,210.80,228.46,106.61,116.30
Resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,279.43,303.27,142.79,151.45
Resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,184.06,194.48,91.60,94.53
Resnet-18 ,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,1490.65,1809.32,409.17,464.62
Resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,3918.52,4568.67,1138.07,1166.20
Resnet-18 ,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,4477.09,5192.77,1294.96,1309.89
end_rec,,,,,,,
begin_rec,,,,,,,
Resnet-50,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,108.35,114.48,55.15,57.62
Resnet-50,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,142.74,149.99,73.33,75.63
Resnet-50,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,98.10,100.62,47.21,48.40
Resnet-50,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,786.06,893.37,182.61,200.00
Resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,2066.51,2231.60,464.01,518.88
Resnet-50,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,2336.42,2508.77,613.40,632.38
end_rec,,,,,,,
begin_rec,,,,,,,
SSD-Resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,1.74,1.83,0.89,1.05
SSD-Resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,2.46,2.48,1.37,1.42
SSD-Resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,1.41,1.58,0.66,0.88
SSD-Resnet34-1200 ,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,14.59,15.29,3.97,4.03
SSD-Resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,35.42,36.77,10.14,10.46
SSD-Resnet34-1200 ,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,41.35,43.93,11.73,12.20
end_rec,,,,,,,
begin_rec,,,,,,,
Unet-Camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,2.57,2.78,1.62,1.70
Unet-Camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,3.68,3.71,2.15,2.29
Unet-Camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,2.25,2.38,1.36,1.45
Unet-Camvid--0001 ,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,25.52,26.93,5.57,5.69
Unet-Camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,60.15,65.11,15.01,15.15
Unet-Camvid--0001 ,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,69.58,76.46,17.16,17.97
end_rec,,,,,,,
begin_rec,,,,,,,
Yolo_V3_Tiny,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,114.02,127.37,67.06,72.20
Yolo_V3_Tiny,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,148.72,168.41,85.62,91.66
Yolo_V3_Tiny,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,98.44,107.53,56.42,60.41
Yolo_V3_Tiny,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,592.92,850.58,207.96,240.90
Yolo_V3_Tiny,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,1631.49,2031.46,534.51,611.68
Yolo_V3_Tiny,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,1774.41,2428.00,691.96,725.60
end_rec,,,,,,,
begin_rec,,,,,,,
Yolo_V4,OV-2022.3-8991,core,Intel® Core™ i3-10100 CPU-only,5.44,5.66,3.17,3.25
Yolo_V4,OV-2022.3-8991,core,Intel® Core™ i5-8500 CPU-only,7.24,7.40,4.19,4.21
Yolo_V4,OV-2022.3-8991,core,Intel® Core™ i7-8700T CPU-only,4.60,4.71,2.45,2.68
Yolo_V4,OV-2022.3-8991,core,Intel® Core™ i9-10920X CPU-only,36.33,40.21,10.52,10.90
Yolo_V4,OV-2022.3-8991,xeon,Intel® Xeon® Gold 6238 CPU-only,81.88,95.46,26.43,27.57
Yolo_V4,OV-2022.3-8991,xeon,Intel® Xeon® 8260 CPU-only,96.58,111.93,30.48,34.50
end_rec,,,,,,,
1 Network model Release IE-Type Platform name Throughput-OVMS-INT8 Throughput-OV-INT8 Throughput-OVMS-FP32 Throughput-OV-FP32
2 begin_rec
3 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 19.05 19.24 12.84 13.02
4 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 21.75 22.97 17.16 17.32
5 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 18.00 18.33 11.91 12.06
6 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 81.48 87.59 46.81 48.37
7 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 207.39 231.10 104.07 125.89
8 bert-small-uncased-whole-word-masking-squad-0002 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 282.09 287.81 159.05 162.28
9 end_rec
10 begin_rec
11 DeeplabV3 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 28.29 31.56 15.94 16.90
12 DeeplabV3 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 37.92 40.93 19.35 20.38
13 DeeplabV3 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 26.10 27.99 15.33 15.78
14 DeeplabV3 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 118.32 142.36 26.18 27.37
15 DeeplabV3 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 347.24 391.34 53.95 73.45
16 DeeplabV3 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 425.70 538.96 125.09 132.23
17 end_rec
18 begin_rec
19 Densenet-121 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 117.68 123.85 68.41 71.42
20 Densenet-121 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 151.83 161.15 90.37 94.03
21 Densenet-121 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 97.49 101.95 61.08 62.79
22 Densenet-121 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 765.57 857.26 205.00 225.97
23 Densenet-121 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 2039.41 2205.00 582.14 600.78
24 Densenet-121 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 2316.39 2501.85 662.25 686.40
25 end_rec
26 begin_rec
27 Efficientdet-D0 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 42.26 43.69 25.09 26.62
28 Efficientdet-D0 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 49.48 50.11 29.37 30.93
29 Efficientdet-D0 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 37.48 38.96 26.29 27.90
30 Efficientdet-D0 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 125.90 143.68 51.04 55.33
31 Efficientdet-D0 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 302.06 335.20 168.52 177.62
32 Efficientdet-D0 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 362.66 415.28 244.88 254.03
33 end_rec
34 begin_rec
35 Inception-V4 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 29.95 33.16 16.58 17.08
36 Inception-V4 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 43.60 44.77 22.21 22.39
37 Inception-V4 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 27.76 28.08 14.16 14.41
38 Inception-V4 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 253.30 275.06 60.19 63.55
39 Inception-V4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 656.23 690.46 158.05 161.39
40 Inception-V4 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 747.08 782.74 185.16 187.21
41 end_rec
42 begin_rec
43 Mobilenet-SSD OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 247.50 275.77 133.42 148.03
44 Mobilenet-SSD OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 311.96 358.32 176.63 199.53
45 Mobilenet-SSD OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 213.07 237.43 128.63 138.09
46 Mobilenet-SSD OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 1382.37 1935.88 391.43 484.28
47 Mobilenet-SSD OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 3578.49 4790.04 1062.88 1141.50
48 Mobilenet-SSD OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 4131.44 5693.82 1319.32 1494.70
49 end_rec
50 begin_rec
51 Mobilenet-V2 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 470.51 546.68 286.64 336.47
52 Mobilenet-V2 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 567.21 690.80 378.24 462.46
53 Mobilenet-V2 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 399.15 470.87 283.32 318.23
54 Mobilenet-V2 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 2493.12 3426.14 765.45 941.54
55 Mobilenet-V2 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 6679.14 9143.29 2302.78 2511.31
56 Mobilenet-V2 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 7371.67 10494.29 2672.91 3192.44
57 end_rec
58 begin_rec
59 Resnet-18 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 210.80 228.46 106.61 116.30
60 Resnet-18 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 279.43 303.27 142.79 151.45
61 Resnet-18 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 184.06 194.48 91.60 94.53
62 Resnet-18 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 1490.65 1809.32 409.17 464.62
63 Resnet-18 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 3918.52 4568.67 1138.07 1166.20
64 Resnet-18 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 4477.09 5192.77 1294.96 1309.89
65 end_rec
66 begin_rec
67 Resnet-50 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 108.35 114.48 55.15 57.62
68 Resnet-50 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 142.74 149.99 73.33 75.63
69 Resnet-50 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 98.10 100.62 47.21 48.40
70 Resnet-50 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 786.06 893.37 182.61 200.00
71 Resnet-50 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 2066.51 2231.60 464.01 518.88
72 Resnet-50 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 2336.42 2508.77 613.40 632.38
73 end_rec
74 begin_rec
75 SSD-Resnet34-1200 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 1.74 1.83 0.89 1.05
76 SSD-Resnet34-1200 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 2.46 2.48 1.37 1.42
77 SSD-Resnet34-1200 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 1.41 1.58 0.66 0.88
78 SSD-Resnet34-1200 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 14.59 15.29 3.97 4.03
79 SSD-Resnet34-1200 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 35.42 36.77 10.14 10.46
80 SSD-Resnet34-1200 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 41.35 43.93 11.73 12.20
81 end_rec
82 begin_rec
83 Unet-Camvid--0001 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 2.57 2.78 1.62 1.70
84 Unet-Camvid--0001 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 3.68 3.71 2.15 2.29
85 Unet-Camvid--0001 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 2.25 2.38 1.36 1.45
86 Unet-Camvid--0001 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 25.52 26.93 5.57 5.69
87 Unet-Camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 60.15 65.11 15.01 15.15
88 Unet-Camvid--0001 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 69.58 76.46 17.16 17.97
89 end_rec
90 begin_rec
91 Yolo_V3_Tiny OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 114.02 127.37 67.06 72.20
92 Yolo_V3_Tiny OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 148.72 168.41 85.62 91.66
93 Yolo_V3_Tiny OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 98.44 107.53 56.42 60.41
94 Yolo_V3_Tiny OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 592.92 850.58 207.96 240.90
95 Yolo_V3_Tiny OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 1631.49 2031.46 534.51 611.68
96 Yolo_V3_Tiny OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 1774.41 2428.00 691.96 725.60
97 end_rec
98 begin_rec
99 Yolo_V4 OV-2022.3-8991 core Intel® Core™ i3-10100 CPU-only 5.44 5.66 3.17 3.25
100 Yolo_V4 OV-2022.3-8991 core Intel® Core™ i5-8500 CPU-only 7.24 7.40 4.19 4.21
101 Yolo_V4 OV-2022.3-8991 core Intel® Core™ i7-8700T CPU-only 4.60 4.71 2.45 2.68
102 Yolo_V4 OV-2022.3-8991 core Intel® Core™ i9-10920X CPU-only 36.33 40.21 10.52 10.90
103 Yolo_V4 OV-2022.3-8991 xeon Intel® Xeon® Gold 6238 CPU-only 81.88 95.46 26.43 27.57
104 Yolo_V4 OV-2022.3-8991 xeon Intel® Xeon® 8260 CPU-only 96.58 111.93 30.48 34.50
105 end_rec

BIN
docs/_static/benchmarks_files/platform_list_22.3.pdf vendored
View File

Binary file not shown.

366
docs/_static/css/custom.css vendored
View File

@ -1,38 +1,46 @@
/* misc */
/* Misc */
/* =================================================== */
.switcher-set {
margin-bottom:1rem;
}
main img {
cursor: pointer;
}
.doxyrest-title-code-block {
margin-bottom: 0;
}
main .searchForm {
margin-bottom: 2rem;
margin-top: 2rem;
}
pre {
white-space: pre-wrap;
word-wrap: break-word;
}
/* navigation panels override */
/* Navigation panels override */
/* =================================================== */
/* hide home item in the top bar */
/* Hide home item in the top bar */
ul#navbar-main-elements li:first-of-type {
display: none;
}
/* items on hover */
#bd-docs-nav div ul a:hover {
text-decoration: underline;
}
ul#navbar-main-elements > li:hover {
text-decoration: underline;
}
/* first-level items in the side menu */
/* First-level items in the side menu */
#bd-docs-nav > div > ul > li {
padding-bottom: 15px;
}
@ -40,69 +48,82 @@ ul#navbar-main-elements > li:hover {
color: #000000;
font-weight: bold;
}
/* second level items */
/* Second level items */
#bd-docs-nav > div > ul > li > ul {
padding-left: 0.3rem;
}
/* overwrite menu chevron directions for open and closed states */
/* Overwrite menu chevron directions for open and closed states */
.toctree-checkbox~label i {
transform: rotate(270deg);
}
.toctree-checkbox:checked~label i {
transform: rotate(0deg);
}
/* footer links */
/* Footer links */
/* =================================================== */
footer div.container div.footer-item p a {
float: left;
margin-right: 30px;
}
footer div.container div.footer-item p a:nth-child(1) {
margin-right: 50px;
}
footer div.container div.footer-item p:nth-child(2) {
clear: both;
}
/* doc version dropdown formatting override */
/* Doc version dropdown formatting override */
/* =================================================== */
[aria-labelledby="version-selector"] {
min-width: 125px!important;
overflow-x: hidden!important;
}
.sst-dropdown #version-selector {
min-width: 125px!important;
}
[aria-labelledby="version-selector"] .dropdown-item {
padding: 0.25rem 0.5rem!important;
}
/* Content in two columns */
/* =================================================== */
.row-two-col-content {
display: flex;
}
.column-two-col-content {
flex: 50%;
padding-right: 10px!important;
}
/* code reference text formatting override */
/* Code reference text formatting override */
/* =================================================== */
code {
color: black !important;
font-weight: bold;
}
/* Table Sort Button */
/* =================================================== */
.sort-header {
cursor: pointer;
}
.sort-btn {
content: "";
background-image:url('media/arrow-small-opposite-v.svg');
@ -115,23 +136,29 @@ code {
position:relative;
top:0.5rem;
}
.sort-btn.sort-active.ascending,
.sort-btn.sort-active {
background-size: 100% 70%;
}
.sort-btn.sort-active.ascending {
background-image: url('media/union-down.svg');
}
.sort-btn.sort-active {
background-image: url('media/union-up.svg');
}
div.highlight {
margin-bottom: 1.15rem;
}
.highlight .err {
border:none;
color:inherit;
}
.opt-notice-wrapper {
position: fixed;
bottom:0;
@ -141,6 +168,7 @@ div.highlight {
padding: 1rem;
z-index: 1000;
}
.opt-notice {
margin-bottom: 0;
position: absolute;
@ -151,6 +179,7 @@ div.highlight {
color: #fff;
}
/* Transition banner */
/* =================================================== */
.transition-banner {
@ -190,11 +219,13 @@ div.highlight {
text-shadow: 0 1px 0 #fff;
opacity: .5;
}
.hidden-banner {
display: none!important;
}
/* responsiveness */
/* Responsiveness */
/* =================================================== */
@media (max-width: 720px) {
.transition-banner {
@ -217,19 +248,43 @@ div.highlight {
/* =================================================== */
.configure-graphs-header {
padding-left: 16px;
display: flex;
justify-content: space-between;
}
.configure-graphs-header h3 {
float: left;
}
.configure-graphs-content {
overflow: auto;
}
.header-inactive {
color: lightgray;
}
.configure-graphs-btn {
padding: 4px 20px;
background-color: #0054AE;
border-color: #0054AE;
color: #fefefe;
}
.chart-wrap {
display: grid;
grid-template-columns: minmax(0, 1fr) 4fr;
padding-left: 15px;
padding-right: 15px;
}
.graph-item {
display: flex;
flex-direction: column;
flex: 1;
min-width: 0;
}
.graph-chart-title-header {
font-size: 1.4rem;
line-height: 2rem;
@ -237,6 +292,7 @@ div.highlight {
padding: 12px 0;
margin: 0;
}
.empty-chart-container {
height: 80px;
line-height: 80px;
@ -245,63 +301,82 @@ div.highlight {
background-color: #f3f3f3;
border-radius: 5px;
}
.graph-chart-title {
vertical-align: middle;
padding: 12px 0;
}
.chart-column-header-container {
.chart-graphs-container {
padding-top: 8px;
display: flex;
flex-direction: row;
width: 100%;
min-width: 0;
}
.chart-column-title {
min-width: 20%;
flex-grow: 0 1;
white-space: nowrap;
display: flex;
flex-direction: row;
align-items: flex-start;
}
.chart-column-title .icon {
margin-top: 6px;
margin-right: 8px;
flex-grow: 0;
float: left;
}
.chart-column-title .chart-header {
flex-grow: 1;
float: left;
}
.chart-column-title .title {
font-size: 1rem;
font-weight: 400;
}
.chart-column-title .subtitle {
font-size: .8rem;
color: gray;
}
.chart-labels-container {
width: 18%;
padding-top: 8px;
}
.chart-labels-container .title {
text-align: right;
.chart-labels-item {
width: 100%;
}
.chart-labels-item .title {
text-overflow: ellipsis;
overflow: hidden;
white-space: nowrap;
display: block;
font-size: .8rem;
line-height: 3.42rem;
line-height: 55px;
height: 55px;
color: gray;
}
.chevron-right-btn {
content: url('media/chevron-right.svg');
vertical-align: middle;
padding-left: 8px;
}
.chevron-down-btn {
content: url('media/chevron-down.svg');
vertical-align: middle;
padding-left: 8px;
}
.chart {
height: 500px;
padding:0;
@ -320,7 +395,7 @@ div.highlight {
.build-benchmark-section .title {
flex-grow: 1;
}
}
.build-benchmark-section h3 {
margin-top: 1rem;
@ -357,63 +432,21 @@ div.highlight {
.efficiency-icon {
content: url('media/icon-efficiency.svg');
}
.latency-icon {
content: url('media/icon-latency.svg');
}
.throughput-icon {
content: url('media/icon-throughput.svg');
}
.value-icon {
content: url('media/icon-value.svg');
}
/* Modal */
/* The Close Button */
.modal-close {
color: #aaaaaa;
float: right;
font-size: 28px;
line-height: 24px;
padding-right: 4px;
}
.modal-close:hover,
.modal-close:focus {
color: #000;
text-decoration: none;
cursor: pointer;
}
.clear-all-btn {
float: right;
cursor: pointer;
line-height: 4rem;
}
.clear-all-btn-content {
border: 1.5px solid black;
padding: 6px 10px;
}
.edit-settings-btn {
float: right;
color: #0054AE;
font-size: 1.05rem;
cursor: pointer;
line-height: 4rem;
display: none;
}
.edit-settings-text {
vertical-align: middle;
}
.edit-settings-icon {
vertical-align: middle;
content: url('media/edit-settings.svg');
}
.modal {
display: block;
position: fixed;
@ -426,10 +459,6 @@ div.highlight {
background-color: rgba(0, 0, 0, 0.4);
}
.modal .models-column-one label {
word-break: break-word;
}
.modal-content {
overflow: auto;
background-color: #fefefe;
@ -437,7 +466,8 @@ div.highlight {
padding: 36px;
border: 1px solid #888;
width: 95%;
max-height: 90%;
max-width: 1140px;
max-height: 85%;
}
.modal-content h2 {
@ -454,21 +484,32 @@ div.highlight {
padding-bottom: 1px;
}
.modal-header-grid-container {
display: grid;
padding: 12px 64px 2px 16px;
grid-template-columns: 40% 20% 20% 10% 10%;
column-gap: 16px;
.modal-header {
display: flex;
justify-content: space-between;
border: 0;
padding: 0;
}
.modal-configure-graphs,
.modal-display-graphs {
display: flex;
flex-direction: column;
min-height: 0;
}
.modal-content-grid-container {
display: grid;
padding-left: 24px;
padding-right: 64px;
padding-top: 8px;
grid-template-columns: 20% 20% 20% 20% 10% 10%;
column-gap: 12px;
font-size: .78rem;
padding: 0.75rem 4rem 0.125rem 1rem;
grid-template-columns: repeat(3, 1fr);
grid-template-rows: auto;
gap: 2rem 1rem;
}
.modal-content-grid {
display: grid;
padding-top: .5rem;
grid-template-columns: 1fr;
}
.modal-content-grid-container .column {
@ -488,29 +529,11 @@ div.highlight {
margin-left: -14px;
}
.modal-header-grid-item h5 {
.modal-content-grid-item h5 {
font-weight: 530;
margin: 0;
}
.modal-grid-item h5 {
margin: 0;
}
.modal-build-graphs-btn {
margin-bottom: 10px;
margin-right: 3px;
padding: 4px 16px;
float: right;
border-color: #0054AE;
background-color: #0054AE;
color: #fff;
}
.modal-build-graphs-btn:disabled {
border-color: #8C8C8C;
background-color: lightgray;
}
.modal-footer {
display: none;
padding: 0;
@ -521,12 +544,31 @@ div.highlight {
left: 0;
}
.modal-footer-content {
display: flex;
justify-content: space-between;
}
.modal-disclaimer-box {
padding-right: 0.5rem;
}
.modal-disclaimer-box p {
color: #00000098;
font-size: 0.8rem;
margin-bottom: 0rem;
}
.benchmark-graph-results-header {
display: flex;
justify-content: space-between;
align-items: center;
padding-left: 16px;
}
.graph-row {
display: flex;
flex-direction: column;
padding-top: 10px;
padding-bottom: 20px;
}
@ -536,7 +578,119 @@ div.highlight {
}
.graph-row-column {
width: 20%;
width: 100%;
}
.graph-legend-container {
display: flex;
flex-direction: column;
}
@media screen and (max-width:768px) {
.modal-content-grid-container {
grid-template-columns: repeat(2, 1fr);
grid-template-rows: auto;
padding-right: 1rem;
}
}
@media screen and (max-width: 530px) {
.modal-content {
width: 100vw;
height: 100vh;
max-height: 100%;
}
.buttons-nav {
margin-top: 0.125rem;
margin-bottom: 0.125rem;
flex-direction: column;
gap: .5rem;
}
.clear-all-btn {
padding: 0;
}
.modal-content-grid-container {
grid-template-columns: 1fr;
grid-template-rows: auto;
padding-right: 1rem;
}
}
@media screen and (min-width: 530px) {
.modal-content-grid--cols-2 {
display: grid;
padding-top: .5rem;
grid-template-columns: 1fr 1fr;
column-gap: 1rem;
}
.span-element-big {
grid-column: 1 / span 2;
}
}
/* Modal buttons */
.modal-close {
color: #aaaaaa;
float: right;
font-size: 28px;
line-height: 24px;
padding-right: 4px;
}
.modal-close:hover,
.modal-close:focus {
color: #000;
text-decoration: none;
cursor: pointer;
}
.buttons-nav {
display: flex;
justify-content: center;
align-items: center;
gap: 1rem;
}
.build-graphs-btn {
border-color: #0054AE;
background-color: #0054AE;
color: #fff;
}
.build-graphs-btn:disabled {
border-color: #8C8C8C;
background-color: lightgray;
}
.clear-all-btn {
cursor: pointer;
}
.clear-all-btn-content {
border: 1.5px solid black;
padding: 6px 10px;
}
.edit-settings-btn {
color: #0054AE;
font-size: 1.05rem;
cursor: pointer;
line-height: 4rem;
}
.edit-settings-text {
vertical-align: middle;
}
.edit-settings-icon {
vertical-align: middle;
content: url('media/edit-settings.svg');
}
.close-btn {
@ -545,10 +699,11 @@ div.highlight {
background-color: #0054AE;
color: #fefefe;
float: right;
align-self: flex-start;
}
/* content formatting for the benchmark pages */
/* Content formatting for the benchmark pages */
.picker-options {
margin: 15px 0;
}
@ -639,7 +794,7 @@ div.highlight {
/* Create a custom checkbox */
.checkmark {
position: absolute;
top: 2px;
top: 5px;
left: 0;
height: 15px;
width: 15px;
@ -660,6 +815,11 @@ div.highlight {
background-color: #0054AE;
}
.checkmark-container input:disabled ~ .checkmark {
background: #d3d3d3;
border: 2px solid #8C8C8C;
}
/* Create the checkmark/indicator (hidden when not checked) */
.checkmark:after {
content: "";

115
docs/_static/html/modal.html vendored
View File

@ -1,64 +1,77 @@
<div>
<div style="width: 100%">
<span style="float: left"><h2>Benchmark Graph Builder</h2></span>
<div class="modal-header">
<h2>Benchmark Graph Builder</h2>
<span class="modal-close">&times;</span>
</div>
<div class="modal-line-divider"></div>
<div id="configure-graphs-header" class="configure-graphs-header">
<div class="edit-settings-btn">
<div class="edit-settings-text">Edit Settings
<span class="edit-settings-icon"></span>
<section id="modal-configure-graphs" class="modal-configure-graphs">
<div id="configure-graphs-header" class="configure-graphs-header">
<h3>Configure Graphs</h3>
<div class="buttons-nav">
<div>
<button id="build-graphs-btn" disabled="disabled" class="build-graphs-btn">Build Graphs</button>
</div>
<div class="clear-all-btn">
<span class="clear-all-btn-content">Clear All</span>
</div>
</div>
</div>
<span class="clear-all-btn">
<span class="clear-all-btn-content">Clear All</span>
</span>
<h3>STEP 1: Configure Graphs</h3>
</div>
<div class="configure-graphs-content">
<div class="modal-header-grid-container">
<div class="modal-header-grid-item">
<h5>Models</h5>
<div class="modal-line-divider"></div>
</div>
<div class="modal-header-grid-item">
<h5>Platform Type</h5>
<div class="modal-line-divider"></div>
</div>
<div class="modal-header-grid-item">
<h5>Platforms</h5>
<div class="modal-line-divider"></div>
</div>
<div class="modal-header-grid-item">
<h5>Parameters</h5>
<div class="modal-line-divider"></div>
</div>
<div class="modal-header-grid-item">
<h5>Precision</h5>
<div class="modal-line-divider"></div>
<div class="configure-graphs-content">
<div class="modal-content-grid-container">
<div class="modal-content-grid-item span-element-big">
<h5>Models</h5>
<div class="modal-line-divider"></div>
<div class="modal-content-grid modal-content-grid--cols-2">
<div class="models-column-one column"></div>
<div class="models-column-two column"></div>
</div>
</div>
<div class="modal-content-grid-item">
<h5>Platform Type</h5>
<div class="modal-line-divider"></div>
<div class="modal-content-grid">
<div class="ietype-column column"></div>
</div>
</div>
<div class="modal-content-grid-item">
<h5>Platforms</h5>
<div class="modal-line-divider"></div>
<div class="modal-content-grid">
<div class="client-platform-column column"></div>
</div>
</div>
<div class="modal-content-grid-item">
<h5>Parameters</h5>
<div class="modal-line-divider"></div>
<div class="modal-content-grid">
<div class="kpi-column column"></div>
</div>
</div>
<div class="modal-content-grid-item">
<h5>Precision</h5>
<div class="modal-line-divider"></div>
<div class="modal-content-grid">
<div class="precisions-column column"></div>
</div>
</div>
</div>
</div>
<div class="modal-content-grid-container">
<div class="models-column-one column"></div>
<div class="models-column-two column"></div>
<div class="ietype-column column"></div>
<div class="client-platform-column column">
</div>
<div class="kpi-column column"></div>
<div class="precisions-column column">
</section>
<section id="modal-display-graphs" class="modal-display-graphs">
<div class="benchmark-graph-results-header">
<h3>Graph Results</h3>
<div class="edit-settings-btn">
<div class="edit-settings-text">Edit Settings
<span class="edit-settings-icon"></span>
</div>
</div>
</div>
<div class="modal-content-footer">
<button id="modal-build-graphs-btn" disabled="disabled" class="modal-build-graphs-btn">Build Graphs</button>
</div>
</div>
<div class="modal-line-divider"></div>
<div class="benchmark-graph-results-header">
<h3 class="header-inactive">STEP 2: Benchmark Graph Results</h3>
</div>
<div class="chart-placeholder"></div>
<div class="modal-line-divider"></div>
<div class="chart-placeholder"></div>
</section>
<div class="modal-footer">
<button class="close-btn">Close</button>
<div class="modal-line-divider"></div>
<div class="modal-footer-content">
<div class="modal-disclaimer-box"></div>
</div>
</div>
</div>

0
docs/img/performance_benchmarks_ovms_02.png → docs/_static/images/performance_benchmarks_ovms_02.png vendored
View File

651
docs/_static/js/graphs.js vendored
View File

@ -1,3 +1,60 @@
// =================== GENERAL OUTPUT CONFIG =========================
const chartDisclaimers = {
Value: 'Value: Performance/(No_of_sockets * Price_of_CPU_dGPU), where prices are in USD as of December 2022.',
Efficiency: 'Efficiency: Performance/(No_of_sockets * TDP_of_CPU_dGPU), where total power dissipation (TDP) is in Watt as of December 2022.'
}
const OVdefaultSelections = {
platforms: {name: 'platform',
data: [
'Intel® Core™ i9-12900K CPU-only',
'Intel® Core™ i9-13900K CPU-only',
'Intel® Core™ i5-10500TE CPU-only',
'Intel® Core™ i5-13600K CPU-only',
'Intel® Core™ i5-8500 CPU-only',
'Intel® Core™ i7-8700T CPU-only',
'Intel® Core™ i9-10900TE CPU-only',
'Intel® Core™ i7-1165G7 CPU-only'
]
},
platformFilters: {name: 'coretype', data: ['CPU']},
models: {name: 'networkmodel',
data: [
'bert-large-uncased-whole-word-masking-squad-0001 ',
'mobilenet-ssd ',
'resnet-50',
'yolo_v3_tiny'
]
},
parameters: {name: 'kpi', data: ['Throughput']},
pracision: {name: 'precision', data: ['INT8', 'FP32']}
}
const OVMSdefaultSelections = {
platforms: {name: 'platform',
data: [
'Intel® Core™ i3-10100 CPU-only',
'Intel® Core™ i5-8500 CPU-only',
'Intel® Core™ i7-8700T CPU-only',
'Intel® Core™ i9-10920X CPU-only',
]
},
models: {name: 'networkmodel',
data: [
'bert-small-uncased-whole-word-masking-squad-0002',
'mobilenet-ssd ',
'resnet-50',
'yolo_v3_tiny'
]
},
parameters: {name: 'kpi', data: ['Throughput']},
pracision: {name: 'precision', data: ['OV-INT8 (reference)', 'INT8']}
}
// ====================================================
class Filter {
// param: GraphData[], networkModels[]
@ -37,9 +94,11 @@ class Filter {
});
}
}
class ExcelDataTransformer {
static transform(csvdata) {
static transform(csvdata, version) {
const entries = csvdata.filter((entry) => {
return !entry.includes('begin_rec') && !entry.includes('end_rec');
});
@ -47,17 +106,20 @@ class ExcelDataTransformer {
// else generate
return entries.map((entry) => {
if (version == 'ovms')
return new GraphData(new OVMSExcelData(entry));
return new GraphData(new ExcelData(entry));
});
}
}
class ExcelData {
constructor(csvdataline) {
if (!csvdataline) {
return;
}
this.networkModel = csvdataline[0];
this.networkModel = csvdataline[0].toLowerCase();
this.release = csvdataline[1];
this.ieType = csvdataline[2];
this.platformName = csvdataline[3];
@ -73,21 +135,17 @@ class ExcelData {
this.tdpPerSocket = csvdataline[13];
this.latency = csvdataline[14];
}
networkModel = '';
release = '';
ieType = '';
platformName = '';
throughputInt8 = '';
throughputFP16 = '';
throughputFP32 = '';
value = '';
efficiency = '';
price = '';
tdp = '';
sockets = '';
pricePerSocket = '';
tdpPerSocket = '';
latency = '';
}
class OVMSExcelData extends ExcelData {
constructor(csvdataline) {
super(csvdataline);
this.throughputOVMSInt8 = csvdataline[5];
this.throughputInt8 = csvdataline[4];
this.throughputOVMSFP32 = csvdataline[7];
this.throughputFP32 = csvdataline[6];
}
}
@ -101,7 +159,13 @@ class GraphData {
this.ieType = excelData.ieType;
this.platformName = excelData.platformName;
this.kpi = new KPI(
new Precision(excelData.throughputInt8, excelData.throughputFP16, excelData.throughputFP32),
{
'ovmsint8': excelData.throughputOVMSInt8,
'ovmsfp32': excelData.throughputOVMSFP32,
'int8': excelData.throughputInt8,
'fp16': excelData.throughputFP16,
'fp32': excelData.throughputFP32
},
excelData.value,
excelData.efficiency,
excelData.latency);
@ -112,18 +176,9 @@ class GraphData {
this.tdpPerSocket = excelData.tdpPerSocket;
this.latency = excelData.latency;
}
networkModel = '';
platformName = '';
release = '';
ieType = '';
kpi = new KPI();
price = '';
tdp = '';
sockets = '';
pricePerSocket = '';
tdpPerSocket = '';
}
class KPI {
constructor(precisions, value, efficiency, latency) {
this.throughput = precisions;
@ -131,22 +186,8 @@ class KPI {
this.efficiency = efficiency;
this.latency = latency;
}
throughput = new Precision();
value = '';
efficiency = '';
latency = '';
}
class Precision {
constructor(int8, fp16, fp32) {
this.int8 = int8;
this.fp16 = fp16;
this.fp32 = fp32;
}
int8 = '';
fp16 = '';
fp32 = '';
}
class Modal {
static getIeTypeLabel(ietype) {
@ -166,10 +207,14 @@ class Modal {
static getCoreTypesLabels() {
return ['CPU', 'iGPU', 'CPU+iGPU'];
}
static getKpisLabels() {
static getKpisLabels(version) {
if (version == 'ovms')
return ['Throughput'];
return ['Throughput', 'Value', 'Efficiency', 'Latency'];
}
static getPrecisionsLabels() {
static getPrecisionsLabels(version) {
if (version == 'ovms')
return ['OV-INT8 (reference)', 'INT8', 'OV-FP32 (reference)', 'FP32'];
return ['INT8', 'FP16', 'FP32'];
}
static getCoreTypes(labels) {
@ -189,6 +234,10 @@ class Modal {
static getPrecisions(labels) {
return labels.map((label) => {
switch (label) {
case 'OV-INT8 (reference)':
return 'ovmsint8';
case 'OV-FP32 (reference)':
return 'ovmsfp32';
case 'INT8':
return 'int8';
case 'FP16':
@ -202,6 +251,7 @@ class Modal {
}
}
class Graph {
constructor(data) {
this.data = data;
@ -281,12 +331,16 @@ class Graph {
static getPrecisionConfig(precision) {
switch (precision) {
case 'ovmsint8':
return { data: null, color: '#FF8F51', label: 'FPS (OV Ref. INT8)' };
case 'ovmsfp32':
return { data: null, color: '#B24501', label: 'FPS (OV Ref. FP32)' };
case 'int8':
return { data: null, color: '#00C7FD', label: 'FPS (INT8)' };
case 'fp16':
return { data: null, color: '#0068B5', label: 'FPS (FP16)' };
return { data: null, color: '#009fca', label: 'FPS (FP16)' };
case 'fp32':
return { data: null, color: '#00C7FD', label: 'FPS (FP32)' };
return { data: null, color: '#007797', label: 'FPS (FP32)' };
default:
return {};
}
@ -308,39 +362,42 @@ class Graph {
}
}
class ChartDisplay {
constructor(mode, numberOfCharts) {
this.mode = mode;
this.numberOfChartsInRow = numberOfCharts;
}
}
$(document).ready(function () {
$('.ov-toolkit-benchmark-results').on('click', showModal);
$('.ov-toolkit-benchmark-results').on('click', () => showModal('ov'));
$('.ovms-toolkit-benchmark-results').on('click', () => showModal('ovms'));
function clickBuildGraphs(graph, networkModels, ietype, platforms, kpis, precisions) {
renderData(graph, networkModels, ietype, platforms, kpis, precisions);
$('.edit-settings-btn').show();
$('.clear-all-btn').hide();
$('.modal-footer').show();
$('.configure-graphs-header h3').addClass('header-inactive');
$('.benchmark-graph-results-header h3').removeClass('header-inactive');
$('#modal-display-graphs').show();
$('.edit-settings-btn').on('click', (event) => {
$('.configure-graphs-content').show();
$('.edit-settings-btn').hide();
$('.clear-all-btn').show();
$('#modal-configure-graphs').show();
$('#modal-display-graphs').hide();
$('.modal-footer').hide();
$('.configure-graphs-header h3').removeClass('header-inactive');
$('.benchmark-graph-results-header h3').addClass('header-inactive');
$('.chart-placeholder').empty();
});
$('.graph-chart-title-header').on('click', (event) => {
var parent = event.target.parentElement;
if ($(parent).children('.chart-wrap.container,.empty-chart-container').is(":visible")) {
$(parent).children('.chart-wrap.container,.empty-chart-container').hide();
if ($(parent).children('.chart-wrap,.empty-chart-container').is(":visible")) {
$(parent).children('.chart-wrap,.empty-chart-container').hide();
$(parent).children('.chevron-right-btn').show();
$(parent).children('.chevron-down-btn').hide();
$
} else {
$(parent).children('.chart-wrap.container,.empty-chart-container').show();
$(parent).children('.chart-wrap,.empty-chart-container').show();
$(parent).children('.chevron-down-btn').show();
$(parent).children('.chevron-right-btn').hide();
}
@ -348,26 +405,24 @@ $(document).ready(function () {
}
function hideModal() {
$('#graphModal').hide();
$('#graphModal').remove();
$('body').css('overflow', 'auto');
}
function showModal() {
function showModal(version) {
$('body').css('overflow', 'hidden');
if ($('#graphModal').length) {
$('#graphModal').show();
return;
}
const dataPath = '_static/benchmarks_files/benchmark-data.csv';
let dataPath = '_static/benchmarks_files/OV-benchmark-data.csv';
if (version == 'ovms')
dataPath = '_static/benchmarks_files/OVMS-benchmark-data.csv';
Papa.parse(dataPath, {
download: true,
complete: renderModal
complete: (result) => renderModal(result, version)
});
}
function getSelectedNetworkModels() {
return $('.models-column-one input:checked, .models-column-two input:checked').map(function () {
return $('.models-column-one input:checked, .models-column-two input:checked').not('[data-networkmodel="Select All"]').map(function () {
return $(this).data('networkmodel');
}).get();
}
@ -392,7 +447,7 @@ $(document).ready(function () {
}).get();
}
function getSelectedPrecisions() {
return $('.precisions-column .selected').map(function () {
return $('.precisions-column input:checked').map(function () {
return $(this).data('precision');
}).get();
}
@ -404,22 +459,22 @@ $(document).ready(function () {
&& getSelectedKpis().length > 0) {
if (getSelectedKpis().includes('Throughput')) {
if (getSelectedPrecisions().length > 0) {
$('#modal-build-graphs-btn').prop('disabled', false);
$('#build-graphs-btn').prop('disabled', false);
return;
}
$('#modal-build-graphs-btn').prop('disabled', true);
$('#build-graphs-btn').prop('disabled', true);
return;
}
$('#modal-build-graphs-btn').prop('disabled', false);
$('#build-graphs-btn').prop('disabled', false);
return;
}
$('#modal-build-graphs-btn').prop('disabled', true);
$('#build-graphs-btn').prop('disabled', true);
}
function renderModal(result) {
function renderModal(result, version) {
// remove header from csv line
result.data.shift();
var graph = new Graph(ExcelDataTransformer.transform(result.data));
var graph = new Graph(ExcelDataTransformer.transform(result.data, version));
var networkModels = Graph.getNetworkModels(graph.data);
var ieTypes = Graph.getIeTypes(graph.data);
@ -436,13 +491,16 @@ $(document).ready(function () {
modalContent.addClass('modal-content');
modal.append(modalContent);
// hide edit settings button
$('.edit-settings-btn').hide();
const models = networkModels.map((networkModel) => createCheckMark(networkModel, 'networkmodel'));
modal.find('.models-column-one').append(models.slice(0, models.length / 2));
const selectAllModelsButton = createCheckMark('Select All', 'networkmodel')
modal.find('.models-column-one').append(selectAllModelsButton).append(models.slice(0, models.length / 2));
modal.find('.models-column-two').append(models.slice(models.length / 2));
const precisions = Modal.getPrecisionsLabels(version).map((precision) => createCheckMark(precision, 'precision'));
modal.find('.precisions-column').append(precisions);
selectAllCheckboxes(precisions);
disableAllCheckboxes(precisions);
const types = ieTypes.map((ieType) => {
var labelText = Modal.getIeTypeLabel(ieType);
if (labelText) {
@ -456,52 +514,75 @@ $(document).ready(function () {
return item;
}
});
modal.find('#modal-display-graphs').hide();
modal.find('.ietype-column').append(types);
modal.find('.ietype-column input').first().prop('checked', true);
const kpiLabels = Modal.getKpisLabels().map((kpi) => createCheckMark(kpi, 'kpi'));
const kpiLabels = Modal.getKpisLabels(version).map((kpi) => createCheckMark(kpi, 'kpi'));
modal.find('.kpi-column').append(kpiLabels);
$('body').prepend(modal);
var fPlatforms = filterClientPlatforms(graph.data, getSelectedNetworkModels(), getSelectedIeType(), Modal.getCoreTypes(getSelectedCoreTypes()));
renderClientPlatforms(modal, Graph.getPlatformNames(fPlatforms));
renderClientPlatforms(graph.data, modal, version, true);
preselectDefaultSettings(graph.data, modal, version);
$('.clear-all-btn').on('click', () => {
$('.modal-content-grid-container input:checkbox').each((index, object) => $(object).prop('checked', false));
$('.precisions-column').empty();
modal.find('.ietype-column input').first().prop('checked', true);
validateSelections();
});
$('#modal-build-graphs-btn').on('click', () => {
$('.configure-graphs-content').hide();
$('.clear-all-btn').on('click', clearAll);
$('#build-graphs-btn').on('click', () => {
$('#modal-configure-graphs').hide();
clickBuildGraphs(graph, getSelectedNetworkModels(), getSelectedIeType(), getSelectedClientPlatforms(), getSelectedKpis(), Modal.getPrecisions(getSelectedPrecisions()));
});
$('.modal-close').on('click', hideModal);
$('.close-btn').on('click', hideModal);
modal.find('.ietype-column input').on('click', function (event) {
if (getSelectedIeType() === 'core') {
showCoreSelectorTypes(Modal.getCoreTypesLabels(), graph.data, modal);
}
else {
hideCoreSelectorTypes();
}
var fPlatforms = filterClientPlatforms(graph.data, getSelectedNetworkModels(), getSelectedIeType(), Modal.getCoreTypes(getSelectedCoreTypes()));
renderClientPlatforms(modal, Graph.getPlatformNames(fPlatforms));
});
modal.find('.kpi-column input').on('click', function (event) {
if (getSelectedKpis().includes('Throughput')) {
showPrecisionSelectorTypes(Modal.getPrecisionsLabels());
}
else {
hidePrecisionSelectorTypes();
}
modal.find('.models-column-one input[data-networkmodel="Select All"]').on('click', function() {
if ($(this).prop('checked'))
selectAllCheckboxes(models);
else deSelectAllCheckboxes(models);
});
modal.find('.ietype-column input').on('click', () => renderClientPlatforms(graph.data, modal, version, true));
modal.find('.kpi-column input').on('click', validateThroughputSelection);
modal.find('input').on('click', validateSelections);
});
}
function validateThroughputSelection() {
const precisions = $('.precisions-column').find('input')
if (getSelectedKpis().includes('Throughput')) {
precisions.prop('disabled', false);
}
else {
precisions.prop('disabled', true);
}
}
function clearAll() {
$('.modal-content-grid-container input:checkbox').each((index, object) => $(object).prop('checked', false));
// Uncomment if you want the Clear All button to reset the Platform Type column as well
// modal.find('.ietype-column input').first().prop('checked', true);
validateThroughputSelection();
validateSelections();
}
function preselectDefaultSettings(data, modal, version) {
const defaultSelections = (version == 'ov') ? OVdefaultSelections : OVMSdefaultSelections;
if (defaultSelections.platformFilters) {
const filters = modal.find('.selectable-box-container').children('.selectable-box');
filters.removeClass('selected');
defaultSelections.platformFilters.data.forEach(selection => {
filters.filter(`[data-${defaultSelections.platformFilters.name}="${selection}"]`).addClass('selected');
});
renderClientPlatforms(data, modal, version);
}
clearAll();
for (setting in defaultSelections) {
let name = defaultSelections[setting].name;
defaultSelections[setting].data.forEach(selection => {
$(`input[data-${name}="${selection}"]`).prop('checked', true);
});
}
validateThroughputSelection();
validateSelections();
}
function showCoreSelectorTypes(coreTypes, graphDataArr, modal) {
if ($('.client-platform-column').find('.selectable-box-container').length) {
@ -524,7 +605,7 @@ $(document).ready(function () {
$(this).addClass('selected');
}
var fPlatforms = filterClientPlatforms(graphDataArr, getSelectedNetworkModels(), getSelectedIeType(), Modal.getCoreTypes(getSelectedCoreTypes()));
renderClientPlatforms(modal, Graph.getPlatformNames(fPlatforms));
renderClientPlatformsItems(modal, Graph.getPlatformNames(fPlatforms), true);
validateSelections();
});
}
@ -533,36 +614,6 @@ $(document).ready(function () {
$('.client-platform-column').find('.selectable-box-container').hide();
}
function showPrecisionSelectorTypes(precisions) {
if ($('.precisions-column').find('.selectable-box-container').length) {
$('.precisions-column').find('.selectable-box-container').show();
return;
}
var container = $('<div>');
container.addClass('selectable-box-container');
precisions.forEach((prec) => {
var box = $('<div>' + prec + '</div>');
box.attr('data-precision', prec);
box.addClass('selectable-box');
container.append(box);
});
$('.precisions-column').prepend(container);
$('.precisions-column .selectable-box').on('click', function () {
if ($(this).hasClass('selected')) {
$(this).removeClass('selected');
} else {
$(this).addClass('selected');
}
validateSelections();
});
}
function hidePrecisionSelectorTypes() {
$('.precisions-column').find('.selectable-box-container').hide();
}
function filterClientPlatforms(data, networkModels, ietype, coreTypes) {
// No longer filtering on the network type, if at some point we want the network type as a filter, uncomment this
// var first = Filter.FilterByNetworkModel(data, networkModels);
@ -575,10 +626,24 @@ $(document).ready(function () {
return Array.from(optionMap.values());
}
function renderClientPlatforms(modal, platformNames) {
function renderClientPlatforms(data, modal, version, preselectEveryItem) {
if (getSelectedIeType() === 'core') {
showCoreSelectorTypes(Modal.getCoreTypesLabels(), data, modal);
if (version === 'ovms')
hideCoreSelectorTypes();
}
else {
hideCoreSelectorTypes();
}
var fPlatforms = filterClientPlatforms(data, getSelectedNetworkModels(), getSelectedIeType(), Modal.getCoreTypes(getSelectedCoreTypes()));
renderClientPlatformsItems(modal, Graph.getPlatformNames(fPlatforms), preselectEveryItem);
}
function renderClientPlatformsItems(modal, platformNames, preselectEveryItem) {
$('.client-platform-column .checkmark-container').remove();
const clientPlatforms = platformNames.map((platform) => createCheckMark(platform, 'platform'));
selectAllCheckboxes(clientPlatforms);
if (preselectEveryItem)
selectAllCheckboxes(clientPlatforms);
modal.find('.client-platform-column').append(clientPlatforms);
modal.find('.client-platform-column input').on('click', validateSelections);
}
@ -597,15 +662,115 @@ $(document).ready(function () {
// receives a jquery list of items and selects all input checkboxes
function selectAllCheckboxes(items) {
items.forEach((item) => {
item.find(':input').attr('checked', true);
item.find(':input').prop('checked', true);
});
}
function getChartOptions(title) {
function enableAllCheckboxes(items) {
items.forEach((item) => {
item.find(':input').prop('disabled', false);
})
}
function disableAllCheckboxes(items) {
items.forEach((item) => {
item.find(':input').prop('disabled', true);
})
}
function deSelectAllCheckboxes(items) {
items.forEach((item) => {
item.find(':input').prop('checked', false);
});
}
// =================== HTMLLEGEND =========================
const getOrCreateLegendList = (chart, id) => {
const legendContainer = document.getElementById(id);
let listContainer = legendContainer.querySelector('ul');
if (!listContainer) {
listContainer = document.createElement('ul');
listContainer.style.display = 'flex';
listContainer.style.flexDirection = 'column';
listContainer.style.margin = 0;
listContainer.style.padding = 0;
listContainer.style.paddingLeft = '10px';
legendContainer.appendChild(listContainer);
}
return listContainer;
};
const htmlLegendPlugin = {
id: 'htmlLegend',
afterUpdate(chart, args, options) {
const ul = getOrCreateLegendList(chart, chart.options.plugins.htmlLegend.containerID);
// Remove old legend items
while (ul.firstChild) {
ul.firstChild.remove();
}
// Reuse the built-in legendItems generator
const items = chart.legend.legendItems;
items.forEach(item => {
const li = document.createElement('li');
li.style.alignItems = 'center';
li.style.display = 'flex';
li.style.flexDirection = 'row';
li.style.marginLeft = '10px';
li.onclick = () => {
const {type} = chart.config;
if (type === 'pie' || type === 'doughnut') {
// Pie and doughnut charts only have a single dataset and visibility is per item
chart.toggleDataVisibility(item.index);
} else {
chart.setDatasetVisibility(item.datasetIndex, !chart.isDatasetVisible(item.datasetIndex));
}
chart.update();
};
// Color box
const boxSpan = document.createElement('span');
boxSpan.style.background = item.fillStyle;
boxSpan.style.borderColor = item.strokeStyle;
boxSpan.style.borderWidth = item.lineWidth + 'px';
boxSpan.style.display = 'inline-block';
boxSpan.style.height = '12px';
boxSpan.style.marginRight = '10px';
boxSpan.style.width = '30px';
// Text
const textContainer = document.createElement('p');
textContainer.style.color = item.fontColor;
textContainer.style.margin = 0;
textContainer.style.padding = 0;
// textContainer.style.fontFamily = 'Roboto';
textContainer.style.fontSize = '0.8rem';
textContainer.style.textDecoration = item.hidden ? 'line-through' : '';
const text = document.createTextNode(item.text);
textContainer.appendChild(text);
li.appendChild(boxSpan);
li.appendChild(textContainer);
ul.appendChild(li);
});
}
};
// ====================================================
function getChartOptions(title, containerId) {
return {
responsive: true,
maintainAspectRatio: false,
legend: { display: true, position: 'bottom' },
legend: {display: false},
title: {
display: false,
text: title
@ -624,17 +789,9 @@ $(document).ready(function () {
}]
},
plugins: {
datalabels: {
color: "#4A4A4A",
anchor: "end",
align: "end",
clamp: false,
offset: 0,
display: true,
font: {
size: 8,
family: 'Roboto'
}
htmlLegend: {
// ID of the container to put the legend in
containerID: containerId,
}
}
}
@ -659,8 +816,10 @@ $(document).ready(function () {
function renderData(graph, networkModels, ietype, platforms, kpis, precisions) {
$('.chart-placeholder').empty();
$('.modal-disclaimer-box').empty();
const display = new ChartDisplay(getChartsDisplayMode(kpis.length), kpis.length);
networkModels.forEach((networkModel) => {
// graph title
var chartName = networkModel;
var chartSlug = chartName.replace(')', '').replace(' (', '-');
var chartContainer = $('<div>');
@ -668,13 +827,13 @@ $(document).ready(function () {
var chevronDown = '<span class="chevron-down-btn"></span>';
var chevronRight = '<span style="display:none" class="chevron-right-btn"></span>';
$(chevronRight).hide();
var chartContainerHeader = $('<span class="graph-chart-title">' + networkModel + '</span>' + chevronDown + chevronRight);
var chartContainerHeader = $(chevronDown + chevronRight + '<span class="graph-chart-title">' + networkModel + '</span>');
chartContainerHeader.addClass('graph-chart-title-header');
chartContainer.prepend(chartContainerHeader);
chartContainer.attr('id', 'ov-chart-container-' + chartSlug);
chartContainer.addClass('chart-container');
chartContainer.addClass('container');
var filteredNetworkModels = Filter.FilterByNetworkModel(graph.data, [networkModel]);
var filteredIeTypes = Filter.FilterByIeType(filteredNetworkModels, ietype);
@ -682,25 +841,30 @@ $(document).ready(function () {
$('.chart-placeholder').append(chartContainer);
if (filteredGraphData.length > 0) {
createChartWithNewData(filteredGraphData, chartContainer, kpis, ietype, precisions);
createChartWithNewData(filteredGraphData, chartContainer, kpis, ietype, precisions, display);
} else {
createEmptyChartContainer(chartContainer);
}
})
for (let kpi of kpis) {
if (chartDisclaimers[kpi])
$('.modal-disclaimer-box').append($('<p>').text(chartDisclaimers[kpi]))
}
$(window).off('resize');
$(window).resize(() => resetChartsDisplay(display));
};
function createEmptyChartContainer(chartContainer) {
chartContainer.append($('<div>').addClass('empty-chart-container').text('No data for this configuration.'));
}
// this function should take the final data set and turn it into graphs
// params: GraphData, unused, chartContainer
function createChartWithNewData(model, chartContainer, kpis, ietype, precisions) {
function createChartWithNewData(model, chartContainer, kpis, ietype, precisions, display) {
var chartWrap = $('<div>');
chartWrap.addClass('chart-wrap');
chartWrap.addClass('container');
chartContainer.append(chartWrap);
var labels = Graph.getPlatformNames(model);
@ -719,12 +883,20 @@ $(document).ready(function () {
return config;
});
// get the client platform labels and create labels for all the graphs
var labelsContainer = $('<div>');
labelsContainer.addClass('chart-labels-container');
chartWrap.append(labelsContainer);
// get the kpi title's and create headers for the graphs
var chartColumnHeaderContainer = $('<div>');
chartColumnHeaderContainer.addClass('chart-column-header-container');
chartColumnHeaderContainer.append($('<div class="chart-column-title"></div>'));
graphConfigs.forEach((graphConfig) => {
var chartGraphsContainer = $('<div>');
chartGraphsContainer.addClass('chart-graphs-container');
chartWrap.append(chartGraphsContainer);
graphConfigs.forEach((graphConfig, index) => {
const id = getRandomNumber();
var graphItem = $(`<div id=${id}>`);
graphItem.addClass('graph-item');
var columnHeaderContainer = $('<div>');
columnHeaderContainer.addClass('chart-column-title');
var columnIcon = $('<div class="icon">');
@ -734,53 +906,134 @@ $(document).ready(function () {
columnHeader.append($('<div class="title">' + graphConfig.chartTitle + '</div>'));
columnHeader.append($('<div class="title">' + Graph.getGraphPlatformText(ietype) + '</div>'));
columnHeader.append($('<div class="subtitle">' + graphConfig.chartSubtitle + '</div>'));
columnHeaderContainer.append(columnHeader);
chartColumnHeaderContainer.append(columnHeaderContainer);
chartGraphsContainer.append(graphItem);
var graphClass = $('<div>');
graphClass.addClass('graph-row');
graphItem.append(columnHeaderContainer);
graphItem.append(graphClass);
processMetricNew(labels, graphConfig.datasets, graphConfig.chartTitle, graphClass, 'graph-row-column', id);
window.setTimeout(() => {
const topPadding = getLabelsTopPadding(display.mode);
const labelsHeight = (labels.length * 55);
const chartHeight = $(graphItem).outerHeight();
const bottomPadding = (chartHeight - (topPadding + labelsHeight));
var labelsItem = $('<div>');
labelsItem.addClass('chart-labels-item');
labels.forEach((label) => {
labelsItem.append($('<div class="title">' + label + '</div>'));
});
labelsItem.css('padding-top', topPadding + 'px');
labelsItem.css('padding-bottom', bottomPadding + 'px');
setInitialItemsVisibility(labelsItem, index, display.mode);
labelsContainer.append(labelsItem);
});
});
// get the client platform labels and create labels for all the graphs
var labelsContainer = $('<div>');
labelsContainer.addClass('chart-labels-container');
labels.forEach((label) => {
labelsContainer.append($('<div class="title">' + label + '</div>'));
});
// get the legend and create legends for each graph
var graphClass = $('<div>');
graphClass.addClass('graph-row');
chartWrap.append(chartColumnHeaderContainer);
graphClass.append(labelsContainer);
chartWrap.append(graphClass);
graphConfigs.forEach((graphConfig) => {
processMetricNew(labels, graphConfig.datasets, graphConfig.chartTitle, graphClass, 'graph-row-column');
});
// might need this line for multiple graphs on a page
// var displayWidth = $(window).width();
setChartsDisplayDirection(display.mode);
adjustHeaderIcons(display.mode);
}
function processMetricNew(labels, datasets, chartTitle, container, widthClass, displayLabels) {
function processMetricNew(labels, datasets, chartTitle, container, widthClass, id) {
// ratio for consistent chart label height
var heightRatio = ((labels.length * 55 + 20) / labels.length) + (labels.length * 55);
var heightRatio = (30 + (labels.length * 55));
var chart = $('<div>');
const containerId = `legend-container-${id}`;
const legend = $(`<div id="${containerId}">`);
legend.addClass('graph-legend-container');
chart.addClass('chart');
chart.addClass(widthClass);
chart.height(heightRatio);
var canvas = $('<canvas>');
chart.append(canvas);
container.append(chart);
container.append(legend);
var context = canvas.get(0).getContext('2d');
context.canvas.height = heightRatio;
new Chart(context, {
window.setTimeout(() => {
new Chart(context, {
type: 'horizontalBar',
data: getChartDataNew(labels, datasets),
options: getChartOptions(chartTitle, displayLabels)
options: getChartOptions(chartTitle, containerId),
plugins: [htmlLegendPlugin]
});
});
}
function getRandomNumber() {
return Math.floor(Math.random() * 100000);
}
function resetChartsDisplay(currentDisplay) {
const newDisplayMode = getChartsDisplayMode(currentDisplay.numberOfChartsInRow);
if (currentDisplay.mode != newDisplayMode) {
currentDisplay.mode = newDisplayMode;
setChartsDisplayDirection(currentDisplay.mode);
adjustLabels(currentDisplay.mode);
adjustHeaderIcons(currentDisplay.mode);
}
}
function adjustLabels(displayMode) {
const firstLabels = $('.chart-labels-container').find('.chart-labels-item:first-child');
const labels = $('.chart-labels-container').find('.chart-labels-item');
labels.css('padding-top', getLabelsTopPadding(displayMode));
if (displayMode == 'column') {
labels.show();
}
else {
labels.hide()
firstLabels.show();
}
}
function adjustHeaderIcons(displayMode) {
const icons = $('.graph-item').find('.chart-column-title');
if (displayMode == 'rowCompact')
icons.css('flex-direction', 'column')
else
icons.css('flex-direction', 'row')
}
function getLabelsTopPadding(displayMode) {
return (displayMode == 'rowCompact') ? 105.91 : 83.912;
}
function setChartsDisplayDirection(displayMode) {
const container = $('.chart-placeholder').find('.chart-graphs-container');
if (displayMode == 'column') {
container.css('flex-direction', 'column');
}
else {
container.css('flex-direction', 'row');
}
}
function setInitialItemsVisibility(item, count, displayMode) {
if (count == 0 || displayMode == 'column') item.show();
else item.hide();
}
function getChartsDisplayMode(numberOfCharts) {
switch (numberOfCharts) {
case 4:
return window.matchMedia('(max-width: 721px)').matches ? 'column'
: window.matchMedia('(max-width: 830px)').matches ? 'rowCompact'
: 'row';
case 3:
return window.matchMedia('(max-width: 569px)').matches ? 'column'
: window.matchMedia('(max-width: 649px)').matches ? 'rowCompact'
: 'row';
case 2:
return window.matchMedia('(max-width: 500px)').matches ? 'column'
: 'row';
default:
return 'row';
}
}
});

178
docs/benchmarks/performance_benchmarks.md
View File

@ -6,21 +6,173 @@
:maxdepth: 1
:hidden:
openvino_docs_performance_benchmarks_openvino
openvino_docs_performance_benchmarks_faq
openvino_docs_performance_int8_vs_fp32
Performance Data Spreadsheet (download xlsx) <https://docs.openvino.ai/2022.3/_static/benchmarks_files/OV-2022.3-Performance-Data.xlsx>
openvino_docs_MO_DG_Getting_Performance_Numbers
This page presents benchmark results for `Intel® Distribution of OpenVINO™ toolkit <https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html>`__
and :doc:`OpenVINO Model Server <ovms_what_is_openvino_model_server>`, for a representative selection of public neural networks and Intel® devices.
The results may help you decide which hardware to use in your applications or plan AI workload for the hardware you have already implemented in your solutions.
Click the buttons below to see the chosen benchmark data.
.. grid:: 1 1 2 2
:gutter: 4
.. grid-item::
.. button-link:: #
:class: ov-toolkit-benchmark-results
:color: primary
:outline:
:expand:
:material-regular:`bar_chart;1.4em` OpenVINO Benchmark Graphs
.. grid-item::
.. button-link:: #
:class: ovms-toolkit-benchmark-results
:color: primary
:outline:
:expand:
:material-regular:`bar_chart;1.4em` OVMS Benchmark Graphs
For a successful deep learning inference application, the following four key metrics need to be considered:
.. tab:: :material-regular:`keyboard_double_arrow_right;1.4em` Throughput
Measures the number of inferences delivered within a latency threshold
(for example, number of Frames Per Second - FPS). When deploying a system with
deep learning inference, select the throughput that delivers the best trade-off
between latency and power for the price and performance that meets your requirements.
.. tab:: :material-regular:`attach_money;1.4em` Value
While throughput is important, what is more critical in edge AI deployments is
the performance efficiency or performance-per-cost. Application performance in
throughput per dollar of system cost is the best measure of value. The value KPI is
calculated as “Throughput measured as inferences per second / price of inference engine”.
This means for a 2 socket system 2x the price of a CPU is used. Prices are as per
date of benchmarking and sources can be found as links in the Hardware Platforms (PDF) description below.
.. tab:: :material-regular:`flash_on;1.4em` Efficiency
System power is a key consideration from the edge to the data center. When selecting
deep learning solutions, power efficiency (throughput/watt) is a critical factor to consider.
Intel designs provide excellent power efficiency for running deep learning workloads.
The efficiency KPI is calculated as “Throughput measured as inferences per second / TDP of
inference engine”. This means for a 2 socket system 2x the power dissipation (TDP) of a CPU is used.
TDP-values are as per date of benchmarking and sources can be found as links in the Hardware Platforms (PDF) description below.
.. tab:: :material-regular:`hourglass_empty;1.4em` Latency
This measures the synchronous execution of inference requests and is reported in milliseconds.
Each inference request (for example: preprocess, infer, postprocess) is allowed to complete before
the next is started. This performance metric is relevant in usage scenarios where a single image
input needs to be acted upon as soon as possible. An example would be the healthcare sector where
medical personnel only request analysis of a single ultra sound scanning image or in real-time or
near real-time applications for example an industrial robot's response to actions in its environment
or obstacle avoidance for autonomous vehicles.
Platforms, Configurations, Methodology
###########################################################
For a listing of all platforms and configurations used for testing, refer to the following:
.. grid:: 1 1 2 2
:gutter: 4
.. grid-item::
.. button-link:: _static/benchmarks_files/platform_list_22.3.pdf
:color: primary
:outline:
:expand:
:material-regular:`download;1.5em` Click for Hardware Platforms [PDF]
.. button-link:: _static/benchmarks_files/OV-2022.3-system-info-detailed.xlsx
:color: primary
:outline:
:expand:
:material-regular:`download;1.5em` Click for Configuration Details [XLSX]
.. the files above need to be updated with OVMS !!!
The OpenVINO benchmark setup includes a single system with OpenVINO™, as well as the benchmark application installed.
It measures the time spent on actual inference (excluding any pre or post processing) and then reports on the inferences
per second (or Frames Per Second).
OpenVINO™ Model Server (OVMS) employs the Intel® Distribution of OpenVINO™ toolkit runtime libraries and exposes a set of
models via a convenient inference API over gRPC or HTTP/REST. Its benchmark results are measured with the configuration of
multiple-clients-single-server, using two hardware platforms connected by ethernet. Network bandwidth depends on both, platforms
and models under investigation. It is set not to be a bottleneck for workload intensity. The connection is dedicated
only to measuring performance.
.. dropdown:: See more details about OVMS benchmark setup
The benchmark setup for OVMS consists of four main parts:
.. image:: _static/images/performance_benchmarks_ovms_02.png
:alt: OVMS Benchmark Setup Diagram
* **OpenVINO™ Model Server** is launched as a docker container on the server platform and it listens (and answers on)
requests from clients. OpenVINO™ Model Server is run on the same machine as the OpenVINO™ toolkit benchmark application
in corresponding benchmarking. Models served by OpenVINO™ Model Server are located in a local file system mounted into
the docker container. The OpenVINO™ Model Server instance communicates with other components via ports over a dedicated docker network.
* **Clients** are run in separated physical machine referred to as client platform. Clients are implemented in Python3
programming language based on TensorFlow* API and they work as parallel processes. Each client waits for a response from OpenVINO™
Model Server before it will send a new next request. The role played by the clients is also verification of responses.
* **Load balancer** works on the client platform in a docker container. HAProxy is used for this purpose. Its main role is
counting of requests forwarded from clients to OpenVINO™ Model Server, estimating its latency, and sharing this information by
Prometheus service. The reason of locating the load balancer on the client site is to simulate real life scenario that includes
impact of physical network on reported metrics.
* **Execution Controller** is launched on the client platform. It is responsible for synchronization of the whole measurement process,
downloading metrics from the load balancer, and presenting the final report of the execution.
Test performance yourself
####################################
You can also test performance for your system yourself, following the guide on :doc:`getting performance numbers <openvino_docs_MO_DG_Getting_Performance_Numbers>`.
Performance of a particular application can also be evaluated virtually using `Intel® DevCloud for the Edge <https://devcloud.intel.com/edge/>`__.
It is a remote development environment with access to Intel® hardware and the latest versions of the Intel® Distribution of the OpenVINO™ Toolkit.
To learn more about it, visit `the website <https://www.intel.com/content/www/us/en/developer/tools/devcloud/edge/overview.html>`__
or `create an account <https://www.intel.com/content/www/us/en/secure/forms/devcloud-enrollment/account-provisioning.html>`__.
Disclaimers
####################################
* Intel® Distribution of OpenVINO™ toolkit performance results are based on release 2022.3, as of December 13, 2022.
* OpenVINO Model Server performance results are based on release 2022.3, as of December 13, 2022.
The results may not reflect all publicly available updates. Intel technologies’ features and benefits depend on system configuration
and may require enabled hardware, software, or service activation. Learn more at intel.com, or from the OEM or retailer.
See configuration disclosure for details. No product can be absolutely secure.
Performance varies by use, configuration and other factors. Learn more at `www.intel.com/PerformanceIndex <https://www.intel.com/PerformanceIndex>`__.
Your costs and results may vary.
Intel optimizations, for Intel compilers or other products, may not optimize to the same degree for non-Intel products.
@endsphinxdirective
The [Intel® Distribution of OpenVINO™ toolkit](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html) helps accelerate deep learning inference across a variety of Intel® processors and accelerators.
The benchmark results below demonstrate high performance gains on several public neural networks on multiple Intel® CPUs, GPUs and VPUs covering a broad performance range. The results may be helpful when deciding which hardware is best for your applications or to plan AI workload on the Intel computing already included in your solutions.
Benchmarks are available for:
* [Intel® Distribution of OpenVINO™ toolkit](performance_benchmarks_openvino.md).
You can also test performance for your system yourself, following the guide on [getting performance numbers](../MO_DG/prepare_model/Getting_performance_numbers.md).
Performance of a particular application can also be evaluated virtually using [Intel® DevCloud for the Edge](https://devcloud.intel.com/edge/). It is a remote development environment with access to Intel® hardware and the latest versions of the Intel® Distribution of the OpenVINO™ Toolkit. To learn more about it, visit [the website](https://www.intel.com/content/www/us/en/developer/tools/devcloud/edge/overview.html) or [create an account](https://www.intel.com/content/www/us/en/forms/idz/devcloud-registration.html?tgt=https://www.intel.com/content/www/us/en/secure/forms/devcloud-enrollment/account-provisioning.html).

89
docs/benchmarks/performance_benchmarks_openvino.md
View File

@ -1,89 +0,0 @@
# Intel® Distribution of OpenVINO™ toolkit Benchmark Results {#openvino_docs_performance_benchmarks_openvino}
@sphinxdirective
.. toctree::
:maxdepth: 1
:hidden:
openvino_docs_performance_benchmarks_faq
openvino_docs_performance_int8_vs_fp32
Performance Data Spreadsheet (download xlsx) <https://docs.openvino.ai/2022.3/_static/benchmarks_files/OV-2022.3-Performance-Data.xlsx>
Click the "Benchmark Graphs" button to see the OpenVINO™ benchmark graphs. Select the models, the hardware platforms (CPU SKUs),
precision and performance index from the lists and click the “Build Graphs” button.
.. button-link:: #
:class: ov-toolkit-benchmark-results
:color: primary
:outline:
:material-regular:`bar_chart;1.4em` Benchmark Graphs
Measuring inference performance involves many variables and is extremely use-case and application dependent.
Below are four parameters for measurements, which are key elements to consider for a successful deep learning inference application:
.. tab:: :material-regular:`keyboard_double_arrow_right;1.4em` Throughput
Measures the number of inferences delivered within a latency threshold (for example, number of Frames Per Second - FPS). When deploying a system with deep learning inference, select the throughput that delivers the best trade-off between latency and power for the price and performance that meets your requirements.
.. tab:: :material-regular:`attach_money;1.4em` Value
While throughput is important, what is more critical in edge AI deployments is the performance efficiency or performance-per-cost. Application performance in throughput per dollar of system cost is the best measure of value. The value KPI is calculated as “Throughput measured as inferences per second / price of inference engine”. This means for a 2 socket system 2x the price of a CPU is used. Prices are as per date of benchmarking and sources can be found as links in the Hardware Platforms (PDF) description below.
.. tab:: :material-regular:`flash_on;1.4em` Efficiency
System power is a key consideration from the edge to the data center. When selecting deep learning solutions, power efficiency (throughput/watt) is a critical factor to consider. Intel designs provide excellent power efficiency for running deep learning workloads. The efficiency KPI is calculated as “Throughput measured as inferences per second / TDP of inference engine”. This means for a 2 socket system 2x the power dissipation (TDP) of a CPU is used. TDP-values are as per date of benchmarking and sources can be found as links in the Hardware Platforms (PDF) description below.
.. tab:: :material-regular:`hourglass_empty;1.4em` Latency
This measures the synchronous execution of inference requests and is reported in milliseconds. Each inference request (for example: preprocess, infer, postprocess) is allowed to complete before the next is started. This performance metric is relevant in usage scenarios where a single image input needs to be acted upon as soon as possible. An example would be the healthcare sector where medical personnel only request analysis of a single ultra sound scanning image or in real-time or near real-time applications for example an industrial robot's response to actions in its environment or obstacle avoidance for autonomous vehicles.
Platform & Configurations
####################################
For a listing of all platforms and configurations used for testing, refer to the following:
.. button-link:: _static/benchmarks_files/platform_list_22.3.pdf
:color: primary
:outline:
:material-regular:`download;1.5em` Click for Hardware Platforms [PDF]
.. button-link:: _static/benchmarks_files/OV-2022.3-system-info-detailed.xlsx
:color: primary
:outline:
:material-regular:`download;1.5em` Click for Configuration Details [XLSX]
This benchmark setup includes a single machine on which both the benchmark application and the OpenVINO™ installation reside. The presented performance benchmark numbers are based on the release 2022.3 of the Intel® Distribution of OpenVINO™ toolkit.
The benchmark application loads the OpenVINO™ Runtime and executes inferences on the specified hardware (CPU, GPU or GNA).
It measures the time spent on actual inference (excluding any pre or post processing) and then reports on the inferences per second (or Frames Per Second).
Disclaimers
####################################
Intel® Distribution of OpenVINO™ toolkit performance benchmark numbers are based on release 2022.3.
Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer. Performance results are based on testing as of December 13, 2022 and may not reflect all publicly available updates. See configuration disclosure for details. No product can be absolutely secure.
Performance varies by use, configuration and other factors. Learn more at :ref:`www.intel.com/PerformanceIndex<https://www.intel.com/PerformanceIndex>`.
Your costs and results may vary.
Intel optimizations, for Intel compilers or other products, may not optimize to the same degree for non-Intel products.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.
@endsphinxdirective

236
docs/benchmarks/performance_benchmarks_ovms.md
View File

@ -1,236 +0,0 @@
@sphinxdirective
:orphan:
@endsphinxdirective
# OpenVINO™ Model Server Benchmark Results {#openvino_docs_performance_benchmarks_ovms}
OpenVINO™ Model Server is an open-source, production-grade inference platform that exposes a set of models via a convenient inference API over gRPC or HTTP/REST. It employs the OpenVINO™ Runtime libraries from the Intel® Distribution of OpenVINO™ toolkit to extend workloads across Intel® hardware including CPU, GPU and others.
![OpenVINO™ Model Server](../img/performance_benchmarks_ovms_01.png)
## Measurement Methodology
OpenVINO™ Model Server is measured in multiple-client-single-server configuration using two hardware platforms connected by ethernet network. The network bandwidth depends on the platforms as well as models under investigation and it is set to not be a bottleneck for workload intensity. This connection is dedicated only to the performance measurements. The benchmark setup is consists of four main parts:
![OVMS Benchmark Setup Diagram](../img/performance_benchmarks_ovms_02.png)
* **OpenVINO™ Model Server** is launched as a docker container on the server platform and it listens (and answers on) requests from clients. OpenVINO™ Model Server is run on the same machine as the OpenVINO™ toolkit benchmark application in corresponding benchmarking. Models served by OpenVINO™ Model Server are located in a local file system mounted into the docker container. The OpenVINO™ Model Server instance communicates with other components via ports over a dedicated docker network.
* **Clients** are run in separated physical machine referred to as client platform. Clients are implemented in Python3 programming language based on TensorFlow* API and they work as parallel processes. Each client waits for a response from OpenVINO™ Model Server before it will send a new next request. The role played by the clients is also verification of responses.
* **Load balancer** works on the client platform in a docker container. HAProxy is used for this purpose. Its main role is counting of requests forwarded from clients to OpenVINO™ Model Server, estimating its latency, and sharing this information by Prometheus service. The reason of locating the load balancer on the client site is to simulate real life scenario that includes impact of physical network on reported metrics.
* **Execution Controller** is launched on the client platform. It is responsible for synchronization of the whole measurement process, downloading metrics from the load balancer, and presenting the final report of the execution.
## bert-small-uncased-whole-word-masking-squad-002 (INT8)
![](../_static/benchmarks_files/ovms/bert-small-uncased-whole-word-masking-squad-002-int8.png)
## bert-small-uncased-whole-word-masking-squad-002 (FP32)
![](../_static/benchmarks_files/ovms/bert-small-uncased-whole-word-masking-squad-002-fp32.png)
## densenet-121 (INT8)
![](../_static/benchmarks_files/ovms/densenet-121-int8.png)
## densenet-121 (FP32)
![](../_static/benchmarks_files/ovms/densenet-121-fp32.png)
## efficientdet-d0 (INT8)
![](../_static/benchmarks_files/ovms/efficientdet-d0-int8.png)
## efficientdet-d0 (FP32)
![](../_static/benchmarks_files/ovms/efficientdet-d0-fp32.png)
## inception-v4 (INT8)
![](../_static/benchmarks_files/ovms/inception-v4-int8.png)
## inception-v4 (FP32)
![](../_static/benchmarks_files/ovms/inception-v4-fp32.png)
## mobilenet-ssd (INT8)
![](../_static/benchmarks_files/ovms/mobilenet-ssd-int8.png)
## mobilenet-ssd (FP32)
![](../_static/benchmarks_files/ovms/mobilenet-ssd-fp32.png)
## mobilenet-v2 (INT8)
![](../_static/benchmarks_files/ovms/mobilenet-v2-int8.png)
## mobilenet-v2 (FP32)
![](../_static/benchmarks_files/ovms/mobilenet-v2-fp32.png)
## resnet-18 (INT8)
![](../_static/benchmarks_files/ovms/resnet-18-int8.png)
## resnet-18 (FP32)
![](../_static/benchmarks_files/ovms/resnet-18-fp32.png)
## resnet-50 (INT8)
![](../_static/benchmarks_files/ovms/resnet-50-int8.png)
## resnet-50 (FP32)
![](../_static/benchmarks_files/ovms/resnet-50-fp32.png)
## ssd-resnt34-1200 (INT8)
![](../_static/benchmarks_files/ovms/ssd-resnt34-1200-int8.png)
## ssd-resnt34-1200 (FP32)
![](../_static/benchmarks_files/ovms/ssd-resnt34-1200-fp32.png)
## unet-camvid-onnx-001 (INT8)
![](../_static/benchmarks_files/ovms/unet-camvid-onnx-001-int8.png)
## unet-camvid-onnx-001 (FP32)
![](../_static/benchmarks_files/ovms/unet-camvid-onnx-001-fp32.png)
## yolo-v3-tiny (INT8)
![](../_static/benchmarks_files/ovms/yolo-v3-tiny-int8.png)
## yolo-v3-tiny (FP32)
![](../_static/benchmarks_files/ovms/yolo-v3-tiny-fp32.png)
## yolo-v4 (INT8)
![](../_static/benchmarks_files/ovms/yolo-v4-int8.png)
## yolo-v4 (FP32)
![](../_static/benchmarks_files/ovms/yolo-v4-fp32.png)
## Platform Configurations
OpenVINO™ Model Server performance benchmark numbers are based on release 2022.2. Performance results are based on testing as of November 16, 2022 and may not reflect all publicly available updates.
@sphinxdirective
.. dropdown:: Platform with Intel® Xeon® Platinum 8260M
.. table::
:widths: 25 25 50
+--------------------------+-------------------------------------------+----------------------------------------+
| | Server Platform | Client Platform |
+==========================+===========================================+========================================+
| Motherboard | Inspur YZMB-00882-104 NF5280M5 | Inspur YZMB-00882-104 NF5280M5 |
+--------------------------+-------------------------------------------+----------------------------------------+
| Memory | Samsung 16 x 16GB @ 2666 MT/s DDR4 | Kingston 16 x 16GB @ 2666 MT/s DDR4 |
+--------------------------+-------------------------------------------+----------------------------------------+
| CPU | Intel® Xeon® Platinum 8260M CPU @ 2.40GHz | Intel® Xeon® Gold 6238M CPU @ 2.10GHz |
+--------------------------+-------------------------------------------+----------------------------------------+
| Selected CPU Flags | Hyper Threading, Turbo Boost, DL Boost | Hyper Threading, Turbo Boost, DL Boost |
+--------------------------+-------------------------------------------+----------------------------------------+
| CPU Thermal Design Power | 162W | 150W |
+--------------------------+-------------------------------------------+----------------------------------------+
| Operating System | Ubuntu 20.04.4 LTS | Ubuntu 20.04.4 LTS |
+--------------------------+-------------------------------------------+----------------------------------------+
| Kernel Version | 5.4.0-107-generic | 5.4.0-107-generic |
+--------------------------+-------------------------------------------+----------------------------------------+
| BIOS Vendor | American Megatrends Inc. | AMI |
+--------------------------+-------------------------------------------+----------------------------------------+
| BIOS Version & Release | 4.1.16; date: 06/23/2020 | 4.1.16; date: 06/23/2020 |
+--------------------------+-------------------------------------------+----------------------------------------+
| Docker Version | 20.10.3 | 20.10.3 |
+--------------------------+-------------------------------------------+----------------------------------------+
| Network Speed | 40 Gb/s | 40 Gb/s |
+--------------------------+-------------------------------------------+----------------------------------------+
.. dropdown:: Platform with 6238M
.. table::
:widths: 25 25 50
+--------------------------+-------------------------------------------+--------------------------------------------+
| | Server Platform | Client Platform |
+==========================+===========================================+============================================+
| Motherboard | Inspur YZMB-00882-104 NF5280M5 | Inspur YZMB-00882-104 NF5280M5 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Memory | Kingston 16 x 16GB @ 2666 MT/s DDR4 | Samsung 16 x 16GB @ 2666 MT/s DDR4 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU | Intel® Xeon® Gold 6238M CPU @ 2.10GHz | Intel® Xeon® Platinum 8260M CPU @ 2.40GHz |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Selected CPU Flags | Hyper Threading, Turbo Boost, DL Boost | Hyper Threading, Turbo Boost, DL Boost |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU Thermal Design Power | 150W | 162W |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Operating System | Ubuntu 20.04.4 LTS | Ubuntu 20.04.4 LTS |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Kernel Version | 5.4.0-107-generic | 5.4.0-107-generic |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Vendor | AMI | American Megatrends Inc. |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Version & Release | 4.1.16; date: 06/23/2020 | 4.1.16; date: 06/23/2020 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Docker Version | 20.10.3 | 20.10.3 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Network Speed | 40 Gb/s | 40 Gb/s |
+--------------------------+-------------------------------------------+--------------------------------------------+
.. dropdown:: Platform with Intel® Core™ i9-10920X
.. table::
:widths: 25 25 50
+--------------------------+-------------------------------------------+--------------------------------------------+
| | Server Platform | Client Platform |
+==========================+===========================================+============================================+
| Motherboard | ASUSTeK COMPUTER INC. PRIME X299-A II | ASUSTeK COMPUTER INC. PRIME Z370-P |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Memory | Corsair 4 x 16GB @ 2666 MT/s DDR4 | Corsair 4 x 16GB @ 2133 MT/s DDR4 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU | Intel® Core™ i9-10920X CPU @ 3.50GHz | Intel® Core™ i7-8700T CPU @ 2.40GHz |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Selected CPU Flags | Hyper Threading, Turbo Boost, DL Boost | Hyper Threading, Turbo Boost, DL Boost |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU Thermal Design Power | 165W | 35 W |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Operating System | Ubuntu 20.04.4 LTS | Ubuntu 20.04.4 LTS |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Kernel Version | 5.4.0-107-generic | 5.4.0-107-generic |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Vendor | American Megatrends Inc. | American Megatrends Inc. |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Version & Release | 0702; date: 06/10/2020 | 2401; date: 07/15/2019 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Docker Version | 19.03.13 | 19.03.14 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Network Speed | 10 Gb/s | 10 Gb/s |
+--------------------------+-------------------------------------------+--------------------------------------------+
.. dropdown:: Platform with Intel® Core™ i7-8700T
.. table::
:widths: 25 25 50
+--------------------------+-------------------------------------------+--------------------------------------------+
| | Server Platform | Client Platform |
+==========================+===========================================+============================================+
| Motherboard | ASUSTeK COMPUTER INC. PRIME Z370-P | ASUSTeK COMPUTER INC. PRIME X299-A II |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Memory | Corsair 4 x 16GB @ 2133 MT/s DDR4 | Corsair 4 x 16GB @ 2666 MT/s DDR4 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU | Intel® Core™ i7-8700T CPU @ 2.40GHz | Intel® Core™ i9-10920X CPU @ 3.50GHz |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Selected CPU Flags | Hyper Threading, Turbo Boost | Hyper Threading, Turbo Boost |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU Thermal Design Power | 35W | 165 W |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Operating System | Ubuntu 20.04.4 LTS | Ubuntu 20.04.4 LTS |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Kernel Version | 5.4.0-107-generic | 5.4.0-107-generic |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Vendor | American Megatrends Inc. | American Megatrends Inc. |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Version & Release | 2401; date: 07/15/2019 | 0702; date: 06/10/2020 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Docker Version | 19.03.14 | 19.03.13 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Network Speed | 10 Gb/s | 10 Gb/s |
+--------------------------+-------------------------------------------+--------------------------------------------+
.. dropdown:: Platform with Intel® Core™ i5-8500
.. table::
:widths: 25 25 50
+--------------------------+-------------------------------------------+--------------------------------------------+
| | Server Platform | Client Platform |
+==========================+===========================================+============================================+
| Motherboard | ASUSTeK COMPUTER INC. PRIME Z370-A | Gigabyte Technology Co., Ltd. Z390 UD |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Memory | Corsair 2 x 16GB @ 2133 MT/s DDR4 | 029E 4 x 8GB @ 2400 MT/s DDR4 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU | Intel® Core™ i5-8500 CPU @ 3.00GHz | Intel® Core™ i3-8100 CPU @ 3.60GHz |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Selected CPU Flags | Turbo Boost | |
+--------------------------+-------------------------------------------+--------------------------------------------+
| CPU Thermal Design Power | 65W | 65 W |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Operating System | Ubuntu 20.04.4 LTS | Ubuntu 20.04.1 LTS |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Kernel Version | 5.4.0-113-generic | 5.4.0-52-generic |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Vendor | American Megatrends Inc. | American Megatrends Inc. |
+--------------------------+-------------------------------------------+--------------------------------------------+
| BIOS Version & Release | 3004; date: 07/12/2021 | F10j; date: 09/16/2020 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Docker Version | 19.03.13 | 20.10.0 |
+--------------------------+-------------------------------------------+--------------------------------------------+
| Network Speed | 40 Gb/s | 40 Gb/s |
+--------------------------+-------------------------------------------+--------------------------------------------+
@endsphinxdirective

3
docs/img/performance_benchmarks_ovms_01.png
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d86125db1e295334c04e92d0645c773f679d21bf52e25dce7c887fdf972b7a28
size 19154

3
docs/install_guides/installing-openvino-from-archive-linux.md
View File

@ -122,13 +122,14 @@ See the [Release Notes](https://www.intel.com/content/www/us/en/developer/articl
.. code-block:: sh
cd /opt/intel/openvino_2022.3.0/
cd /opt/intel/openvino_2022.3.0
sudo -E ./install_dependencies/install_openvino_dependencies.sh
6. For simplicity, it is useful to create a symbolic link as below:
.. code-block:: sh
cd /opt/intel
sudo ln -s openvino_2022.3.0 openvino_2022
.. note::

2
tools/pot/README.md
View File

@ -55,5 +55,5 @@ OpenVINO provides several examples to demonstrate the POT optimization workflow:
## See Also
* [Performance Benchmarks](https://docs.openvino.ai/latest/openvino_docs_performance_benchmarks_openvino.html)
* [Performance Benchmarks](https://docs.openvino.ai/latest/openvino_docs_performance_benchmarks.html)
* [INT8 Quantization by Using Web-Based Interface of the DL Workbench](https://docs.openvino.ai/latest/workbench_docs_Workbench_DG_Int_8_Quantization.html)

2
tools/pot/docs/Introduction.md
View File

@ -56,4 +56,4 @@ Have more questions about post-training quantization or encountering errors usin
* [Post-training Quantization Examples](@ref pot_examples_description)
* [Quantization Best Practices](@ref pot_docs_BestPractices)
* [Post-training Optimization Tool FAQ](@ref pot_docs_FrequentlyAskedQuestions)
* [Performance Benchmarks](@ref openvino_docs_performance_benchmarks_openvino)
* [Performance Benchmarks](@ref openvino_docs_performance_benchmarks)