openvino/docs/_static/benchmarks_files/OV-benchmark-data.csv

56 KiB

1Network modelReleaseIE-TypePlatform nameThroughput-INT8Throughput-FP16Throughput-FP32ValueEfficiencyPriceTDPSocketsPrice/SocketTDP/SocketLatencyUOM_TUOM_VUOM_EUOM_LLatency_FP16Latency_FP32Latency_int4Throughput_INT4
2begin_rec FPSFPS/$FPS/TDPmsec.
3bert-base-casedOV-2023.2coreIntel® Core™ i3-8100 21.270.1820.3271176511176548.62FPSFPS/$FPS/TDPmsec.
4bert-base-casedOV-2023.2coreIntel® Core™ i5-10500TE 32.0421.720.1500.4932146512146536.77FPSFPS/$FPS/TDPmsec.
5bert-base-casedOV-2023.2coreIntel® Core™ i5-13600K 112.7845.210.3430.902329125132912517.53FPSFPS/$FPS/TDPmsec.
6bert-base-casedOV-2023.2coreIntel® Core™ i7-1185G7 CPU50.1118.360.1181.7904262814262823.39FPSFPS/$FPS/TDPmsec.
7bert-base-casedOV-2023.2coreIntel® Core™ i7-1185GRE CPU38.1713.670.0781.3634902814902829.4FPSFPS/$FPS/TDPmsec.
8bert-base-casedOV-2023.2coreIntel® Core™ i7-12700H CPU88.6235.370.1770.771502115150211517.1FPSFPS/$FPS/TDPmsec.
9bert-base-casedOV-2023.2coreIntel® Core™ i7-8700T 27.4718.340.0910.7853033513033543.1FPSFPS/$FPS/TDPmsec.
10bert-base-casedOV-2023.2coreIntel® Core™ i9-10900TE 33.5821.380.0690.9604883514883537.7FPSFPS/$FPS/TDPmsec.
11bert-base-casedOV-2023.2coreIntel® Core™ i9-12900TE 52.7420.430.0971.5075443515443523.05FPSFPS/$FPS/TDPmsec.
12bert-base-casedOV-2023.2coreIntel® Core™ i9-13900K 164.8666.260.2751.319599125159912513.76FPSFPS/$FPS/TDPmsec.
13bert-base-casedOV-2023.2xeonIntel® Xeon® W1290P 50.9433.270.0860.407594125159412529.19FPSFPS/$FPS/TDPmsec.
14bert-base-casedOV-2023.2xeonIntel® Xeon® E-2124G 20.730.0830.2922497112497149.54FPSFPS/$FPS/TDPmsec.
15bert-base-casedOV-2023.2xeonIntel® Xeon® Gold 5218T 215.8680.310.0691.02831442102157210514.03FPSFPS/$FPS/TDPmsec.
16bert-base-casedOV-2023.2xeonIntel® Xeon® Platinum 8270 569.64222.970.0341.38916954410284772057.97FPSFPS/$FPS/TDPmsec.
17bert-base-casedOV-2023.2xeonIntel® Xeon® Platinum 8380 876.04336.630.0471.6221871854029359270FPSFPS/$FPS/TDPmsec.
18bert-base-casedOV-2023.2xeonIntel® Xeon® Platinum 8490H 3131.74505.870.0924.474340007002170003504.14FPSFPS/$FPS/TDPmsec.
19bert-base-casedOV-2023.2xeonIntel® Xeon® Silver 4216R 205.6176.340.1021.02820222002101110014.66FPSFPS/$FPS/TDPmsec.
20bert-base-casedOV-2023.2xeonIntel® Xeon® Silver 4316 423.53166.330.1861.412227430021137150FPSFPS/$FPS/TDPmsec.
21bert-base-casedOV-2023.2accelIntel® Data Center GPU Flex 170 824.04680.350.4285.49419251501192515019.37FPSFPS/$FPS/TDPmsec.
22bert-base-casedOV-2023.2accelIntel® Arc®A-Series Graphics 620.32554.081.9324.135321150132115025.63FPSFPS/$FPS/TDPmsec.
23bert-base-casedOV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU83.6660.242.140.1962.9884262814262847.28FPSFPS/$FPS/TDPmsec.
24bert-base-casedOV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU72.4355.3936.920.1482.5874902814902855.03FPSFPS/$FPS/TDPmsec.
25bert-base-casedOV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU91.5264.8346.370.1820.796502115150211543.39FPSFPS/$FPS/TDPmsec.
26bert-base-casedOV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU94.4939.790.2223.37542628142628FPSFPS/$FPS/TDPmsec.
27bert-base-casedOV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU88.7935.190.1770.7725021151502115FPSFPS/$FPS/TDPmsec.
28end_rec
29begin_rec FPSFPS/$FPS/TDPmsec.
30bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i3-8100 2.090.0180.03211765111765493.93FPSFPS/$FPS/TDPmsec.
31bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i5-10500TE 2.981.860.0140.04621465121465351.2FPSFPS/$FPS/TDPmsec.
32bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i5-13600K 10.073.750.0310.0813291251329125156.29FPSFPS/$FPS/TDPmsec.
33bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i7-1185G7 CPU5.071.630.0120.18142628142628219.53FPSFPS/$FPS/TDPmsec.
34bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i7-1185GRE CPU3.781.210.0080.13549028149028267.11FPSFPS/$FPS/TDPmsec.
35bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i7-12700H CPU8.313.080.0170.0725021151502115155.69FPSFPS/$FPS/TDPmsec.
36bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i7-8700T 2.71.610.0090.07730335130335411.88FPSFPS/$FPS/TDPmsec.
37bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i9-10900TE 3.281.990.0070.09448835148835331.95FPSFPS/$FPS/TDPmsec.
38bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i9-12900TE 5.121.830.0090.14654435154435210.03FPSFPS/$FPS/TDPmsec.
39bert-large-uncased-whole-word-masking-squad-0001OV-2023.2coreIntel® Core™ i9-13900K 15.375.950.0260.1235991251599125113.51FPSFPS/$FPS/TDPmsec.
40bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® W1290P 4.653.110.0080.0375941251594125228.25FPSFPS/$FPS/TDPmsec.
41bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® E-2124G 2.110.0080.03024971124971484.55FPSFPS/$FPS/TDPmsec.
42bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Gold 5218T 20.816.910.0070.099314421021572105106.59FPSFPS/$FPS/TDPmsec.
43bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Platinum 8270 50.6317.750.0030.123169544102847720554.45FPSFPS/$FPS/TDPmsec.
44bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Platinum 8380 66.7627.440.0040.1241871854029359270231.49FPSFPS/$FPS/TDPmsec.
45bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Platinum 8490H 250.4745.770.0070.3583400070021700035027.75FPSFPS/$FPS/TDPmsec.
46bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Silver 4216R 20.736.570.0100.104202220021011100106.9FPSFPS/$FPS/TDPmsec.
47bert-large-uncased-whole-word-masking-squad-0001OV-2023.2xeonIntel® Xeon® Silver 4316 38.8514.530.0170.129227430021137150156.69FPSFPS/$FPS/TDPmsec.
48bert-large-uncased-whole-word-masking-squad-0001OV-2023.2accelIntel® Data Center GPU Flex 170 148.54102.980.0770.990192515011925150107.19FPSFPS/$FPS/TDPmsec.
49bert-large-uncased-whole-word-masking-squad-0001OV-2023.2accelIntel® Arc®A-Series Graphics 127.9994.720.3990.8533211501321150124.58FPSFPS/$FPS/TDPmsec.
50bert-large-uncased-whole-word-masking-squad-0001OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU9.076.624.270.0210.32442628142628452.44FPSFPS/$FPS/TDPmsec.
51bert-large-uncased-whole-word-masking-squad-0001OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU5.395.773.010.0110.19249028149028741.24FPSFPS/$FPS/TDPmsec.
52bert-large-uncased-whole-word-masking-squad-0001OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU10.547.5750.0210.0925021151502115379.08FPSFPS/$FPS/TDPmsec.
53bert-large-uncased-whole-word-masking-squad-0001OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU8.493.460.0200.30342628142628FPSFPS/$FPS/TDPmsec.
54bert-large-uncased-whole-word-masking-squad-0001OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU8.533.010.0170.0745021151502115FPSFPS/$FPS/TDPmsec.
55end_rec
56begin_rec FPSFPS/$FPS/TDPmsec.
57deeplabv3OV-2023.2atomIntel® Atom® X6425E CPU4.662.870.0700.388671216712219.16FPSFPS/$FPS/TDPmsec.
58deeplabv3OV-2023.2coreIntel® Core™ i3-8100 2214.030.1880.3391176511176545.56FPSFPS/$FPS/TDPmsec.
59deeplabv3OV-2023.2coreIntel® Core™ i5-10500TE 35.1516.610.1640.5412146512146533.27FPSFPS/$FPS/TDPmsec.
60deeplabv3OV-2023.2coreIntel® Core™ i5-13600K 101.5741.760.3090.813329125132912516.21FPSFPS/$FPS/TDPmsec.
61deeplabv3OV-2023.2coreIntel® Core™ i7-1185G7 CPU52.3616.310.1231.8704262814262819.93FPSFPS/$FPS/TDPmsec.
62deeplabv3OV-2023.2coreIntel® Core™ i7-1185GRE CPU31.699.450.0651.1324902814902829.7FPSFPS/$FPS/TDPmsec.
63deeplabv3OV-2023.2coreIntel® Core™ i7-12700H CPU74.829.130.1490.650502115150211516.96FPSFPS/$FPS/TDPmsec.
64deeplabv3OV-2023.2coreIntel® Core™ i7-8700T 32.2218.380.1060.9213033513033537.52FPSFPS/$FPS/TDPmsec.
65deeplabv3OV-2023.2coreIntel® Core™ i9-10900TE 39.418.250.0811.1264883514883528.44FPSFPS/$FPS/TDPmsec.
66deeplabv3OV-2023.2coreIntel® Core™ i9-12900TE 58.1122.540.1071.6605443515443521.65FPSFPS/$FPS/TDPmsec.
67deeplabv3OV-2023.2coreIntel® Core™ i9-13900K 149.5957.890.2501.197599125159912512.49FPSFPS/$FPS/TDPmsec.
68deeplabv3OV-2023.2atomIntel® Processor N200 CPU1.721.010.0090.287193611936596.5FPSFPS/$FPS/TDPmsec.
69deeplabv3OV-2023.2xeonIntel® Xeon® W1290P 51.1219.380.0860.409594125159412521.94FPSFPS/$FPS/TDPmsec.
70deeplabv3OV-2023.2xeonIntel® Xeon® E-2124G 21.7714.750.0870.3072497112497145.69FPSFPS/$FPS/TDPmsec.
71deeplabv3OV-2023.2xeonIntel® Xeon® Gold 5218T 188.6676.860.0600.89831442102157210511.81FPSFPS/$FPS/TDPmsec.
72deeplabv3OV-2023.2xeonIntel® Xeon® Platinum 8270 413.18154.250.0241.00816954410284772055.65FPSFPS/$FPS/TDPmsec.
73deeplabv3OV-2023.2xeonIntel® Xeon® Platinum 8380 564.23223.460.0301.04518718540293592705.36FPSFPS/$FPS/TDPmsec.
74deeplabv3OV-2023.2xeonIntel® Xeon® Platinum 8490H 1001.4380.460.0291.431340007002170003503.6FPSFPS/$FPS/TDPmsec.
75deeplabv3OV-2023.2xeonIntel® Xeon® Silver 4216R 182.5774.430.0900.91320222002101110012.14FPSFPS/$FPS/TDPmsec.
76deeplabv3OV-2023.2xeonIntel® Xeon® Silver 4316 360.93138.140.1591.2032274300211371507.04FPSFPS/$FPS/TDPmsec.
77deeplabv3OV-2023.2accelIntel® Data Center GPU Flex 170 732.85602.340.3814.88619251501192515021.8FPSFPS/$FPS/TDPmsec.
78deeplabv3OV-2023.2accelIntel® Arc®A-Series Graphics 597.79484.981.8623.985321150132115026.18FPSFPS/$FPS/TDPmsec.
79deeplabv3OV-2023.2atomIntel® Celeron® 6305E CPU11.644.560.1090.7761071511071587.1FPSFPS/$FPS/TDPmsec.
80deeplabv3OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU10.8711.075.640.1620.906671216712367.4FPSFPS/$FPS/TDPmsec.
81deeplabv3OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU104.7148.9527.690.2463.7394262814262837.85FPSFPS/$FPS/TDPmsec.
82deeplabv3OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU76.3436.2213.670.1562.7264902814902852.07FPSFPS/$FPS/TDPmsec.
83deeplabv3OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU113.6552.7233.360.2260.988502115150211534.81FPSFPS/$FPS/TDPmsec.
84deeplabv3OV-2023.2atom-iGPUIntel® Processor N200 iGPU3.651.921.270.0190.6091936119361094.07FPSFPS/$FPS/TDPmsec.
85deeplabv3OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU60.327.7316.440.5644.0201071511071566.22FPSFPS/$FPS/TDPmsec.
86deeplabv3OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU11.115.660.1660.926671216712FPSFPS/$FPS/TDPmsec.
87deeplabv3OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU86.7824.130.2043.09942628142628FPSFPS/$FPS/TDPmsec.
88deeplabv3OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU75.7128.980.1510.6585021151502115FPSFPS/$FPS/TDPmsec.
89deeplabv3OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU4.661.90.0240.776193611936FPSFPS/$FPS/TDPmsec.
90deeplabv3OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU61.1516.890.5714.07710715110715FPSFPS/$FPS/TDPmsec.
91end_rec
92begin_rec FPSFPS/$FPS/TDPmsec.
93efficientdet-d0OV-2023.2atomIntel® Atom® X6425E CPU7.295.010.1090.608671216712140.41FPSFPS/$FPS/TDPmsec.
94efficientdet-d0OV-2023.2coreIntel® Core™ i3-8100 36.624.310.3130.5631176511176528.3FPSFPS/$FPS/TDPmsec.
95efficientdet-d0OV-2023.2coreIntel® Core™ i5-10500TE 58.8429.380.2750.9052146512146521.11FPSFPS/$FPS/TDPmsec.
96efficientdet-d0OV-2023.2coreIntel® Core™ i5-13600K 139.3277.220.4231.115329125132912511.92FPSFPS/$FPS/TDPmsec.
97efficientdet-d0OV-2023.2coreIntel® Core™ i7-1185G7 CPU73.7641.070.1732.6344262814262815.53FPSFPS/$FPS/TDPmsec.
98efficientdet-d0OV-2023.2coreIntel® Core™ i7-1185GRE CPU52.5721.480.1071.8774902814902820.87FPSFPS/$FPS/TDPmsec.
99efficientdet-d0OV-2023.2coreIntel® Core™ i7-12700H CPU114.4654.770.2280.995502115150211511.88FPSFPS/$FPS/TDPmsec.
100efficientdet-d0OV-2023.2coreIntel® Core™ i7-8700T 51.9334.220.1711.4843033513033524.28FPSFPS/$FPS/TDPmsec.
101efficientdet-d0OV-2023.2coreIntel® Core™ i9-10900TE 6635.110.1351.8864883514883518.95FPSFPS/$FPS/TDPmsec.
102efficientdet-d0OV-2023.2coreIntel® Core™ i9-12900TE 75.3744.410.1392.1545443515443515.52FPSFPS/$FPS/TDPmsec.
103efficientdet-d0OV-2023.2coreIntel® Core™ i9-13900K 207102.360.3461.65659912515991259.45FPSFPS/$FPS/TDPmsec.
104efficientdet-d0OV-2023.2atomIntel® Processor N200 CPU2.091.670.0110.349193611936488.71FPSFPS/$FPS/TDPmsec.
105efficientdet-d0OV-2023.2xeonIntel® Xeon® W1290P 96.5638.610.1630.772594125159412514.19FPSFPS/$FPS/TDPmsec.
106efficientdet-d0OV-2023.2xeonIntel® Xeon® E-2124G 35.0125.270.1410.4932497112497129.41FPSFPS/$FPS/TDPmsec.
107efficientdet-d0OV-2023.2xeonIntel® Xeon® Gold 5218T 258.46164.630.0821.23131442102157210511.88FPSFPS/$FPS/TDPmsec.
108efficientdet-d0OV-2023.2xeonIntel® Xeon® Platinum 8270 518.85310.760.0311.26516954410284772057.42FPSFPS/$FPS/TDPmsec.
109efficientdet-d0OV-2023.2xeonIntel® Xeon® Platinum 8380 834.12495.890.0451.54518718540293592704.31FPSFPS/$FPS/TDPmsec.
110efficientdet-d0OV-2023.2xeonIntel® Xeon® Platinum 8490H 1043.83861.50.0311.491340007002170003505.43FPSFPS/$FPS/TDPmsec.
111efficientdet-d0OV-2023.2xeonIntel® Xeon® Silver 4216R 248.64157.520.1231.24320222002101110012.27FPSFPS/$FPS/TDPmsec.
112efficientdet-d0OV-2023.2xeonIntel® Xeon® Silver 4316 469.81293.670.2071.5662274300211371505.89FPSFPS/$FPS/TDPmsec.
113efficientdet-d0OV-2023.2accelIntel® Data Center GPU Flex 170 846.71825.710.4405.64519251501192515018.66FPSFPS/$FPS/TDPmsec.
114efficientdet-d0OV-2023.2accelIntel® Arc®A-Series Graphics 582.03590.731.8133.880321150132115026.38FPSFPS/$FPS/TDPmsec.
115efficientdet-d0OV-2023.2atomIntel® Celeron® 6305E CPU18.0611.090.1691.2041071511071557.26FPSFPS/$FPS/TDPmsec.
116efficientdet-d0OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU19.7122.4811.180.2941.643671216712202.28FPSFPS/$FPS/TDPmsec.
117efficientdet-d0OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU110.4290.5846.890.2593.9444262814262835.95FPSFPS/$FPS/TDPmsec.
118efficientdet-d0OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU62.8949.9123.650.1282.2464902814902863.05FPSFPS/$FPS/TDPmsec.
119efficientdet-d0OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU127.71103.7854.390.2541.110502115150211530.98FPSFPS/$FPS/TDPmsec.
120efficientdet-d0OV-2023.2atom-iGPUIntel® Processor N200 iGPU5.534.942.750.0290.921193611936721.64FPSFPS/$FPS/TDPmsec.
121efficientdet-d0OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU72.1460.6133.850.6744.8091071511071555.18FPSFPS/$FPS/TDPmsec.
122efficientdet-d0OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU20.1111.510.3001.676671216712FPSFPS/$FPS/TDPmsec.
123efficientdet-d0OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU101.0348.050.2373.60842628142628FPSFPS/$FPS/TDPmsec.
124efficientdet-d0OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU114.8355.310.2290.9995021151502115FPSFPS/$FPS/TDPmsec.
125efficientdet-d0OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU5.733.570.0300.955193611936FPSFPS/$FPS/TDPmsec.
126efficientdet-d0OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU56.1932.140.5253.74610715110715FPSFPS/$FPS/TDPmsec.
127end_rec
128begin_rec FPSFPS/$FPS/TDPmsec.
129mobilenet-v2OV-2023.2atomIntel® Atom® X6425E CPU132.0179.711.97011.0016712167127.97FPSFPS/$FPS/TDPmsec.
130mobilenet-v2OV-2023.2coreIntel® Core™ i3-8100 536.374.5848.252117651117652.02FPSFPS/$FPS/TDPmsec.
131mobilenet-v2OV-2023.2coreIntel® Core™ i5-10500TE 898.55500.274.19913.824214651214651.57FPSFPS/$FPS/TDPmsec.
132mobilenet-v2OV-2023.2coreIntel® Core™ i5-13600K 2785.111237.028.46522.28132912513291250.88FPSFPS/$FPS/TDPmsec.
133mobilenet-v2OV-2023.2coreIntel® Core™ i7-1185G7 CPU1347.18525.713.16248.113426281426280.86FPSFPS/$FPS/TDPmsec.
134mobilenet-v2OV-2023.2coreIntel® Core™ i7-1185GRE CPU979.433191.99934.980490281490281.19FPSFPS/$FPS/TDPmsec.
135mobilenet-v2OV-2023.2coreIntel® Core™ i7-12700H CPU2099.291056.244.18218.25550211515021151.1FPSFPS/$FPS/TDPmsec.
136mobilenet-v2OV-2023.2coreIntel® Core™ i7-8700T 741.65519.772.44821.190303351303351.86FPSFPS/$FPS/TDPmsec.
137mobilenet-v2OV-2023.2coreIntel® Core™ i9-10900TE 949.26604.021.94527.122488351488351.5FPSFPS/$FPS/TDPmsec.
138mobilenet-v2OV-2023.2coreIntel® Core™ i9-12900TE 1300.22657.072.39037.149544351544351.32FPSFPS/$FPS/TDPmsec.
139mobilenet-v2OV-2023.2coreIntel® Core™ i9-13900K 4089.62014.336.82732.71759912515991250.71FPSFPS/$FPS/TDPmsec.
140mobilenet-v2OV-2023.2atomIntel® Processor N200 CPU41.129.710.2136.85119361193627.14FPSFPS/$FPS/TDPmsec.
141mobilenet-v2OV-2023.2xeonIntel® Xeon® W1290P 1450.73542.772.44211.60659412515941251.29FPSFPS/$FPS/TDPmsec.
142mobilenet-v2OV-2023.2xeonIntel® Xeon® E-2124G 523.032.1017.367249711249712.07FPSFPS/$FPS/TDPmsec.
143mobilenet-v2OV-2023.2xeonIntel® Xeon® Gold 5218T 5410.811915.841.72125.7663144210215721051.42FPSFPS/$FPS/TDPmsec.
144mobilenet-v2OV-2023.2xeonIntel® Xeon® Platinum 8270 14207.134438.670.83834.65216954410284772050.93FPSFPS/$FPS/TDPmsec.
145mobilenet-v2OV-2023.2xeonIntel® Xeon® Platinum 8380 22308.516801.731.19241.31218718540293592700.57FPSFPS/$FPS/TDPmsec.
146mobilenet-v2OV-2023.2xeonIntel® Xeon® Platinum 8490H 38064.3810986.011.12054.378340007002170003500.66FPSFPS/$FPS/TDPmsec.
147mobilenet-v2OV-2023.2xeonIntel® Xeon® Silver 4216R 5178.331862.472.56125.8922022200210111001.45FPSFPS/$FPS/TDPmsec.
148mobilenet-v2OV-2023.2xeonIntel® Xeon® Silver 4316 12161.333597.475.34840.5382274300211371500.56FPSFPS/$FPS/TDPmsec.
149mobilenet-v2OV-2023.2accelIntel® Data Center GPU Flex 170 6748.165698.623.50644.9881925150119251502.37FPSFPS/$FPS/TDPmsec.
150mobilenet-v2OV-2023.2accelIntel® Arc®A-Series Graphics 4308.653849.9513.42328.72432115013211503.63FPSFPS/$FPS/TDPmsec.
151mobilenet-v2OV-2023.2atomIntel® Celeron® 6305E CPU265.71132.812.48317.714107151107153.66FPSFPS/$FPS/TDPmsec.
152mobilenet-v2OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU191.22225.68130.692.85415.93567121671220.63FPSFPS/$FPS/TDPmsec.
153mobilenet-v2OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU1014.86749.24525.162.38236.245426281426283.77FPSFPS/$FPS/TDPmsec.
154mobilenet-v2OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU880.63557.89349.941.79731.451490281490284.25FPSFPS/$FPS/TDPmsec.
155mobilenet-v2OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU1319.62916.27563.832.62911.47550211515021152.83FPSFPS/$FPS/TDPmsec.
156mobilenet-v2OV-2023.2atom-iGPUIntel® Processor N200 iGPU58.6840.5226.290.3049.78119361193667.34FPSFPS/$FPS/TDPmsec.
157mobilenet-v2OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU685.09513.1339.26.40345.672107151107155.56FPSFPS/$FPS/TDPmsec.
158mobilenet-v2OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU107.78137.91.6098.981671216712FPSFPS/$FPS/TDPmsec.
159mobilenet-v2OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU2182.22612.955.12377.93742628142628FPSFPS/$FPS/TDPmsec.
160mobilenet-v2OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU2071.131048.224.12618.0105021151502115FPSFPS/$FPS/TDPmsec.
161mobilenet-v2OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU115.3550.030.59819.224193611936FPSFPS/$FPS/TDPmsec.
162mobilenet-v2OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU1465.46396.5613.69697.69810715110715FPSFPS/$FPS/TDPmsec.
163end_rec
164begin_rec FPSFPS/$FPS/TDPmsec.
165resnet-50OV-2023.2atomIntel® Atom® X6425E CPU19.928.180.2971.66067121671251.27FPSFPS/$FPS/TDPmsec.
166resnet-50OV-2023.2coreIntel® Core™ i3-8100 96.9150.720.8281.4911176511176510.72FPSFPS/$FPS/TDPmsec.
167resnet-50OV-2023.2coreIntel® Core™ i5-10500TE 145.0774.010.6782.232214651214658.19FPSFPS/$FPS/TDPmsec.
168resnet-50OV-2023.2coreIntel® Core™ i5-13600K 515.17140.111.5664.12132912513291253.89FPSFPS/$FPS/TDPmsec.
169resnet-50OV-2023.2coreIntel® Core™ i7-1185G7 CPU229.3461.850.5388.191426281426285.03FPSFPS/$FPS/TDPmsec.
170resnet-50OV-2023.2coreIntel® Core™ i7-1185GRE CPU172.4445.060.3526.159490281490286.62FPSFPS/$FPS/TDPmsec.
171resnet-50OV-2023.2coreIntel® Core™ i7-12700H CPU445.18122.920.8873.87150211515021153.93FPSFPS/$FPS/TDPmsec.
172resnet-50OV-2023.2coreIntel® Core™ i7-8700T 122.8962.10.4063.511303351303359.97FPSFPS/$FPS/TDPmsec.
173resnet-50OV-2023.2coreIntel® Core™ i9-10900TE 156.5975.570.3214.474488351488357.6FPSFPS/$FPS/TDPmsec.
174resnet-50OV-2023.2coreIntel® Core™ i9-12900TE 269.472.670.4957.697544351544354.89FPSFPS/$FPS/TDPmsec.
175resnet-50OV-2023.2coreIntel® Core™ i9-13900K 749.69228.221.2525.99859912515991252.98FPSFPS/$FPS/TDPmsec.
176resnet-50OV-2023.2atomIntel® Processor N200 CPU6.723.130.0351.120193611936159.9FPSFPS/$FPS/TDPmsec.
177resnet-50OV-2023.2xeonIntel® Xeon® W1290P 240.8596.840.4051.92759412515941255.5FPSFPS/$FPS/TDPmsec.
178resnet-50OV-2023.2xeonIntel® Xeon® E-2124G 92.9249.940.3731.3092497112497111.12FPSFPS/$FPS/TDPmsec.
179resnet-50OV-2023.2xeonIntel® Xeon® Gold 5218T 968.92267.960.3084.6143144210215721052.91FPSFPS/$FPS/TDPmsec.
180resnet-50OV-2023.2xeonIntel® Xeon® Platinum 8270 2902.26747.220.1717.07916954410284772051.55FPSFPS/$FPS/TDPmsec.
181resnet-50OV-2023.2xeonIntel® Xeon® Platinum 8380 4946.111154.110.2649.1591871854029359270FPSFPS/$FPS/TDPmsec.
182resnet-50OV-2023.2xeonIntel® Xeon® Platinum 8490H 19987.311672.830.58828.553340007002170003501.02FPSFPS/$FPS/TDPmsec.
183resnet-50OV-2023.2xeonIntel® Xeon® Silver 4216R 931.662570.4614.6582022200210111003FPSFPS/$FPS/TDPmsec.
184resnet-50OV-2023.2xeonIntel® Xeon® Silver 4316 2276.19562.551.0017.587227430021137150FPSFPS/$FPS/TDPmsec.
185resnet-50OV-2023.2accelIntel® Data Center GPU Flex 170 3436.032103.961.78522.9071925150119251504.65FPSFPS/$FPS/TDPmsec.
186resnet-50OV-2023.2accelIntel® Arc®A-Series Graphics 2320.831555.267.23015.47232115013211506.8FPSFPS/$FPS/TDPmsec.
187resnet-50OV-2023.2atomIntel® Celeron® 6305E CPU49.5914.360.4633.3061071511071519.89FPSFPS/$FPS/TDPmsec.
188resnet-50OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU49.3652.3527.440.7374.11367121671280.69FPSFPS/$FPS/TDPmsec.
189resnet-50OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU351.53206.09116.490.82512.5554262814262811.12FPSFPS/$FPS/TDPmsec.
190resnet-50OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU291.8170.6995.050.59610.4214902814902813.6FPSFPS/$FPS/TDPmsec.
191resnet-50OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU389.36224.15136.980.7763.386502115150211510.01FPSFPS/$FPS/TDPmsec.
192resnet-50OV-2023.2atom-iGPUIntel® Processor N200 iGPU14.667.824.240.0762.444193611936271.96FPSFPS/$FPS/TDPmsec.
193resnet-50OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU213.06118.2867.331.99114.2041071511071518.66FPSFPS/$FPS/TDPmsec.
194resnet-50OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU73.7832.261.1016.148671216712FPSFPS/$FPS/TDPmsec.
195resnet-50OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU467.05119.191.09616.68042628142628FPSFPS/$FPS/TDPmsec.
196resnet-50OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU446.64123.080.8903.8845021151502115FPSFPS/$FPS/TDPmsec.
197resnet-50OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU20.626.290.1073.437193611936FPSFPS/$FPS/TDPmsec.
198resnet-50OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU299.375.52.79719.95310715110715FPSFPS/$FPS/TDPmsec.
199end_rec
200begin_rec FPSFPS/$FPS/TDPmsec.
201ssd-resnet34-1200OV-2023.2atomIntel® Atom® X6425E CPU0.330.130.0050.0286712167122993.01FPSFPS/$FPS/TDPmsec.
202ssd-resnet34-1200OV-2023.2coreIntel® Core™ i3-8100 1.680.970.0140.02611765111765601.85FPSFPS/$FPS/TDPmsec.
203ssd-resnet34-1200OV-2023.2coreIntel® Core™ i5-10500TE 2.421.40.0110.03721465121465459.92FPSFPS/$FPS/TDPmsec.
204ssd-resnet34-1200OV-2023.2coreIntel® Core™ i5-13600K 8.242.40.0250.0663291251329125163.48FPSFPS/$FPS/TDPmsec.
205ssd-resnet34-1200OV-2023.2coreIntel® Core™ i7-1185G7 CPU3.9110.0090.14042628142628277.92FPSFPS/$FPS/TDPmsec.
206ssd-resnet34-1200OV-2023.2coreIntel® Core™ i7-1185GRE CPU2.880.770.0060.10349028149028338.91FPSFPS/$FPS/TDPmsec.
207ssd-resnet34-1200OV-2023.2coreIntel® Core™ i7-12700H CPU7.232.110.0140.0635021151502115160.16FPSFPS/$FPS/TDPmsec.
208ssd-resnet34-1200OV-2023.2coreIntel® Core™ i7-8700T 2.021.130.0070.05830335130335564.49FPSFPS/$FPS/TDPmsec.
209ssd-resnet34-1200OV-2023.2coreIntel® Core™ i9-10900TE 2.651.470.0050.07648835148835411.44FPSFPS/$FPS/TDPmsec.
210ssd-resnet34-1200OV-2023.2coreIntel® Core™ i9-12900TE 4.431.320.0080.12654435154435233.69FPSFPS/$FPS/TDPmsec.
211ssd-resnet34-1200OV-2023.2coreIntel® Core™ i9-13900K 12.564.020.0210.1005991251599125125.42FPSFPS/$FPS/TDPmsec.
212ssd-resnet34-1200OV-2023.2atomIntel® Processor N200 CPU0.110.050.0010.0191936119368949.48FPSFPS/$FPS/TDPmsec.
213ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® W1290P 4.332.450.0070.0355941251594125238.2FPSFPS/$FPS/TDPmsec.
214ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® E-2124G 1.60.920.0060.02324971124971628.09FPSFPS/$FPS/TDPmsec.
215ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Gold 5218T 17.644.570.0060.084314421021572105115.69FPSFPS/$FPS/TDPmsec.
216ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Platinum 8270 57.7814.80.0030.141169544102847720536.97FPSFPS/$FPS/TDPmsec.
217ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Platinum 8380 78.7920.720.0040.1461871854029359270108.29FPSFPS/$FPS/TDPmsec.
218ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Platinum 8490H 447.5831.290.0130.639340007002170003508.52FPSFPS/$FPS/TDPmsec.
219ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Silver 4216R 16.784.350.0080.084202220021011100121.64FPSFPS/$FPS/TDPmsec.
220ssd-resnet34-1200OV-2023.2xeonIntel® Xeon® Silver 4316 42.3610.470.0190.14122743002113715062FPSFPS/$FPS/TDPmsec.
221ssd-resnet34-1200OV-2023.2accelIntel® Data Center GPU Flex 170 212109.860.1101.41319251501192515075.46FPSFPS/$FPS/TDPmsec.
222ssd-resnet34-1200OV-2023.2accelIntel® Arc®A-Series Graphics 147.3381.30.4590.9823211501321150107.9FPSFPS/$FPS/TDPmsec.
223ssd-resnet34-1200OV-2023.2atomIntel® Celeron® 6305E CPU0.890.230.0080.059107151107151121.85FPSFPS/$FPS/TDPmsec.
224ssd-resnet34-1200OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU1.181.180.60.0180.0986712167123388.59FPSFPS/$FPS/TDPmsec.
225ssd-resnet34-1200OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU9.695.422.820.0230.34642628142628422.17FPSFPS/$FPS/TDPmsec.
226ssd-resnet34-1200OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU8.814.732.220.0180.31549028149028454.51FPSFPS/$FPS/TDPmsec.
227ssd-resnet34-1200OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU10.576.153.310.0210.0925021151502115378.05FPSFPS/$FPS/TDPmsec.
228ssd-resnet34-1200OV-2023.2atom-iGPUIntel® Processor N200 iGPU0.290.160.0010.04819361193613815.91FPSFPS/$FPS/TDPmsec.
229ssd-resnet34-1200OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU5.072.641.410.0470.33810715110715774.3FPSFPS/$FPS/TDPmsec.
230ssd-resnet34-1200OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU0.330.130.0050.028671216712FPSFPS/$FPS/TDPmsec.
231ssd-resnet34-1200OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU3.9110.0090.14042628142628FPSFPS/$FPS/TDPmsec.
232ssd-resnet34-1200OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU7.222.110.0140.0635021151502115FPSFPS/$FPS/TDPmsec.
233ssd-resnet34-1200OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU0.110.050.0010.019193611936FPSFPS/$FPS/TDPmsec.
234ssd-resnet34-1200OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU0.890.230.0080.05910715110715FPSFPS/$FPS/TDPmsec.
235end_rec
236begin_rec FPSFPS/$FPS/TDPmsec.
237ssd_mobilenet_v1_cocoOV-2023.2atomIntel® Atom® X6425E CPU45.2521.490.6753.77167121671223.03FPSFPS/$FPS/TDPmsec.
238ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i3-8100 211.26122.91.8063.250117651117654.94FPSFPS/$FPS/TDPmsec.
239ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i5-10500TE 328.11171.731.5335.048214651214653.6FPSFPS/$FPS/TDPmsec.
240ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i5-13600K 958.88352.82.9157.67132912513291252.39FPSFPS/$FPS/TDPmsec.
241ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i7-1185G7 CPU516.83149.61.21318.458426281426281.95FPSFPS/$FPS/TDPmsec.
242ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i7-1185GRE CPU387.14100.710.79013.827490281490282.82FPSFPS/$FPS/TDPmsec.
243ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i7-12700H CPU851.54313.451.6967.40550211515021152.26FPSFPS/$FPS/TDPmsec.
244ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i7-8700T 276.74157.910.9137.907303351303354.32FPSFPS/$FPS/TDPmsec.
245ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i9-10900TE 364.53192.130.74710.415488351488353.37FPSFPS/$FPS/TDPmsec.
246ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i9-12900TE 524.73184.040.96514.992544351544353.11FPSFPS/$FPS/TDPmsec.
247ssd_mobilenet_v1_cocoOV-2023.2coreIntel® Core™ i9-13900K 1448.44577.782.41811.58759912515991252.07FPSFPS/$FPS/TDPmsec.
248ssd_mobilenet_v1_cocoOV-2023.2atomIntel® Processor N200 CPU14.487.940.0752.41319361193672.01FPSFPS/$FPS/TDPmsec.
249ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® W1290P 575.79221.760.9694.60659412515941252.37FPSFPS/$FPS/TDPmsec.
250ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® E-2124G 202.62125.710.8142.854249711249715.11FPSFPS/$FPS/TDPmsec.
251ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Gold 5218T 2056.28640.870.6549.7923144210215721051.56FPSFPS/$FPS/TDPmsec.
252ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Platinum 8270 5764.351656.740.34014.05916954410284772051.1FPSFPS/$FPS/TDPmsec.
253ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Platinum 8380 10274.612320.940.54919.02718718540293592700.66FPSFPS/$FPS/TDPmsec.
254ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Platinum 8490H 22310.173557.580.65631.872340007002170003500.82FPSFPS/$FPS/TDPmsec.
255ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Silver 4216R 1961.85610.960.9709.8092022200210111001.63FPSFPS/$FPS/TDPmsec.
256ssd_mobilenet_v1_cocoOV-2023.2xeonIntel® Xeon® Silver 4316 4825.791246.042.12216.0862274300211371500.81FPSFPS/$FPS/TDPmsec.
257ssd_mobilenet_v1_cocoOV-2023.2accelIntel® Data Center GPU Flex 170 4044.153428.722.10126.9611925150119251503.93FPSFPS/$FPS/TDPmsec.
258ssd_mobilenet_v1_cocoOV-2023.2accelIntel® Arc®A-Series Graphics 2984.212546.59.29719.89532115013211505.28FPSFPS/$FPS/TDPmsec.
259ssd_mobilenet_v1_cocoOV-2023.2atomIntel® Celeron® 6305E CPU107.1236.581.0017.142107151107159.17FPSFPS/$FPS/TDPmsec.
260ssd_mobilenet_v1_cocoOV-2023.2atom-iGPUIntel® Atom® X6425E iGPU92.5295.6751.131.3817.71067121671242.26FPSFPS/$FPS/TDPmsec.
261ssd_mobilenet_v1_cocoOV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU651.76382.05253.71.53023.277426281426286.02FPSFPS/$FPS/TDPmsec.
262ssd_mobilenet_v1_cocoOV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU524.22312.45186.781.07018.722490281490287.46FPSFPS/$FPS/TDPmsec.
263ssd_mobilenet_v1_cocoOV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU773.55416.41274.891.5416.72750211515021154.96FPSFPS/$FPS/TDPmsec.
264ssd_mobilenet_v1_cocoOV-2023.2atom-iGPUIntel® Processor N200 iGPU29.1115.389.50.1514.852193611936136.41FPSFPS/$FPS/TDPmsec.
265ssd_mobilenet_v1_cocoOV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU411.09221.78136.653.84227.406107151107159.59FPSFPS/$FPS/TDPmsec.
266ssd_mobilenet_v1_cocoOV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU108.7457.491.6239.061671216712FPSFPS/$FPS/TDPmsec.
267ssd_mobilenet_v1_cocoOV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU681.22234.331.59924.32942628142628FPSFPS/$FPS/TDPmsec.
268ssd_mobilenet_v1_cocoOV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU846.65312.781.6877.3625021151502115FPSFPS/$FPS/TDPmsec.
269ssd_mobilenet_v1_cocoOV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU35.0614.070.1825.843193611936FPSFPS/$FPS/TDPmsec.
270ssd_mobilenet_v1_cocoOV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU299.91136.252.80319.99410715110715FPSFPS/$FPS/TDPmsec.
271end_rec
272begin_rec FPSFPS/$FPS/TDPmsec.
273unet-camvid-onnx-0001OV-2023.2atomIntel® Atom® X6425E CPU0.480.060.0070.0406712167122086.28FPSFPS/$FPS/TDPmsec.
274unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i3-8100 2.421.550.0210.03711765111765426.14FPSFPS/$FPS/TDPmsec.
275unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i5-10500TE 3.62.280.0170.05521465121465324.72FPSFPS/$FPS/TDPmsec.
276unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i5-13600K 11.523.960.0350.0923291251329125121.88FPSFPS/$FPS/TDPmsec.
277unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i7-1185G7 CPU6.541.630.0150.23442628142628168.96FPSFPS/$FPS/TDPmsec.
278unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i7-1185GRE CPU4.871.220.0100.17449028149028209.5FPSFPS/$FPS/TDPmsec.
279unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i7-12700H CPU10.233.550.0200.0895021151502115123.74FPSFPS/$FPS/TDPmsec.
280unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i7-8700T 3.021.860.0100.08630335130335385.98FPSFPS/$FPS/TDPmsec.
281unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i9-10900TE 3.862.40.0080.11048835148835286.48FPSFPS/$FPS/TDPmsec.
282unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i9-12900TE 6.292.210.0120.18054435154435167.25FPSFPS/$FPS/TDPmsec.
283unet-camvid-onnx-0001OV-2023.2coreIntel® Core™ i9-13900K 17.976.610.0300.144599125159912591.7FPSFPS/$FPS/TDPmsec.
284unet-camvid-onnx-0001OV-2023.2atomIntel® Processor N200 CPU0.170.090.0010.0291936119365851.61FPSFPS/$FPS/TDPmsec.
285unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® W1290P 6.173.960.0100.0495941251594125180.39FPSFPS/$FPS/TDPmsec.
286unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® E-2124G 2.311.480.0090.03324971124971434.36FPSFPS/$FPS/TDPmsec.
287unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Gold 5218T 29.197.310.0090.13931442102157210571.02FPSFPS/$FPS/TDPmsec.
288unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Platinum 8270 95.1821.60.0060.232169544102847720523.81FPSFPS/$FPS/TDPmsec.
289unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Platinum 8380 129.1231.530.0070.239187185402935927073.82FPSFPS/$FPS/TDPmsec.
290unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Platinum 8490H 594.4448.370.0170.849340007002170003508.51FPSFPS/$FPS/TDPmsec.
291unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Silver 4216R 27.776.960.0140.13920222002101110074.6FPSFPS/$FPS/TDPmsec.
292unet-camvid-onnx-0001OV-2023.2xeonIntel® Xeon® Silver 4316 69.0415.920.0300.23022743002113715043.95FPSFPS/$FPS/TDPmsec.
293unet-camvid-onnx-0001OV-2023.2accelIntel® Data Center GPU Flex 170 308.2201.070.1602.05519251501192515051.9FPSFPS/$FPS/TDPmsec.
294unet-camvid-onnx-0001OV-2023.2accelIntel® Arc®A-Series Graphics 264.35182.280.8241.762321150132115060.21FPSFPS/$FPS/TDPmsec.
295unet-camvid-onnx-0001OV-2023.2atomIntel® Celeron® 6305E CPU1.490.380.0140.09910715110715675.13FPSFPS/$FPS/TDPmsec.
296unet-camvid-onnx-0001OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU0.981.990.980.0150.0826712167124060.12FPSFPS/$FPS/TDPmsec.
297unet-camvid-onnx-0001OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU17.258.844.820.0400.61642628142628227.85FPSFPS/$FPS/TDPmsec.
298unet-camvid-onnx-0001OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU15.517.824.160.0320.55449028149028257.82FPSFPS/$FPS/TDPmsec.
299unet-camvid-onnx-0001OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU18.559.775.390.0370.1615021151502115215.12FPSFPS/$FPS/TDPmsec.
300unet-camvid-onnx-0001OV-2023.2atom-iGPUIntel® Processor N200 iGPU0.460.250.140.0020.0771936119368685.49FPSFPS/$FPS/TDPmsec.
301unet-camvid-onnx-0001OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU8.414.382.380.0790.56010715110715475.59FPSFPS/$FPS/TDPmsec.
302unet-camvid-onnx-0001OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU1.230.790.0180.102671216712FPSFPS/$FPS/TDPmsec.
303unet-camvid-onnx-0001OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU13.963.780.0330.49942628142628FPSFPS/$FPS/TDPmsec.
304unet-camvid-onnx-0001OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU10.263.520.0200.0895021151502115FPSFPS/$FPS/TDPmsec.
305unet-camvid-onnx-0001OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU0.570.190.0030.094193611936FPSFPS/$FPS/TDPmsec.
306unet-camvid-onnx-0001OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU8.942.440.0840.59610715110715FPSFPS/$FPS/TDPmsec.
307end_rec
308begin_rec FPSFPS/$FPS/TDPmsec.
309yolo_v3OV-2023.2atomIntel® Atom® X6425E CPU2.090.880.0310.174671216712484.41FPSFPS/$FPS/TDPmsec.
310yolo_v3OV-2023.2coreIntel® Core™ i3-8100 10.635.80.0910.1631176511176595.04FPSFPS/$FPS/TDPmsec.
311yolo_v3OV-2023.2coreIntel® Core™ i5-10500TE 15.378.280.0720.2362146512146574.25FPSFPS/$FPS/TDPmsec.
312yolo_v3OV-2023.2coreIntel® Core™ i5-13600K 51.7915.620.1570.414329125132912529.87FPSFPS/$FPS/TDPmsec.
313yolo_v3OV-2023.2coreIntel® Core™ i7-1185G7 CPU24.166.610.0570.8634262814262846.04FPSFPS/$FPS/TDPmsec.
314yolo_v3OV-2023.2coreIntel® Core™ i7-1185GRE CPU18.044.840.0370.6444902814902857.2FPSFPS/$FPS/TDPmsec.
315yolo_v3OV-2023.2coreIntel® Core™ i7-12700H CPU45.5513.340.0910.396502115150211529.39FPSFPS/$FPS/TDPmsec.
316yolo_v3OV-2023.2coreIntel® Core™ i7-8700T 12.716.820.0420.3633033513033587.06FPSFPS/$FPS/TDPmsec.
317yolo_v3OV-2023.2coreIntel® Core™ i9-10900TE 16.648.640.0340.4754883514883567.32FPSFPS/$FPS/TDPmsec.
318yolo_v3OV-2023.2coreIntel® Core™ i9-12900TE 27.338.160.0500.7815443515443541.73FPSFPS/$FPS/TDPmsec.
319yolo_v3OV-2023.2coreIntel® Core™ i9-13900K 78.0625.640.1300.624599125159912523.25FPSFPS/$FPS/TDPmsec.
320yolo_v3OV-2023.2atomIntel® Processor N200 CPU0.70.340.0040.1171936119361470.7FPSFPS/$FPS/TDPmsec.
321yolo_v3OV-2023.2xeonIntel® Xeon® W1290P 27.3714.080.0460.219594125159412540.66FPSFPS/$FPS/TDPmsec.
322yolo_v3OV-2023.2xeonIntel® Xeon® E-2124G 10.065.640.0400.14224971124971100.33FPSFPS/$FPS/TDPmsec.
323yolo_v3OV-2023.2xeonIntel® Xeon® Gold 5218T 106.3629.720.0340.50631442102157210521.82FPSFPS/$FPS/TDPmsec.
324yolo_v3OV-2023.2xeonIntel® Xeon® Platinum 8270 313.8387.890.0190.765169544102847720510.5FPSFPS/$FPS/TDPmsec.
325yolo_v3OV-2023.2xeonIntel® Xeon® Platinum 8380 490.61109.010.0260.9091871854029359270FPSFPS/$FPS/TDPmsec.
326yolo_v3OV-2023.2xeonIntel® Xeon® Platinum 8490H 2125.85193.930.0633.037340007002170003503.31FPSFPS/$FPS/TDPmsec.
327yolo_v3OV-2023.2xeonIntel® Xeon® Silver 4216R 101.1328.360.0500.50620222002101110022.77FPSFPS/$FPS/TDPmsec.
328yolo_v3OV-2023.2xeonIntel® Xeon® Silver 4316 242.2562.310.1070.80822743002113715013.97FPSFPS/$FPS/TDPmsec.
329yolo_v3OV-2023.2accelIntel® Data Center GPU Flex 170 784.51385.290.4085.23019251501192515020.34FPSFPS/$FPS/TDPmsec.
330yolo_v3OV-2023.2accelIntel® Arc®A-Series Graphics 582.91341.61.8163.886321150132115027.27FPSFPS/$FPS/TDPmsec.
331yolo_v3OV-2023.2atomIntel® Celeron® 6305E CPU5.451.540.0510.36310715110715184.42FPSFPS/$FPS/TDPmsec.
332yolo_v3OV-2023.2atom-iGPUIntel® Atom® X6425E iGPU6.746.853.380.1010.562671216712591.73FPSFPS/$FPS/TDPmsec.
333yolo_v3OV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU63.5729.6816.20.1492.2704262814262863.78FPSFPS/$FPS/TDPmsec.
334yolo_v3OV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU57.5126.0413.460.1172.0544902814902869.04FPSFPS/$FPS/TDPmsec.
335yolo_v3OV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU70.1733.5318.680.1400.610502115150211556.66FPSFPS/$FPS/TDPmsec.
336yolo_v3OV-2023.2atom-iGPUIntel® Processor N200 iGPU1.760.940.50.0090.2931936119362270.28FPSFPS/$FPS/TDPmsec.
337yolo_v3OV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU32.2215.098.060.3012.14810715110715123.79FPSFPS/$FPS/TDPmsec.
338yolo_v3OV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU7.723.750.1150.643671216712FPSFPS/$FPS/TDPmsec.
339yolo_v3OV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU51.2713.810.1201.83142628142628FPSFPS/$FPS/TDPmsec.
340yolo_v3OV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU45.3713.460.0900.3955021151502115FPSFPS/$FPS/TDPmsec.
341yolo_v3OV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU2.170.70.0110.361193611936FPSFPS/$FPS/TDPmsec.
342yolo_v3OV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU33.628.520.3142.24210715110715FPSFPS/$FPS/TDPmsec.
343end_rec
344begin_rec FPSFPS/$FPS/TDPmsec.
345yolo_v3_tinyOV-2023.2atomIntel® Atom® X6425E CPU22.910.30.3421.90867121671244.81FPSFPS/$FPS/TDPmsec.
346yolo_v3_tinyOV-2023.2coreIntel® Core™ i3-8100 111.763.530.9551.718117651117659.05FPSFPS/$FPS/TDPmsec.
347yolo_v3_tinyOV-2023.2coreIntel® Core™ i5-10500TE 167.3691.550.7822.575214651214656.74FPSFPS/$FPS/TDPmsec.
348yolo_v3_tinyOV-2023.2coreIntel® Core™ i5-13600K 600195.961.8244.80032912513291253.05FPSFPS/$FPS/TDPmsec.
349yolo_v3_tinyOV-2023.2coreIntel® Core™ i7-1185G7 CPU252.2877.330.5929.010426281426284.56FPSFPS/$FPS/TDPmsec.
350yolo_v3_tinyOV-2023.2coreIntel® Core™ i7-1185GRE CPU186.6155.020.3816.665490281490285.72FPSFPS/$FPS/TDPmsec.
351yolo_v3_tinyOV-2023.2coreIntel® Core™ i7-12700H CPU501.3153.330.9994.35950211515021153.07FPSFPS/$FPS/TDPmsec.
352yolo_v3_tinyOV-2023.2coreIntel® Core™ i7-8700T 137.8376.630.4553.938303351303358.19FPSFPS/$FPS/TDPmsec.
353yolo_v3_tinyOV-2023.2coreIntel® Core™ i9-10900TE 184.1595.480.3775.261488351488356.36FPSFPS/$FPS/TDPmsec.
354yolo_v3_tinyOV-2023.2coreIntel® Core™ i9-12900TE 293.8793.770.5408.396544351544354.16FPSFPS/$FPS/TDPmsec.
355yolo_v3_tinyOV-2023.2coreIntel® Core™ i9-13900K 859.57285.931.4356.87759912515991252.43FPSFPS/$FPS/TDPmsec.
356yolo_v3_tinyOV-2023.2atomIntel® Processor N200 CPU7.834.080.0411.306193611936136.7FPSFPS/$FPS/TDPmsec.
357yolo_v3_tinyOV-2023.2xeonIntel® Xeon® W1290P 298.34148.850.5022.38759412515941254.01FPSFPS/$FPS/TDPmsec.
358yolo_v3_tinyOV-2023.2xeonIntel® Xeon® E-2124G 106.1562.710.4261.495249711249719.46FPSFPS/$FPS/TDPmsec.
359yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Gold 5218T 1051.35338.780.3345.0063144210215721052.52FPSFPS/$FPS/TDPmsec.
360yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Platinum 8270 2835.63919.260.1676.91616954410284772051.22FPSFPS/$FPS/TDPmsec.
361yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Platinum 8380 4653.131373.230.2498.61718718540293592700.87FPSFPS/$FPS/TDPmsec.
362yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Platinum 8490H 13069.922139.010.38418.671340007002170003501.07FPSFPS/$FPS/TDPmsec.
363yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Silver 4216R 1009.33322.760.4995.0472022200210111002.62FPSFPS/$FPS/TDPmsec.
364yolo_v3_tinyOV-2023.2xeonIntel® Xeon® Silver 4316 2219.25701.360.9767.3972274300211371501.33FPSFPS/$FPS/TDPmsec.
365yolo_v3_tinyOV-2023.2accelIntel® Data Center GPU Flex 170 3774.192809.61.96125.1611925150119251504.2FPSFPS/$FPS/TDPmsec.
366yolo_v3_tinyOV-2023.2accelIntel® Arc®A-Series Graphics 2481.582188.37.73116.54432115013211506.38FPSFPS/$FPS/TDPmsec.
367yolo_v3_tinyOV-2023.2atomIntel® Celeron® 6305E CPU54.0317.970.5053.6021071511071518.27FPSFPS/$FPS/TDPmsec.
368yolo_v3_tinyOV-2023.2atom-iGPUIntel® Atom® X6425E iGPU65.7166.3933.870.9815.47667121671260.33FPSFPS/$FPS/TDPmsec.
369yolo_v3_tinyOV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU546.82290.91170.541.28419.529426281426287.02FPSFPS/$FPS/TDPmsec.
370yolo_v3_tinyOV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU494.07258.4135.871.00817.645490281490287.98FPSFPS/$FPS/TDPmsec.
371yolo_v3_tinyOV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU614.04322.38201.061.2235.33950211515021156.27FPSFPS/$FPS/TDPmsec.
372yolo_v3_tinyOV-2023.2atom-iGPUIntel® Processor N200 iGPU18.679.835.510.0973.112193611936213.14FPSFPS/$FPS/TDPmsec.
373yolo_v3_tinyOV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU292.06153.1186.792.73019.4711071511071513.59FPSFPS/$FPS/TDPmsec.
374yolo_v3_tinyOV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU28.4939.70.4252.374671216712FPSFPS/$FPS/TDPmsec.
375yolo_v3_tinyOV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU485.88147.221.14117.35342628142628FPSFPS/$FPS/TDPmsec.
376yolo_v3_tinyOV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU504.34154.351.0054.3865021151502115FPSFPS/$FPS/TDPmsec.
377yolo_v3_tinyOV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU23.018.080.1193.835193611936FPSFPS/$FPS/TDPmsec.
378yolo_v3_tinyOV-2023.2atom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU322.0392.973.01021.46910715110715FPSFPS/$FPS/TDPmsec.
379end_rec
380begin_rec FPSFPS/$FPS/TDPmsec.
381yolo_v8nOV-2023.2atomIntel® Atom® X6425E CPU10.235.10.1530.853671216712101.71FPSFPS/$FPS/TDPmsec.
382yolo_v8nOV-2023.2coreIntel® Core™ i3-8100 53.4333.010.4570.8221176511176519.24FPSFPS/$FPS/TDPmsec.
383yolo_v8nOV-2023.2coreIntel® Core™ i5-10500TE 81.2846.840.3801.2512146512146513.7FPSFPS/$FPS/TDPmsec.
384yolo_v8nOV-2023.2coreIntel® Core™ i5-13600K 249.1395.350.7571.99332912513291256.67FPSFPS/$FPS/TDPmsec.
385yolo_v8nOV-2023.2coreIntel® Core™ i7-1185G7 CPU110.5740.760.2603.9494262814262810.77FPSFPS/$FPS/TDPmsec.
386yolo_v8nOV-2023.2coreIntel® Core™ i7-1185GRE CPU77.427.480.1582.7644902814902813.63FPSFPS/$FPS/TDPmsec.
387yolo_v8nOV-2023.2coreIntel® Core™ i7-12700H CPU213.2281.230.4251.85450211515021156.64FPSFPS/$FPS/TDPmsec.
388yolo_v8nOV-2023.2coreIntel® Core™ i7-8700T 71.3942.390.2362.0403033513033516.54FPSFPS/$FPS/TDPmsec.
389yolo_v8nOV-2023.2coreIntel® Core™ i9-10900TE 92.6452.820.1902.6474883514883512.63FPSFPS/$FPS/TDPmsec.
390yolo_v8nOV-2023.2coreIntel® Core™ i9-12900TE 132.4350.680.2433.784544351544359.16FPSFPS/$FPS/TDPmsec.
391yolo_v8nOV-2023.2coreIntel® Core™ i9-13900K 377.83153.020.6313.02359912515991255.31FPSFPS/$FPS/TDPmsec.
392yolo_v8nOV-2023.2atomIntel® Processor N200 CPU3.261.940.0170.543193611936316.73FPSFPS/$FPS/TDPmsec.
393yolo_v8nOV-2023.2xeonIntel® Xeon® W1290P 135.1572.610.2281.08159412515941259.22FPSFPS/$FPS/TDPmsec.
394yolo_v8nOV-2023.2xeonIntel® Xeon® E-2124G 52.1532.90.2090.7352497112497119.49FPSFPS/$FPS/TDPmsec.
395yolo_v8nOV-2023.2xeonIntel® Xeon® Gold 5218T 450.82174.940.1432.1473144210215721055.96FPSFPS/$FPS/TDPmsec.
396yolo_v8nOV-2023.2xeonIntel® Xeon® Platinum 8270 998.4454.70.0592.43516954410284772053.53FPSFPS/$FPS/TDPmsec.
397yolo_v8nOV-2023.2xeonIntel® Xeon® Platinum 8380 1714.12554.580.0923.17418718540293592702.38FPSFPS/$FPS/TDPmsec.
398yolo_v8nOV-2023.2xeonIntel® Xeon® Platinum 8490H 2889.04998.410.0854.127340007002170003503.61FPSFPS/$FPS/TDPmsec.
399yolo_v8nOV-2023.2xeonIntel® Xeon® Silver 4216R 431.74165.690.2142.1592022200210111006.18FPSFPS/$FPS/TDPmsec.
400yolo_v8nOV-2023.2xeonIntel® Xeon® Silver 4316 862.18340.380.3792.8742274300211371503.32FPSFPS/$FPS/TDPmsec.
401yolo_v8nOV-2023.2accelIntel® Data Center GPU Flex 170 1539.241433.210.80010.26219251501192515010.28FPSFPS/$FPS/TDPmsec.
402yolo_v8nOV-2023.2accelIntel® Arc®A-Series Graphics 1005.971032.493.1346.706321150132115015.79FPSFPS/$FPS/TDPmsec.
403yolo_v8nOV-2023.2atomIntel® Celeron® 6305E CPU24.259.560.2271.6171071511071540.75FPSFPS/$FPS/TDPmsec.
404yolo_v8nOV-2023.2atom-iGPUIntel® Atom® X6425E iGPU32.0333.5219.170.4782.669671216712124.04FPSFPS/$FPS/TDPmsec.
405yolo_v8nOV-2023.2core-iGPUIntel® Core™ i7-1185G7 iGPU206.31140.7588.20.4847.3684262814262819.11FPSFPS/$FPS/TDPmsec.
406yolo_v8nOV-2023.2core-iGPUIntel® Core™ i7-1185GRE iGPU164.45109.0961.030.3365.8734902814902824.02FPSFPS/$FPS/TDPmsec.
407yolo_v8nOV-2023.2core-iGPUIntel® Core™ i7-12700H iGPU220.75149.9896.810.4401.920502115150211517.82FPSFPS/$FPS/TDPmsec.
408yolo_v8nOV-2023.2atom-iGPUIntel® Processor N200 iGPU8.375.573.250.0431.394193611936477.17FPSFPS/$FPS/TDPmsec.
409yolo_v8nOV-2023.2atom-iGPUIntel® Celeron® 6305E iGPU35.1420.320.5242.928671216712FPSFPS/$FPS/TDPmsec.
410yolo_v8nOV-2023.2atom-CPU+iGPUIntel® Atom® X6425E CPU+iGPU179.374.120.4216.40342628142628FPSFPS/$FPS/TDPmsec.
411yolo_v8nOV-2023.2core-CPU+iGPUIntel® Core™ i7-1185G7 CPU+iGPU212.8482.480.4241.8515021151502115FPSFPS/$FPS/TDPmsec.
412yolo_v8nOV-2023.2core-CPU+iGPUIntel® Core™ i7-12700H CPU+iGPU10.064.440.0521.676193611936FPSFPS/$FPS/TDPmsec.
413yolo_v8nOV-2023.2atom-CPU+iGPUIntel® Processor N200 CPU+iGPU113.9648.91.0657.59710715110715FPSFPS/$FPS/TDPmsec.
414end_recatom-CPU+iGPUIntel® Celeron® 6305E CPU+iGPU
415begin_rec
416chatGLM2-6BOV-2023.2coreIntel® Core™ i9-13900K 277340msec./tokenFPS/$FPS/TDPmsec./token374
417chatGLM2-6BOV-2023.2xeonIntel® Xeon® Platinum 8380 173msec./tokenFPS/$FPS/TDPmsec./token
418chatGLM2-6BOV-2023.2xeonIntel® Xeon® Platinum 8490H114msec./tokenFPS/$FPS/TDPmsec./token
419chatGLM2-6BOV-2023.2accelIntel® Data Center GPU Flex 170 msec./tokenFPS/$FPS/TDPmsec./token
420chatGLM2-6BOV-2023.2accelIntel® Arc®A-Series Graphics 95121msec./tokenFPS/$FPS/TDPmsec./token
421end_rec
422begin_rec
423Llama-2-7b-chatOV-2023.2coreIntel® Core™ i9-13900K 415420msec./tokenFPS/$FPS/TDPmsec./token417
424Llama-2-7b-chatOV-2023.2xeonIntel® Xeon® Platinum 8380 179201msec./tokenFPS/$FPS/TDPmsec./token133
425Llama-2-7b-chatOV-2023.2xeonIntel® Xeon® Platinum 8490H143133msec./tokenFPS/$FPS/TDPmsec./token136
426Llama-2-7b-chatOV-2023.2accelIntel® Data Center GPU Flex 170 11195msec./tokenFPS/$FPS/TDPmsec./token126
427Llama-2-7b-chatOV-2023.2accelIntel® Arc®A-Series Graphics 163163msec./tokenFPS/$FPS/TDPmsec./token221
428end_rec
429begin_rec
430Stable-Diffusion-v2-1OV-2023.2accelIntel® Data Center GPU Flex 170 7.14.4sec.FPS/$FPS/TDPsec.
431end_rec