Commit Graph

2582 Commits

Author SHA1 Message Date
Polina Brzezinskaya 0c8a5d5279
[VPU] Removes MYRIAD specific tools (#6908) 2021-08-09 20:35:03 +03:00
Min, Byungil 9899264d61
Resolve python build issue on Windows (#6517)
Signed-off-by: Min, Byungil <byungil.min@intel.com>
2021-08-09 12:53:29 +03:00
Gleb Kazantaev b11a2220b0
Enable ConstantFolding inside MO Backend (#6916) 2021-08-07 12:40:46 +03:00
Aleksandr Voron 74ac48a297
Update CMakeLists.txt (#6965) 2021-08-06 21:14:44 +03:00
Szymon Irzabek 862176d1d4
[GNA] Add support for strides with dilations and POT fake quantize layers (#6900) 2021-08-06 14:45:11 +03:00
Gabriele Galiero Casay 371fc7aee4
Enable low precision types in ConvertLike operation reference implementation (#6890)
* Enable low precision types for ConvertLike operation

* Migrate backend unit test suite to template plugin reference tests

* Fix typo in naming convention

* Avoid duplication of template plugin tests execution

* Add file to instantiate TEST_P and avoid test execution duplication
2021-08-06 11:19:16 +03:00
Edward Shogulin 43f18da413
[LPT] Legacy compliance restrictions removal all: Reshape (#6870)
* [LPT] Reshape: legacy compliance restrictions removal

* [LPT] comment fixes
2021-08-06 10:27:34 +03:00
Ilya Churaev fc39303677
Moved IE public headers to IE library (#6941)
* Moved IE public headers to IE library

* Fixed documentation

* Fixed fast build

* Fixed doc
2021-08-06 10:05:51 +03:00
Sergey Shlyapnikov f231fbd551
[GPU] Fix invalid memory access in replace_all_usage fucntion (#6906) 2021-08-06 08:40:34 +03:00
Mikhail Ryzhov 89fba123bb
[GNA] Added support of FQ layers for outputs (#6905)
* [GNA] Fixed FQ pass for several outputs

* Added tests

* Used the latest opeset8
2021-08-05 22:12:52 +03:00
Edward Shogulin c08bc75766
[LPT] Optimize quantization scheme for SPR/ATS (#6808)
* [LPT] Optimize quantization scheme for SPR/ATS

* [LPT] updatePrecisions = false support
2021-08-05 21:03:03 +03:00
Sergey Shlyapnikov 79e9190838
[GPU] Fix incorrect fusions indexes for eltwise ref kernel (#6936) 2021-08-05 13:40:52 +03:00
Egor Duplensky f584cf9727
[CPU] Update batch limit right after setting it (#6513)
Seem to be more convenient than checking and updating batch limit
in scope of Infer request call.
2021-08-05 08:21:16 +03:00
Yuan Hu a913950039
revise tan op (#6567)
* revise tan op

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* update doc

add examples in desciption
add the unit of measure
clear input type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add template plugin test case for int type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* add template plugin test case for uint and float

remove the float test in backend

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* modify document

change type to any supported numeric type

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>

* fix compile error in openvino-lin

Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
2021-08-05 07:48:58 +03:00
Ilya Churaev 031381dc07
Small api changes (#6923)
* Deprecate specialize_function

* Changed RTMap

* Fixed python build
2021-08-04 21:34:11 +03:00
hyunback kim f00dabc184
Add input image scale option in benchmark App (#5848)
* Add input image scale flag in benchmark app.

- user set input image scale with -iscale.
  input is divided by scale.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Apply image scale, mean parameter in benchmark APP

Means and sacles values per channel

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Fix clang-format

Signed-off-by: hyunback <hyunback.kim@intel.com>

* fix clang-format issue2.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Update benchmark tool to align the format of mean and sacle values with MO arguments.

Signed-off-by: hyunback <hyunback.kim@intel.com>

* Remove debug print.

Signed-off-by: hyunback <hyunback.kim@intel.com>
2021-08-04 19:51:46 +03:00
Anastasia Kuporosova 585f211e0a
[IE Python API] fix test query state write buffer (#6928) 2021-08-04 19:43:41 +03:00
Aleksandr Voron cad700444e
Update CMakeLists.txt (#6840) 2021-08-04 17:58:20 +03:00
Vladimir Paramuzov 29b527353a
[GPU] Replace internal TBlobs with mappable ClBlobs in all InferRequests to ensure correct work on discrete GPUs (#6922)
Co-authored-by: Mikhail Letavin <mikhail.letavin@intel.com>
2021-08-04 16:53:56 +03:00
Gleb Kazantaev 73e8e91ffd
Enable NopEliminatoin inside MO Backend (#6874)
* Refactor NopElimination; Execute NopEliminatoin inside MOC Backend

* Add missing header

* Refactor tests; use weak_ptr to avoid excess consumers for node

* Add test to check number of shared_ptr usages for graph nodes during Manager execution

* Remove AlgebraicSimplification forewer
2021-08-04 13:53:06 +03:00
Anton Romanov 0acfc8b5ae
Update weights size (#6909) 2021-08-04 13:37:24 +03:00
Anastasia Kuporosova dd742de105
[Python API] removal of deprecated python api (#6282)
* [Python API] removal of deprecated python api

* [Python API] removal of deprecated python api
2021-08-04 11:46:39 +03:00
Anton Pankratv 4d8825e4f8
Stream executor config returns strings (#6830) 2021-08-04 11:09:30 +03:00
Mateusz Tabaka 8c4cee1b58
[GPU] Handle negative axis in concat op (#6839)
* [clDNN] Handle negative axis in concat op

That enables following models for onnx importer path:
yolact-resnet50-fpn-pytorch
yolact-resnet101-fpn-pytorch
yolact-darknet53-fpn-pytorch
swin-tiny-patch4-window7-224
action-recognition-mkinetics-res34-mhsa
driver-action-recognition-adas-0002-decoder
horizontal-text-detection-0001

* Add tests for negative axis in Concat op
2021-08-04 10:44:22 +03:00
Vladimir Paramuzov 8f5d9a8b78
[GPU] Refactored network/program/topology classes (#6800) 2021-08-04 10:17:59 +03:00
Ilya Lavrenov b9b0a8b34a
Fixed compilation with clang (#6917) 2021-08-04 09:28:20 +03:00
Bartek Szmelczynski c963136453
Revise less equal (#6720)
* update spec, add visitors, backend test

* remove visitors test as it is implemented in another PR

* remove visitors test from CMakeLists

* remove old backend tests, refactor minor parts of the code

* add namespace

* refaactor template test for less_equal op
2021-08-04 03:18:25 +03:00
Piotr Szmelczynski a30bd0c9bb
Revise logical and (#6731)
* update docs

* add host tensors validation

* create type_prop tests

* create serialization single layer test

* create visitor test

* create op_reference test

* add logicalAnd to constants.py

* create additional op_reference tests

* add check for number of visited attributes in visitor test

* update auto_broadcast description

* remoove backend test

* update LogicalNot params name

* remove backend test from CMakeList

* create util function for type_prop tests

* update op_reference tests

* remove typo in docs

* remove unsupported types from evaluate

* fix bug in op_reference test

* refactor visitor test

* update math formula in the spec

* update has_evaluate types
2021-08-03 19:37:16 +03:00
Ilya Churaev 8a612fa55e
Moved current IE API to separate folder (#6735)
* Moved current IE API to separate folder

* Fix install

* Fix documentation

* Fixed install path

* Try to fix CI

* Changed installation path

* Use ONNXRuntime rel-1.8.1 version
2021-08-03 12:24:05 +03:00
Szymon Irzabek 063c240ed6
[GNA] Add decompose 2D convolutions transformation (#6382)
* [GNA] Add decompose 2D convolutions transformation

* [GNA] Use constant folding instead of creating copies

* [GNA] Enable more tests

* [GNA] Align ngraph opset
2021-08-03 10:33:11 +03:00
Szymon Durawa bba7155fb7
CVS-60706 add cosh to int test. (#6718) 2021-08-03 08:43:04 +03:00
Ilya Lavrenov 9ad668a8d7
Fixing cmake command removing temp data for ie_wheel (#6893)
* Fixing cmake command removing temp data for ie_wheel

* rm -> remove_directory

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-08-03 08:07:09 +03:00
Ilya Churaev e89ffa7718
Added nGraph as a public dependency (#6071)
* Added nGraph as a public dependency

* Fixed Windows warning

* Fixed CMake

* Fixed constant op

* Fixed typo

* Fixed comments

* Revert ngraph libraries

* Fixed build

* Fixed IE::ngraph

* Fixed git merge
2021-08-02 18:48:16 +03:00
Gleb Kazantaev cc5f63d87a
Fix Pruning for case with INT8 GroupConvolution operation (#6872) 2021-08-02 12:36:51 +03:00
Ilya Lavrenov a177eb2f2e
Fixed Windows public precommit (#6877) 2021-08-02 10:22:37 +03:00
Maksim Kutakov 35696ca1db
[CPU] Unified memory descriptor (#6328) 2021-08-02 09:19:15 +03:00
Ilya Lavrenov c38f08b777
Use protobuf-lite for ONNX FE by default (#6829) 2021-07-31 17:21:35 +03:00
Evgeny Lazarev 5bafab9e72
Allow partially defined dimensions to read/serialize from/to IR (#6819)
* Allow to read and serialize IRs with -1 in dimensions (partially defined shape)

* Added unit test for reading/writing IR with partially defined shapes

* Added missing xml file with test IR

* Remove copy-paste issue

* Output message fix

* Restored statification of the output shapes during IR serialization

* Try to make dynamic shapes static with upper bound

* Code style changes
2021-07-30 22:53:43 +03:00
Luo Cheng 86bb056dbf
MulticlassNms/MatrixNms: transformations and CPU implementation (#6653)
* init version, need revise: opset7

* add convert testcase

* multiclass_nms support spec

* init version

* matrixnms support spec

* init support for matrix_nms

* impl matirx_nms

* implemented multiclass_nms reference.

TODO: more test cases.

* support dynamic shape in test

* update to spec 0611

* update to spec 0611

* fixes.

* fix: now sort by class_id and score work.

* fix clang check error

* more test cases verified.

* fixes in ref impl.

* attribute nms_eta works

* test cross_batch and output_type i32.

* enable multiclass-nms cpu plugin fallback ngraph

* keep topk typo

* enable matrix-nms cpu plugin fallback ngraph

* support sort_result_across_batch

* Add matrix_nms unit test

* Add cross batch test cases

* fix typo

* move multiclass to opset8

* move matrixnms to opset8

* Reference implementations for MulticlassNms and MatrixNms ops

* fix name conflict

* remove unused var
sort_result_across_batch default set to false

* avoid float overflow

* fix clang check error

* info for mac fail

* change testcase due to unstable sort

* nms add 'normalized' attribute

* multiclass cpu test support 'normalized'

* nms add 'normalized' attribute

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fixes: 1. normalized support. 2. sort by score before keep_top_k inside a batch.

* fix sort order in matrix_nms

* fix review comments

* add matrix_nms MKLDNN extension layer

* parallel in matirx nms

* separate filtered_box

* separate class_nms result

* parallel in class

* parallel in batch

* partial new nms

* partial remove useless function

* debug & fix

* debug in indexing

* fix test cases

* remove logging

* fix code-style

* fix typo

* add matrix_nms extension

* nms python api

* remove unused testcases

* refactor transformation

* transform dynamic shape to static shape

* Update inference-engine/src/transformations/include/ngraph_ops/nms_static_shape_ie.hpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* remove register_pass call

* [MKLDNN]migrate matrix_nms to MKLDNNNode

* bug fix in matrix_nms

* padding on matrix_nms

* remove logging

* test case refine

* merged transform_matrix_nms branch

* refine matrixnms testcase

* multiclass nms cpu plugin implement for static shape, rebased on Reference implementations PR

* rebase to new multi-classs transform provided by lc

* Name style algin with matrix-nms

* static shape padding style to batch inside,new unit test method, real classnum shape

* fix format

* fix ci error

* multi-class NMS modification based on PR reviewer opinion: code format, copyright, delete unused include and funciton way

* explicit template instantiation due to mac ci fail

* Yi3/fix review (#16)

* fix coding style

* use parallel_for2d

* fix ci fail

* unify 'copyright 2021'

* mkldnn_multiclass_nms node update based on PR review (#17)

* [MKLDNN] apply suggestion for matrix_nms (#18)

* fix bug

* apply review comments

* apply review comments

* apply review comments

* apply review comments

* skip only Nms test, not MatrixNms MulticlassNms test

Co-authored-by: Zhang Yi3 <yi3.zhang@intel.com>
Co-authored-by: jialipen <cecilia.peng@intel.com>
Co-authored-by: mangguo <mang.guo@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: liubo-intel <bo4.liu@intel.com>
2021-07-30 15:45:44 +03:00
Mateusz Tabaka c0c2f2da7e
Add LeakyReluFusion transformation (#6816) 2021-07-30 13:04:52 +02:00
Ilya Lavrenov 518ec79cb0
Updated samples compile options (#6818)
* Don't warn about obsolete cmake usage

* Removed build flags for samples

* Fixed ngraph with -Wpedantic

* cmake for 3rdparty
2021-07-30 13:54:09 +03:00
Maxim Andronov 2b871eb582
[CPU] prohibit fusing if dropped node contain > 1 child edges (#6705) 2021-07-30 11:47:47 +03:00
Maxim Vafin 5920cf849d
Implement paddle frontend methods for partial conversion (#6784)
* Implement paddle frontend methods for partial conversion

* Apply feedback

* Fix codestyle

* Remove normalize implementation and change convert signature for partialModel case

* Apply review feedback

* Apply review feedback

* Fix onnx importer convert signature

* Fix codestyle

* Add test of unsupported op

* Fix code style

* Remove "normalize()" tests

* Fix onnx tests

* Fix build

* Fix merge conflicts
2021-07-30 10:14:18 +03:00
Yury Gaydaychuk 7ab92b5845
[CPU] Adaptive pooling implementation (#6594) 2021-07-29 20:41:24 +03:00
Gleb Kazantaev a3d9f00d98
Enable LinOpFusion To MO Backend (#6838) 2021-07-29 18:16:49 +03:00
Gleb Kazantaev 0a1cad52ab
Avoid Constant data copy inside Reshape constant folding (#6410)
* Avoid Constant data copy inside Reshape constant folding

* Fix Codestyle

* Updated Squeeze, Unsqueeze cf

* Deprecate set_data_shape method

* Fix Pruning
2021-07-29 17:51:25 +03:00
Egor Shulman ab8d046642
[CPU] NormalizeL2 - unsorted axes are not supported (#6602) 2021-07-29 17:30:38 +03:00
Xie Zhengtian 513a7504a6
[AUTO] Update Auto-device plugin selection logic (#6335)
* Update selecting device logic to support Myriad and VPUX for auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Update selecting logic in auto-device plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
2021-07-29 15:57:45 +03:00
Mikhail Nosov d65dbd1200
Fix Windows_2019 CI (#6854) 2021-07-29 14:55:33 +03:00
Alexey Lebedev 4c0c184d3f
[IE PYTHON] Release GIL in some functions (#6236)
* Release GIL in load_network

* release gil in infer, wait and get_idle_request_id

* release gil in read_network and IECore.__cinit__

* release GIL in properties

* Release GIL in infer_async

* Add test

* Fix test

* Fix test
2021-07-29 14:28:11 +03:00