Commit Graph

6 Commits

Author SHA1 Message Date
Anton Romanov f5528a7d98
small refactor samples setBatchSize (#3053)
* small refactor samples setBatchSize
2020-11-16 17:20:54 +03:00
Rafik Saliev d225ba6e53
[IE] Add batched blob support (#2203)
* [IE] Add batched blob support

New `class BatchedBlob : public CompoundBlob` defined to allow to pass multiple blobs as 1 InferRequest input.

Motivation: There is the special user case when a number of plain images (e.g. `NV12Blob`) should be passed as one input for network which batch size > 1.

`class CompoundBlob` is not applicable for such cases due to:
1. `NV12Blob` is `CompoundBlob` which prevents to combine multiple NV12 images to a CompoundBlob
2. The default behavior in most of plugins - do not accept generic CompoundBlob as `SetBlob()` argument

Adding `SetBlob(name, vector<Blob::Ptr>...)` to `class IInferRequest`, `class InferRequest`, `class IInferRequestInternal`, ...  - is not effective solution due to limited and specific use cases for `batched inputs`.

+ Apply rule-of-zero to CompoundBlob and inherited classes.

* Add "BATCHED_BLOB" optimization capability metric

* Add BatchedBlob usage to hello_nv12_input_classification

* Apply offline code review outcome:

1. Revert CompoundBlob public .ctors signatures
2. Remove 'workaround' .ctor for `BatchedBlob`
3. Revert tensor descriptors of `I420Blob` `NV12Blob` back to the 'fake' value.

* Code review fix

* Add functional tests for CPU, GPU, MULTI, HETERO

* update doc comment

* Apply code review change requests.
2020-11-03 21:19:26 +03:00
Mikhail Ryzhov 7859aab4b0
Modified samples to support ONNX models (#1680)
* Modified samples to support ONNX models

- Removed manual loading of IR .bin files (hello_classification, object_detection_sample_ssd)
- Corrected comments
- Added Note in README files

* Modified samples to support ONNX models

- Removed manual loading of IR .bin files (hello_classification, object_detection_sample_ssd)
- Corrected comments
- Added Note in README files
2020-08-26 18:53:24 +03:00
Ilya Lavrenov 17e457d7c8
Updated inference_engine.hpp (#1539) 2020-07-30 18:40:28 +03:00
Alexey Suhov b2140c083a Publishing 2020.1 content 2020-02-11 22:48:49 +03:00
Alexey Suhov ba6e22b1b5 Publishing 2019 R2 content (#223) 2019-08-09 19:02:42 +03:00