* applying reviewrs comments
* fixed refs, more structuring (bold, bullets, etc)
* refactoring tput/latency sections
* next iteration (mostly latency), also brushed the auto-batching and other sections
* updates sync/async images
* common opts brushed
* WIP tput redesigned
* minor brushing of common and auto-batching
* Tput fully refactored
* fixed doc name in the link
* moved int8 perf counters to the right section
* fixed links
* fixed broken quotes
* fixed more links
* add ref to the internals to the TOC
* Added a note on the batch size
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
* Brushed the general optimization page
* Opt GUIDE, WIP
* perf hints doc placeholder
* WIP
* WIP2
* WIP 3
* added streams and few other details
* fixed titles, misprints etc
* Perf hints
* movin the runtime optimizations intro
* fixed link
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* some details on the FIL and other means when pure inference time is not the only factor
* shuffled according to general->use-case->device-specifics flow, minor brushing
* next iter
* section on optimizing for tput and latency
* couple of links to the features support matrix
* Links, brushing, dedicated subsections for Latency/FIL/Tput
* had to make the link less specific (otherwise docs compilations fails)
* removing the Temp/Should be moved to the Opt Guide
* shuffled the tput/latency/etc info into separated documents. also the following docs moved from the temp into specific feature, general product desc or corresponding plugins
- openvino_docs_IE_DG_Model_caching_overview
- openvino_docs_IE_DG_Int8Inference
- openvino_docs_IE_DG_Bfloat16Inference
- openvino_docs_OV_UG_NoDynamicShapes
* fixed toc for ov_dynamic_shapes.md
* referring the openvino_docs_IE_DG_Bfloat16Inference to avoid docs compilation errors
* fixed main product TOC, removed ref from the second-level items
* reviewers remarks
* reverted the openvino_docs_OV_UG_NoDynamicShapes
* reverting openvino_docs_IE_DG_Bfloat16Inference and openvino_docs_IE_DG_Int8Inference
* "No dynamic shapes" to the "Dynamic shapes" as TOC
* removed duplication
* minor brushing
* Caching to the next level in TOC
* brushing
* more on the perf counters ( for latency and dynamic cases)
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update md files. Add cpp in docs/examples
* Normalize all the line endings
* Fix block_id in snippets
* Fix utf-8 encoding
* Add new folder for snippets
* Fix issues with compiling code from snippets
* Added conteiner iterator fix
Maxim Shevtsov