Commit Graph

98 Commits

Author SHA1 Message Date
Alexander Suslov be5c755c32
migrate to new convert API (#21323) 2023-11-28 11:36:25 +04:00
Alexander Suslov 2a33f35c43
DOCS Update optimization docs with ov.save_model() instead of ov.serialize() (#20711)
* introduced ov.save_model(...) to the ptq code examples

* replied to comments

* fixed rendering

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-11-16 13:34:33 +01:00
Alexander Kozlov 0f260c2ccd
[DOC]: Added INT4 weight compression description (#20812)
* Added INT4 information into weight compression doc

* Added GPTQ info. Fixed comments

* Fixed list

* Fixed issues. Updated Gen.AI doc

* Applied comments

* Added additional infor about GPTQ support

* Fixed typos

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Update docs/optimization_guide/nncf/code/weight_compression_openvino.py

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>

* Applied changes

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/gen_ai.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Update docs/articles_en/openvino_workflow/model_optimization_guide/weight_compression.md

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Added table with results

* One more comment

---------

Co-authored-by: Nico Galoppo <nico.galoppo@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-11-08 10:17:57 +04:00
Maciej Smyk a999e870ae
Optimize Inference Restructure (#20231) 2023-10-05 15:33:36 +02:00
Maciej Smyk 492d475728
Model Optimization Guide Restructure (#20188) 2023-10-03 09:41:56 +02:00
Maciej Smyk e7435af7b0
Running Inference Restructure (#20195) 2023-10-03 09:41:44 +02:00
Maciej Smyk 98153f8be1
Workflow (#20181) 2023-10-02 14:11:57 +02:00
Maciej Smyk fb41324141
Update weight_compression.md (#20000) 2023-09-22 13:06:27 +02:00
Maciej Smyk bcb469ab19
19680 & 19849 (#19879) 2023-09-15 14:55:32 +02:00
Anastasia Kuporosova 2bf8d910f6
[Docs][PyOV] update python snippets (#19367)
* [Docs][PyOV] update python snippets

* first snippet

* Fix samples debug

* Fix linter

* part1

* Fix speech sample

* update model state snippet

* add serialize

* add temp dir

* CPU snippets update (#134)

* snippets CPU 1/6

* snippets CPU 2/6

* snippets CPU 3/6

* snippets CPU 4/6

* snippets CPU 5/6

* snippets CPU 6/6

* make  module TODO: REMEMBER ABOUT EXPORTING PYTONPATH ON CIs ETC

* Add static model creation in snippets for CPU

* export_comp_model done

* leftovers

* apply comments

* apply comments -- properties

* small fixes

* rempve debug info

* return IENetwork instead of Function

* apply comments

* revert precision change in common snippets

* update opset

* [PyOV] Edit docs for the rest of plugins (#136)

* modify main.py

* GNA snippets

* GPU snippets

* AUTO snippets

* MULTI snippets

* HETERO snippets

* Added properties

* update gna

* more samples

* Update docs/OV_Runtime_UG/model_state_intro.md

* Update docs/OV_Runtime_UG/model_state_intro.md

* attempt1 fix ci

* new approach to test

* temporary remove some files from run

* revert cmake changes

* fix ci

* fix snippet

* fix py_exclusive snippet

* fix preprocessing snippet

* clean-up main

* remove numpy installation in gha

* check for GPU

* add logger

* iexclude main

* main update

* temp

* Temp2

* Temp2

* temp

* Revert temp

* add property execution devices

* hide output from samples

---------

Co-authored-by: p-wysocki <przemyslaw.wysocki@intel.com>
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-09-13 21:05:24 +02:00
Karol Blaszczak 932ba63744
[DOCS] feature transition section (#19506)
* [DOCS] legacy features section

* pass 2 of extensions

* Apply suggestions from code review

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-09-09 20:30:51 +02:00
Maciej Smyk 3677dda457
[DOCS] 23.0 to 23.1 link update for master (#19584)
* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix

* 2023.1 link fix
2023-09-04 15:40:02 +02:00
Sebastian Golebiewski 1cf3fe96af
[DOCS] Improve NNCF workflow images (#19040)
* Update DEVELOPMENT_FLOW_V3_crunch.svg

* Update DEVELOPMENT_FLOW_V3_crunch.svg

* update

* Update DEVELOPMENT_FLOW_V3_crunch.svg

* Update DEVELOPMENT_FLOW_V3_crunch.svg

* Update DEVELOPMENT_FLOW_V3_crunch.svg

* Update docs/optimization_guide/model_optimization_guide.md
2023-08-31 14:00:31 +02:00
Sebastian Golebiewski 87f6e34a56
[DOCS] Improving code snippets for quantization (#19479)
* improve-snippets

* Apply suggestions from code review

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_tensorflow.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* update-path

* Update docs/optimization_guide/nncf/ptq/code/ptq_torch.py

---------

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>
2023-08-30 11:52:36 +02:00
Maciej Smyk e5c4350d92
[DOCS] Review release docs for master (#19152) 2023-08-14 13:40:34 +02:00
Stefania Hergane 24f8c4105e
[EISW-89824] [master] Rename VPUX to NPU (#19004)
* Change `VPUX`/`VPU` occurrences to `NPU`

* Switch `HARDWARE_AWARE_IGNORED_PATTERNS` VPU to NPU

* Rename `MYRIAD plugin`

* Rename vpu_patterns to npu_patterns in tools/pot

* Rename vpu.json to npu.json in tools/pot

* Rename restrict_for_vpu to restrict_for_npu in tools/pot

* Change keembayOptimalBatchNum to npuOptimalBatchNum

---------

Co-authored-by: Dan <mircea-aurelian.dan@intel.com>
2023-08-10 00:20:07 +04:00
Maciej Smyk 70e33469a8
Update model_optimization_guide.md (#18952) 2023-08-04 14:49:56 +02:00
Vitaliy Urusovskij f8f6d4a5b5
Note ONNX FE in `mem_optimization_guide.md` (#18777) 2023-07-27 10:42:35 +04:00
Tatiana Savina d829c8086d
basiq quantization flow changes (#18439) 2023-07-10 18:53:41 +02:00
Maciej Smyk 492bf497d7
[DOCS] Tab reorder for master (#18387)
* tabs-1

* Update configure_devices.md

* tab-2

* tab-order

* Update installing-openvino-from-archive-linux.md

* Update installing-openvino-from-archive-linux.md

* win-linux-fix

* Update GPU_Extensibility.md
2023-07-07 14:31:02 +02:00
Sebastian Golebiewski 152c9b63e2
[DOCS] Adding metadata to articles (#18331)
* adding-metadata

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

* Apply suggestions from code review

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-07-03 13:09:07 +02:00
Maciej Smyk a3e4a1f730
[DOCS] Table directive update + Get Started fix for master (#18203) 2023-06-23 16:47:28 +02:00
Mingyu Kim 0b06d15178
[docs] typo fix (#17915) 2023-06-08 10:27:26 +09:00
Tatiana Savina 0a94aeb1bb
[DOCS] Port release doc fixes (#17939)
* [DOCS]  Model optimization paragraph fix  (#17907)

* fix mo guide paragraph

* fix format

* fix paragraph

* remove extra line

* fix archive link (#17918)

* [DOCS]  Add sudo to uninstall (#17929)

* add sudo to uninstall

* Update uninstalling-openvino.md
2023-06-07 18:57:42 +02:00
Sebastian Golebiewski 6c287986b7
[DOCS] `convert_model()` as a default conversion path (#17454) 2023-05-31 17:53:22 +02:00
Maksim Proshin 2513db5a04
DOCS Update optimization docs with NNCF PTQ changes and deprecation of POT (#17398)
* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update home.rst

* Update ptq_introduction.md

* Update Introduction.md

* Update Introduction.md

* Update Introduction.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update model_optimization_guide.md

* Update ptq_introduction.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update quantization_w_accuracy_control.md

* Update model_optimization_guide.md

* Update Introduction.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update ptq_introduction.md

* Update Introduction.md

* Update model_optimization_guide.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update quantization_w_accuracy_control.md

* Update Introduction.md

* Update FrequentlyAskedQuestions.md

* Update model_optimization_guide.md

* Update Introduction.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update model_optimization_guide.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* added code snippet (#1)

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update model_optimization_guide.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update quantization_w_accuracy_control.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update basic_quantization_flow.md

* Update ptq_introduction.md

* Update ptq_introduction.md

* Delete ptq_introduction.md

* Update FrequentlyAskedQuestions.md

* Update Introduction.md

* Update quantization_w_accuracy_control.md

* Update introduction.md

* Update basic_quantization_flow.md code blocks

* Update quantization_w_accuracy_control.md code snippets

* Update docs/optimization_guide/nncf/ptq/code/ptq_torch.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update model_optimization_guide.md

* Optimization docs proofreading  (#2)

* images updated

* delete reminder

* review

* text review

* change images to original ones

* Update filter_pruning.md code blocks

* Update basic_quantization_flow.md

* Update quantization_w_accuracy_control.md

* Update images (#3)

* images updated

* delete reminder

* review

* text review

* change images to original ones

* Update filter_pruning.md code blocks

* update images

* resolve conflicts

* resolve conflicts

* change images to original ones

* resolve conflicts

* update images

* fix conflicts

* Update model_optimization_guide.md

* Update docs/optimization_guide/nncf/ptq/code/ptq_tensorflow.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_torch.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_onnx.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_aa_openvino.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* Update docs/optimization_guide/nncf/ptq/code/ptq_openvino.py

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>

* table format fix

* Update headers

* Update qat.md code blocks

---------

Co-authored-by: Alexander Suslov <alexander.suslov@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-05-19 14:36:22 +00:00
Maciej Smyk 568f0eb21b
[DOCS] Link adjustment for master (#17607) 2023-05-18 15:12:34 +00:00
Maciej Smyk 43acbf59b6
[DOCS] Precision Control article for master (#17413) 2023-05-17 11:54:48 +02:00
Vitaliy Urusovskij d99a5ab1ba
Prepare "memory_optimization_guide.md" (#17022)
* Prepare "memory_optimizing_guide.md"

* Modify `memory_optimization_guide.md`

* Add memory guide into toctree

* Rephrase memory_optimization_guide.md

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>

---------

Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
2023-05-11 14:23:36 +04:00
Karol Blaszczak 0c12ee6015
[DOCS] fix for copyright and trademark glyphs (#17021) 2023-04-20 14:11:16 +02:00
Vitaliy Urusovskij 016d36f032
Add `mmap` notes in dldt_depl_optimization_latency.md (#16682) 2023-04-03 12:10:12 +04:00
Sebastian Golebiewski f9ff518d16
DOCS shift to rst - `Model Optimization Guide` articles (#16598) 2023-03-31 11:26:04 +02:00
Sebastian Golebiewski 712d1b99d1
DOCS shift to rst - Post-training Quantization with NNCF (#16631) 2023-03-30 08:23:55 +02:00
Ilya Lavrenov 0250f62d11
Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Sebastian Golebiewski 2f69305aa3
DOCS shift to rst (#16445) 2023-03-22 09:41:59 +01:00
Sebastian Golebiewski 14e70e76fb
DOCS shift to rst - Further Low-Level Implementation Details (#16444) 2023-03-22 09:39:32 +01:00
Sebastian Golebiewski 083596e285
DOC shift to rst - Optimize Inference article group (#16382) 2023-03-20 12:43:04 +01:00
Sebastian Golebiewski 76e60ff258
DOCS shift to rst - Performance Hints (#16386) 2023-03-20 12:39:31 +01:00
Sebastian Golebiewski 1e757de195
[DOCS] shift to rst - OpenVINO Inference Request 2023-03-13 10:04:54 +01:00
Karol Blaszczak 670668e593
DOCS shift to rst - devices and ARM (#16193) 2023-03-10 09:25:33 +01:00
Sebastian Golebiewski bd3a392d84
[DOCS] 'Quantization-aware Training' article update (#15617) 2023-02-24 08:57:04 +01:00
Sebastian Golebiewski 28cfb988e7
[DOCS] 'Quantizing with accuracy control' article update (#15642) 2023-02-24 08:56:23 +01:00
Sebastian Golebiewski 7a465e2422
[DOCS] 'Basic Quantization Flow' article update (#15641) 2023-02-24 08:55:51 +01:00
Sebastian Golebiewski 5ae859b4f8
[DOCS] 'Filter Pruning of Convolutional Models' article update (#15616)
Prep for conversion to rst
2023-02-24 08:55:28 +01:00
Tatiana Savina f730edb084
[DOCS] Remove DL Workbench (#15733)
* remove dl wb docs

* text correction

* change ecosystem description

* replace link
2023-02-21 13:16:02 +00:00
Vladimir Paramuzov 2201a5f83e
Added common ov::execution_mode hint (#15048)
* [GPU] Added common exec mode hint and gpu support

* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property

* [GPU] Execution mode tests and fixes

* Fixed code style

* Moved execution_mode test to common. Fixes for python API

* Remove deprecations for hint::inference_precision and just keep both

* Fix test
2023-01-18 20:13:00 +04:00
Ilya Lavrenov c4eeecfec5
Remove myriad plugin (#15131)
* Removed Intel MYRIAD plugin

* Removed Intel MYIAD from CI files

* Removed Intel MYRIAD from cmake folder

* Removed MYRIAD, HDDL from samples

* Removed MYRIAD, HDDL from scripts folder

* Removed MYRIAD from bindings folder (C and Python API)

* Removed MYRIAD tests

* Removed MYRIAD from tests folder

* Removed MYRIAD from tools folder

* Removed HDDL (VAD), MYRIAD (NSC2) from documentation

* Fixed build for AUTO unit tests

* Fixed clang code style

* Fixed comments and issues

* removed MYRIAD from AUTO tests

* Disabled MULTI tests in CI

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/deployment/local-distribution.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-01-18 15:19:44 +04:00
Ilya Churaev 0c9abf43a9
Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Sebastian Golebiewski 3017c8d123
DOCS: Fixing broken links in documentation. (#14935) 2023-01-05 11:25:03 +04:00
Karol Blaszczak f31ebd4947
Release doc updates_port (#14784) 2023-01-04 11:12:11 +00:00