### Details:
- Continuation of https://github.com/openvinotoolkit/openvino/pull/24588
- Initialized "int-to-type" map with more clear "string-to-type" map
first, using `num()` value from constructed dtypes.
### Tickets:
- *...*
Updates the requirements on [h5py](https://github.com/h5py/h5py) to
permit the latest version.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="2c80981022"><code>2c80981</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2405">#2405</a> from
takluyver/rever-3.11</li>
<li><a
href="76afe10048"><code>76afe10</code></a>
Add HDF5 1.14.4 fixes to release notes</li>
<li><a
href="009047936d"><code>0090479</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2406">#2406</a> from
ajelenak/libhdf5-1.14.4</li>
<li><a
href="0f071a4d64"><code>0f071a4</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2407">#2407</a> from
h5py/dependabot/github_actions/actions-45223d3826</li>
<li><a
href="944a4a6967"><code>944a4a6</code></a>
Bump peaceiris/actions-gh-pages from 3 to 4 in the actions group</li>
<li><a
href="8f513ced5e"><code>8f513ce</code></a>
Clean up release notes</li>
<li><a
href="62bd813202"><code>62bd813</code></a>
Rename new whatsnew file, add to index</li>
<li><a
href="9c305e23ce"><code>9c305e2</code></a>
Updated CHANGELOG for 3.11.0</li>
<li><a
href="9e107c4a78"><code>9e107c4</code></a>
bumped version to 3.11.0</li>
<li><a
href="71af64dec8"><code>71af64d</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2360">#2360</a> from
loichuder/visit-links</li>
<li>Additional commits viewable in <a
href="https://github.com/h5py/h5py/compare/3.1.0...3.11.0">compare
view</a></li>
</ul>
</details>
<br />
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
</details>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
### Details:
- *Add patch function to make 16bit models traceable. This reduce memory
consumption and time spent during conversion of models that are natively
saved in 16bit precision*
### Tickets:
- *CVS-136828*
### Details:
- Extended stateful API to CompiledModel class to allow working on
underlaying InferRequest.
- Added test cases and refactored them.
### Tickets:
- CVS-139972
With this change, users don't have to add "import openvino.torch" in
their applications. Providing torch.compile(model, backend="openvino")
automatically imports the necessary modules. This simplifies the user
experience and enables PT2 based benchmarking OOB without any changes. .
More information can be found here:
https://github.com/pytorch/pytorch/pull/124536
JIRA: CVS-139370
---------
Co-authored-by: Surya Siddharth Pemmaraju <surya.siddharth.pemmaraju@intel.com>
Updates the requirements on
[pytest](https://github.com/pytest-dev/pytest) to permit the latest
version.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/pytest-dev/pytest/releases">pytest's
releases</a>.</em></p>
<blockquote>
<h2>8.2.0</h2>
<h1>pytest 8.2.0 (2024-04-27)</h1>
<h2>Deprecations</h2>
<ul>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/12069">#12069</a>:
A deprecation warning is now raised when implementations of one of the
following hooks request a deprecated <code>py.path.local</code>
parameter instead of the <code>pathlib.Path</code> parameter which
replaced it:</p>
<ul>
<li><code>pytest_ignore_collect</code>{.interpreted-text
role="hook"} - the <code>path</code> parameter - use
<code>collection_path</code> instead.</li>
<li><code>pytest_collect_file</code>{.interpreted-text
role="hook"} - the <code>path</code> parameter - use
<code>file_path</code> instead.</li>
<li><code>pytest_pycollect_makemodule</code>{.interpreted-text
role="hook"} - the <code>path</code> parameter - use
<code>module_path</code> instead.</li>
<li><code>pytest_report_header</code>{.interpreted-text
role="hook"} - the <code>startdir</code> parameter - use
<code>start_path</code> instead.</li>
<li><code>pytest_report_collectionfinish</code>{.interpreted-text
role="hook"} - the <code>startdir</code> parameter - use
<code>start_path</code> instead.</li>
</ul>
<p>The replacement parameters are available since pytest 7.0.0.
The old parameters will be removed in pytest 9.0.0.</p>
<p>See <code>legacy-path-hooks-deprecated</code>{.interpreted-text
role="ref"} for more details.</p>
</li>
</ul>
<h2>Features</h2>
<ul>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/11871">#11871</a>:
Added support for reading command line arguments from a file using the
prefix character <code>@</code>, like e.g.: <code>pytest
@tests.txt</code>. The file must have one argument per line.</p>
<p>See <code>Read arguments from file
<args-from-file></code>{.interpreted-text role="ref"}
for details.</p>
</li>
</ul>
<h2>Improvements</h2>
<ul>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/11523">#11523</a>:
<code>pytest.importorskip</code>{.interpreted-text
role="func"} will now issue a warning if the module could be
found, but raised <code>ImportError</code>{.interpreted-text
role="class"} instead of
<code>ModuleNotFoundError</code>{.interpreted-text
role="class"}.</p>
<p>The warning can be suppressed by passing
<code>exc_type=ImportError</code> to
<code>pytest.importorskip</code>{.interpreted-text
role="func"}.</p>
<p>See <code>import-or-skip-import-error</code>{.interpreted-text
role="ref"} for details.</p>
</li>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/11728">#11728</a>:
For <code>unittest</code>-based tests, exceptions during class cleanup
(as raised by functions registered with <code>TestCase.addClassCleanup
<unittest.TestCase.addClassCleanup></code>{.interpreted-text
role="meth"}) are now reported instead of silently
failing.</p>
</li>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/11777">#11777</a>:
Text is no longer truncated in the <code>short test summary info</code>
section when <code>-vv</code> is given.</p>
</li>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/12112">#12112</a>:
Improved namespace packages detection when
<code>consider_namespace_packages</code>{.interpreted-text
role="confval"} is enabled, covering more situations (like
editable installs).</p>
</li>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/9502">#9502</a>:
Added <code>PYTEST_VERSION</code>{.interpreted-text
role="envvar"} environment variable which is defined at the
start of the pytest session and undefined afterwards. It contains the
value of <code>pytest.__version__</code>, and among other things can be
used to easily check if code is running from within a pytest run.</p>
</li>
</ul>
<h2>Bug Fixes</h2>
<ul>
<li>
<p><a
href="https://redirect.github.com/pytest-dev/pytest/issues/12065">#12065</a>:
Fixed a regression in pytest 8.0.0 where test classes containing
<code>setup_method</code> and tests using <code>@staticmethod</code> or
<code>@classmethod</code> would crash with <code>AttributeError:
'NoneType' object has no attribute 'setup_method'</code>.</p>
<p>Now the <code>request.instance
<pytest.FixtureRequest.instance></code>{.interpreted-text
role="attr"} attribute of tests using
<code>@staticmethod</code> and <code>@classmethod</code> is no longer
<code>None</code>, but a fresh instance of the class, like in non-static
methods.</p>
</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="6bd3f31344"><code>6bd3f31</code></a>
Tweak changelog for 8.2.0</li>
<li><a
href="9b6219b5e8"><code>9b6219b</code></a>
Prepare release version 8.2.0</li>
<li><a
href="835765c9d3"><code>835765c</code></a>
Merge pull request <a
href="https://redirect.github.com/pytest-dev/pytest/issues/12130">#12130</a>
from bluetech/fixtures-inline</li>
<li><a
href="7e7503c0b0"><code>7e7503c</code></a>
unittest: report class cleanup exceptions (<a
href="https://redirect.github.com/pytest-dev/pytest/issues/12250">#12250</a>)</li>
<li><a
href="882c4da2f3"><code>882c4da</code></a>
fixtures: inline <code>fail_fixturefunc</code></li>
<li><a
href="2e8fb9f140"><code>2e8fb9f</code></a>
fixtures: extract a <code>_check_fixturedef</code> method</li>
<li><a
href="acf2971f46"><code>acf2971</code></a>
fixtures: inline <code>_getnextfixturedef</code> into
<code>_get_active_fixturedef</code></li>
<li><a
href="3c77aec1da"><code>3c77aec</code></a>
fixtures: move "request" check early</li>
<li><a
href="d217d68cde"><code>d217d68</code></a>
fixtures: inline <code>_compute_fixture_value</code></li>
<li><a
href="530be28575"><code>530be28</code></a>
fixtures: use early return in <code>_get_active_fixturedef</code></li>
<li>Additional commits viewable in <a
href="https://github.com/pytest-dev/pytest/compare/5.0.0...8.2.0">compare
view</a></li>
</ul>
</details>
<br />
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
</details>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [paddlepaddle](https://github.com/paddlepaddle/paddle) from 2.5.2
to 2.6.0.
Paddle 2.6 removed many apis in "fluid". There are bound to be a lot of
bugs that the api won't find. We can change paddle.fluid to paddle.base
for error cases. This will fix most of the problems.
The PR mainly fixes the following problems:
- fix build errors during api names changed
- fix test errors during op output changed
### Tickets:
- Closes https://github.com/openvinotoolkit/openvino/pull/21867
---------
Co-authored-by: mei, yang <yang.mei@intel.com>
**Details:** Fix h5py issue in GHA test jobs: `error: libhdf5.so: cannot
open shared object file: No such file or directory`
**Ticket:** TBD
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
### Details:
Ported SDPA to PagedAttention transformation from python to C++ code.
the related PRs:
https://github.com/openvinotoolkit/openvino/pull/24127https://github.com/openvinotoolkit/openvino/pull/24177
Tested model scope:
- [x] "hf-internal-testing/tiny-random-BloomForCausalLM",
- [x] "hf-internal-testing/tiny-random-FalconForCausalLM",
- [x] "hf-internal-testing/tiny-random-Starcoder2ForCausalLM",
- [x] "hf-internal-testing/tiny-random-GPTJForCausalLM",
- [x] "hf-internal-testing/tiny-random-StableLmForCausalLM",
- [x] "hf-internal-testing/tiny-random-LlamaForCausalLM",
- [x] "hf-internal-testing/tiny-random-MistralForCausalLM",
- [x] "hf-internal-testing/tiny-random-OPTForCausalLM",
- [x] "hf-internal-testing/tiny-random-PhiForCausalLM",
- [x] "hf-internal-testing/tiny-random-StableLmForCausalLM",
- [x] "facebook/opt-125m",
- [x] "llama2",
- [x] "bigcode/starcoder2-7b"
- [ ] "mosaicml/mpt-7b-chat" (FAILED both py/c++) - acceptable for this
PR
Issue: RuntimeError: Check '(axis_range_min <= axis) && (axis <=
axis_range_max)' failed at src/core/src/validation_util.cpp:386:
Concat Parameter axis 2 out of the tensor rank range [0, 0].
- [x] _means, that the response to the dedicated prompt is the same for
the py and c++ transformations._
### Tickets:
- *CVS-138664*
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: Andrii Staikov <andrii.staikov@intel.com>
### Details:
- adding new struct for PCI information (aligned with GPU)
- adding new property to query PCI information (as a RO metric)
- implement query of pci information from driver in zero_device, with
backwards compatibility
### Tickets:
[ - *ticket-id*](https://jira.devtools.intel.com/browse/CVS-138767)
Updates the requirements on
[flake8-builtins](https://github.com/gforcada/flake8-builtins) to permit
the latest version.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/gforcada/flake8-builtins/blob/main/CHANGES.rst">flake8-builtins's
changelog</a>.</em></p>
<blockquote>
<h2>2.5.0 (2024-04-09)</h2>
<ul>
<li>Support detecting a shadowing folder as module name (as part of
<code>A005</code>).
[asfaltboy]</li>
</ul>
<h2>2.4.0 (2024-04-01)</h2>
<ul>
<li>Add rule for lambda argument shadowing (<code>A006</code>).
[cielavenir]</li>
</ul>
<h2>2.3.0 (2024-03-29)</h2>
<ul>
<li>Add rule for builtin module name shadowing (<code>A005</code>).
[asfaltboy]</li>
</ul>
<h2>2.2.0 (2023-11-03)</h2>
<ul>
<li>Use <code>tox</code> and <code>pre-commit</code> to ease project
maintenance.
[gforcada]</li>
</ul>
<h2>2.2.0a0 (2023-11-01)</h2>
<ul>
<li>
<p>Drop python 3.7 support.
[gforcada]</p>
</li>
<li>
<p>Test pre-release of python 3.12.
[gforcada]</p>
</li>
<li>
<p>Use <code>pyproject.toml</code> rather than <code>setup.py</code>.
[gforcada]</p>
</li>
<li>
<p>Switch from <code>setuptools</code> to <code>hatchling</code>.
[gforcada]</p>
</li>
<li>
<p>Add rule for import shadowing (<code>A004</code>).
[felixvd]</p>
</li>
<li>
<p>Switch to <code>main</code> branch.
[gforcada]</p>
</li>
</ul>
<h2>2.1.0 (2022-12-23)</h2>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="ab45f4d565"><code>ab45f4d</code></a>
Preparing release 2.5.0</li>
<li><a
href="3890afbd5e"><code>3890afb</code></a>
Merge pull request <a
href="https://redirect.github.com/gforcada/flake8-builtins/issues/125">#125</a>
from asfaltboy/ps/import-a005-module-dir</li>
<li><a
href="b46b4d7b80"><code>b46b4d7</code></a>
chore: add change note for shadow dir module</li>
<li><a
href="74588e17d8"><code>74588e1</code></a>
feat(A005): support detecting a shadowing folder</li>
<li><a
href="5b6dbffe32"><code>5b6dbff</code></a>
Back to development: 2.4.1</li>
<li><a
href="90cd95b0db"><code>90cd95b</code></a>
Preparing release 2.4.0</li>
<li><a
href="19e04fab10"><code>19e04fa</code></a>
fix: revert release date</li>
<li><a
href="7793730ebf"><code>7793730</code></a>
chore: black</li>
<li><a
href="116ce7b766"><code>116ce7b</code></a>
Merge pull request <a
href="https://redirect.github.com/gforcada/flake8-builtins/issues/123">#123</a>
from cielavenir/raiseA002ForLambda</li>
<li><a
href="8702675502"><code>8702675</code></a>
update changes</li>
<li>Additional commits viewable in <a
href="https://github.com/gforcada/flake8-builtins/compare/0.1...2.5.0">compare
view</a></li>
</ul>
</details>
<br />
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
</details>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
### Details:
- *Add ScatterNDUpdate-15 to PyAPI*
- *Parametrize to test both ScatterND versions + add test for reduce
attribute*
### Tickets:
- *111092*
---------
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
### Details:
- *Extended the calls to as_node and as_nodes with the name parameter in
all the opsets.*
- *Added tests for the involved operations.*
### Tickets:
- #24030
- part of
[CVS-133139](https://jira.devtools.intel.com/browse/CVS-133139)
### Details:
Numpy started preparation to release 2.0 version.
It brings many breaking changes listed below.
Align with these changes it's a plan for further development
(CVS-138766), for today we want to secure users against unintentional
installation of 2.x version of numpy with OV.
This PR has to be ported for 2024/1 branch
- Preparing to restrict OV to not use release of Numpy 2.0 which may
introduce many breaking changes including:
- required bump of `pybind` to 2.12+
- API and namespaces clean-ups and deprecations
- behavior changes of keywords such as `copy`
- changes to existing and introduction of new dtypes (such as
`StringDType` and possibility of adding custom ones)
- more can be found here:
https://numpy.org/devdocs/release/2.0.0-notes.html
- and here:
https://numpy.org/devdocs/numpy_2_0_migration_guide.html#numpy-2-migration-guide
### Tickets:
- CVS-138838
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
### Details:
- Constant's function `get_data` is extended to provide both copy and
view of the data.
- `get_data` can now cast date to desired dtype.
- Added testcases.
Example:
```python
In [1]: import openvino as ov
In [2]: import numpy as np
In [3]: arr = np.array([1.0, 1012.5, 0.0, 0.1, 0.5], dtype=np.float32)
In [4]: c = ov.runtime.opset13.constant(arr, dtype=np.float32)
In [5]: c.get_data(dtype=np.bool_)
Out[5]: array([ True, True, False, True, True])
In [6]: c = ov.runtime.opset13.constant(arr, dtype=ov.Type.bf16)
In [7]: c.get_data(dtype=np.float32)
Out[7]:
array([1.0000000e+00, 1.0120000e+03, 0.0000000e+00, 9.9609375e-02,
5.0000000e-01], dtype=float32)
In [8]: c.get_data(dtype=np.float32, copy=False)
Out[8]:
array([1.0000000e+00, 1.0120000e+03, 0.0000000e+00, 9.9609375e-02,
5.0000000e-01], dtype=float32)
```
### Tickets:
- CVS-129930
- CVS-127292
### Details:
- Removed internal conversion of all typed passed to `convert_model()`
to `np.dtype`, as some types do not have `numpy` analogs, which causes
errors. Also this step is redundant as we can use `ov.Type` instead.
### Tickets:
- 138755
### Details:
- Limit NF4 conversion to FP16 -> NF4 in convert operator as values are
correctly quantized, Not support NF4 conversion to/from other types.
### Tickets:
- [CVS-135304](https://jira.devtools.intel.com/browse/CVS-135304)
### Details:
- Automatically adding the node name to all autogenerated constants.
Example: `NodeName/Constant_X`
- Removed `apply_affix_on` approach.
- Adjusted testcases to check compatibility.
- The change is backward incompatible -- breaking cases unknown.
- To be added: extend other operations `as_node/as_nodes` to follow this
example, as this approach is not automatically applicable.
### Tickets:
- CVS-133139
---------
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
### Details:
- Initialization of OV Opset15
(Discussed internally and agreed to introduce new opset in 2024.2)
To provide more agile approach, this PR has been updated with an idea
(proposed by @mmikolajcz) to include only new operators within the new
Opset, and fill it up at the end of the development period (not
necessarily per release).
This should lead to infrequent introduction of further opsets.
\* Currently common opsets tests rely on Parameter/ShapeOf/Convert in
every opset, so they were added.
But this approach for opset testing should be revised.
### Tickets:
- 138268, 131683
### Details:
- *The PR adds RISCV64 arch for python wheel setup to fix the following
error during build on the target machine:*
```
[100%] Building Python wheel
openvino-2024.2.0-14978-cp310-cp310-manylinux_2_36_riscv64.whl
Processing /home/sipeed/openvino/openvino/src/bindings/python/wheel
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [6 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File
"/home/sipeed/openvino/openvino/src/bindings/python/wheel/setup.py",
line 50, in <module>
OV_RUNTIME_LIBS_DIR = os.getenv("OV_RUNTIME_LIBS_DIR",
f"runtime/{LIBS_DIR}/{ARCH}/{CONFIG}")
NameError: name 'ARCH' is not defined
[end of output]
note: This error originates from a subprocess, and is likely not a
problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
make[2]: ***
[src/bindings/python/wheel/CMakeFiles/ie_wheel.dir/build.make:177:
wheels/openvino-2024.2.0-14978-cp310-cp310-manylinux_2_36_riscv64.whl]
Error 1
make[1]: *** [CMakeFiles/Makefile2:2841:
src/bindings/python/wheel/CMakeFiles/ie_wheel.dir/all] Error 2
make: *** [Makefile:156: all] Error 2
```
### Tickets:
- *N/A*
PagedAttention operation exposed in Python API only for easier vLLM
openvino integration. It is not intended to be used outside our
integration work in vLLM and similar applications where we can use
PagedAttention. Exposed as a hidden part of API, will not be documented.
Connected to already existing implementation in CPU plugin.
Operation is not a part of any public opset.
### Details:
- Edited and overloaded the __getitem__ operation for `Shape` and
`PartialShape`
- Added tests for correct the implementation
### Tickets:
- 75641
- #21968
---------
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>
### Details:
- Support LLM inference
|device|
|--|
|HETERO:CPU|
|HETERO:GPU|
|HETERO:CPU,GPU|
|HETERO:GPU,CPU|
|HETERO:GPU.0,GPU.1|
|HETERO:GPU.0,GPU.1,CPU|
|HETERO:GPU.0,GPU.1,GPU.2|
- Use the `ov::hint::model_distribution_policy` property in
[PR23077](https://github.com/openvinotoolkit/openvino/pull/23077/)
- Use host memory in different subgraphs when input/output data exchange
- Mask supported nodes and unsupported nodes to Subgraph in graph, and
query model use subgraph, keep the model in query_model same as compile
- Add a property `ov::query_model_ratio` to set the percentage of the
model can be queried during query model
- Improve performance on some LLM with large parameter by split the
model to different devices, the number of split models should be
smaller, reduce communication usage between multiple devices
### Tickets:
- *CVS-133258*
---------
Co-authored-by: Nadezhda <nadezhda.ageeva@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
Co-authored-by: yanlan song <bell.song@intel.com>
Przemyslaw Wysocki