Commit Graph

15501 Commits

Author SHA1 Message Date
Ilya Lavrenov 3ca4919219
Set _GLIBCXX_USE_CXX11_ABI globally in OV cmake (#24657)
### Details:
- It can be useful when other targets within user project need to be
linked with _GLIBCXX_USE_CXX11_ABI=0
2024-05-23 20:33:10 +00:00
Andrei Kashchikhin f028ecf0f7
[CI] [GHA] Investigate and mitigate Mac workflows (#24631)
### Tickets:
 - *142049*
2024-05-23 19:58:53 +00:00
Vladislav Denisov 8d99a63f6d
[GoodFirstIssue][OP CONFORMANCE][TEMPLATE] Added static shape generator for dynamic shapes (#24125)
### Details:
 - Added generator of static shapes based on an operation type.

### Tickets:
 - https://github.com/openvinotoolkit/openvino/issues/23551
2024-05-23 17:59:34 +00:00
Wang Wangwang 80237bf292
Revert "[DOCS] Update the document of HETERO pipeline parallelism" (#24644)
This reverts commit 03aad66230.

### Details:
Revert the commit because there are some models with stateful OPS
(assign/readvalue) not in same attention node, hetero pipeline
parallelism does not work.

### Tickets:
 - *CVS-141771*
2024-05-23 13:45:38 +00:00
Ilya Lavrenov fc6af4f4af
Use system TBB by default for Deb, RPM (#24613)
### Details:
 - Otherwise, currently users have error during Debian package build
2024-05-23 12:40:05 +00:00
Michal Miotk f2fdb4bd1d
[GPU] fix for mixing types in permute_f_y (#24648)
### Details:
 - fix mixing IN and OUT vec type

### Tickets:
 - 140728
2024-05-23 11:49:27 +00:00
Yuan Hu 1a4ae5e7a3
[core] fix thread safe issue in #19832 (#24562)
### Details:
- *I lost code `t_stream_count_map[(void*)this] = item.first;` in
#19832*
 - *the thread safe issue happen in below workflow*
 - create thread A
call CustomThreadLocal:local() in thread A -> create stream A (the count
of stream A is 2)
   destory thread A (the count of stream A is 1)
   create thread B (same thread id with thread A)
call CustomThreadLocal:local() in thread B -> use stream A(the count of
stream A is 1, so it's broken)
- *add testcase, also fix
https://github.com/openvinotoolkit/openvino/pull/19986/files#r1332774754*

### Tickets:
 - Closes https://github.com/openvinotoolkit/openvino/issues/24509

---------

Signed-off-by: HU Yuan2 <yuan2.hu@intel.com>
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2024-05-23 11:47:57 +00:00
Mircea-Aurelian Dan c0853f0f2f
Upstream NPU behavior tests (#24552)
### Details:
- By this PR we want to create `ov_npu_func_tests` executable having
functional tests from `NPU plugin` (SLTs and Subgraphs to be added
later).
- Functional tests were copy-pasted to <code><a
href="https://github.com/openvinotoolkit/openvino/compare/master...MirceaDan99:openvino:EISW-120273/original/copy_npu_func_tests_to_ov">EISW-120273/original/copy_npu_func_tests_to_ov</a></code>
branch to review changes easier at:
d4f0300e1b..7b7e177f11
- Latest validation is:
https://vpux-ci-vpuip.ir.intel.com/job/ov_integration/job/ov_integration/1167/

### Tickets:
 - *E-120273*
2024-05-23 11:28:53 +00:00
Mustafa Cavus 4b8641ee3f
Added quantized_decomposed quantization unit tests (#24388)
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: Surya Siddharth Pemmaraju <surya.siddharth.pemmaraju@intel.com>
Co-authored-by: Yamini Nimmagadda <yamini.nimmagadda@intel.com>
2024-05-23 10:15:11 +00:00
Tatiana Savina f9c039418c
[DOCS] Direct to Python tab in the ovc transition guide (#24624)
### Details:
 - *item1*
 - *...*

### Tickets:
 - 140454
2024-05-23 09:20:04 +00:00
Alicja Miloszewska 16005894f9
[OV JS] Add method descriptions of CompiledModel (#24571)
### Details:
 - Add method descriptions to *lib/addon.ts* 

### Tickets:
 - *141291*

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-05-23 08:25:03 +00:00
Przemyslaw Wysocki c4f33cec55
[PyOV] Extend Python API with `Col2Im-15` (#24569)
### Details:
 - Add Python API for `Col2Im-15`
- Requires https://github.com/openvinotoolkit/openvino/pull/24548 to
work and pass CI

### Tickets:
 - CVS-138920

### Related PRs:
- https://github.com/openvinotoolkit/openvino/pull/24548
- https://github.com/openvinotoolkit/openvino/pull/24197
- https://github.com/openvinotoolkit/openvino/pull/23947

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-05-23 07:51:22 +00:00
Ilya Lavrenov 3bbb35cea6
Revert "[PyOV] Reenable test_cancel" (#24639)
Reverts openvinotoolkit/openvino#24590

Sporadically fails
https://github.com/openvinotoolkit/openvino/actions/runs/9189693102/job/25273009310

Looks like tests relies on certain execution time of model inference,
while it depends on machine
2024-05-23 07:41:09 +00:00
Vladimir Paramuzov 23d487bdfb
[GPU] Allow signed int8 for WOQ (#24620)
### Details:
 - Add i8 data type to list of supported dequantization types for woq

### Tickets:
 - *CVS-131044*
2024-05-23 07:07:09 +00:00
Tomasz Jankowski 9ec1c4a1fe
[Tmpl test] Preprocess: Drop legacy comparison (#24622)
### Details:
 - Fixed tensors' shapes.

### Tickets:
 - CVS-137216
2024-05-23 06:39:43 +00:00
awayzjj d0e6f8ffea
Implement CPU plugin just-in-time emitter for Mod operation (#24574)
Closes https://github.com/openvinotoolkit/openvino/issues/24061
### Details:
 - Mod operation

### Tickets:
 - [CVS-137689](https://jira.devtools.intel.com/browse/CVS-137689)
2024-05-23 06:24:18 +00:00
Attila Csok 00ef5c9a07
[intel-npu] removing cpu_pinning string from CID command string (#24566)
### Details:
- removing ENABLE_CPU_PINNING from command string passed to CiD, for
older compiler versions to enable backwards compatibility

### Tickets:
 - EISW-124233
2024-05-23 06:05:46 +00:00
Inbasekaran Perumal 9025003860
Align behavior of ONNX Frontend function ReduceSumSquare-11, 13, 18 with original framework (#23798)
Hello maintainers,

Since my previous PR
(https://github.com/openvinotoolkit/openvino/pull/22993#issue-2146681772)
had diverged significantly from the master branch, and also included
additional changes, I thought it would be best to create a new PR.
@gkrivor, could you please take a look?

This closes
https://github.com/openvinotoolkit/openvino/issues/20563#issue-1949590592.

---------

Co-authored-by: Georgy Krivoruchko <georgy.krivoruchko@intel.com>
2024-05-23 03:39:30 +00:00
Wang, Yang c904b8e182
[AUTO] Load cached model to target device W/O CPU accelerating (#24618)
### Details:
- update logic of only loading cached model to GPU with AUTO if GPU
cached blob exists and `ov::intel_auto::enable_startup_fallback` is
enable

### Tickets:
 - CVS-138574
2024-05-23 02:02:46 +00:00
Andrew Kwangwoong Park 4b0868c98a
[GPU] Apply dynamic padding for onednn gemm (#24605)
### Details:
 - Apply dynamic padding for onednn gemm
 - Update memory descriptor to handle the padded dims and strides

### Tickets:
 - 140516

---------

Signed-off-by: Andrew Park <andrew.park@intel.com>
2024-05-22 21:06:26 +00:00
Ilya Lavrenov 50b731639a
Added -Wno-stringop-overflow for GPU unit tests as well (#24638)
### Details:
- The same https://github.com/openvinotoolkit/openvino/pull/24628 for
GPU Unit tests
2024-05-22 20:35:41 +00:00
Andrei Kashchikhin 8c5b357135
[CI] [GHA] Add Dockerfile for U20 and use it in the `Build` job in Linux workflow (#24573)
### Tickets:
 - *141573*
2024-05-22 18:27:43 +00:00
Andrzej Kopytko ef6ca0a13d
[Docs] Page styling (#24637)
another part
2024-05-22 18:27:22 +00:00
Tomasz Jankowski 6f7cf28847
[Tmpl test] ExperimentalDetectronPriorGridGenerator: Drop legacy comparison (#24592)
### Details:
- Removed 'actual comparison size' parameter from base template test
class `CommonReferenceTest`.
- Moved partial comparison logic to
`ReferenceExperimentalPGGLayerTest::Validate()` - it's needed only in
this test.

### Tickets:
 - CVS-137159
2024-05-22 17:17:04 +00:00
Vladislav Golubev 0eab4efffa
[CPU] Avoid overflow in GatherDecompression builders, enable tests (#24629) 2024-05-22 15:40:52 +00:00
Alina Kladieva b014776bf4
[GHA] Checkout the latest OneDNN for GPU in nightly (#24534)
### Tickets:
 - CVS-139627
2024-05-22 14:57:06 +00:00
Luo Cheng f400fe5d87
[CPU] Fix segment fault for PagedAttention when head size is multiple of 16 (#24627)
### Details:
- *Fix segment fault for PagedAttention when head size is multiple of
16*
 - *...*

### Tickets:
 - *ticket-id*
2024-05-22 14:49:39 +00:00
Mustafa Cavus 87f25aa14b
Torchfx dynamic shapes initial (CVS-139182) (#24578)
### Details:
 - Enabling dynamic shapes with aot_autograd

### Tickets:
 - CVS-139182

---------

Co-authored-by: Przemyslaw Wysocki <przemyslaw.wysocki@intel.com>
2024-05-22 14:04:16 +00:00
Maciej Smyk 0cd4710321
[DOCS] Assets move - images for master (#24621)
Jira: 138084

Moving image assets closer to the source files.
2024-05-22 14:00:50 +00:00
Katarzyna Mitrus 00856cdcb2
[Op][Internal] Reference implementation for internal::RMS op (#24556)
### Details:
- Reference implementation and ref tests for
[internal::RMS](70142121c1/src/common/transformations/include/ov_ops/rms.hpp)
(moved from gpu custom ops) available for common transformations
 - Enable Accuracy tests for RMSFusion transformation
 
 The changes moving RMS from gpu to internal are from PR:
 -  #24539 (to be merged first)
 
 Internal RMS op docs:
- https://github.com/openvinotoolkit/openvino/pull/24564

 ### Tickets:
 - Related to 136262

---------

Co-authored-by: michal-miotk <michal.miotk@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-05-22 13:32:47 +00:00
Daniil Lyakhov 58e6ba6a85
PyTorch QAT to PTQ documentation update (#24363)
### Details:
QAT documentation for NNCF Torch and NNCF Tensorflow is spitted on two
pages

* quantization-aware-training-pytorch.rst is QAT by `nncf.quantize`
method documentation
* quantization-aware-training-tensorflow.rst file is a copy of original
quantization-aware-training.rst without the PyTorch part

Link to generated doc:

http://openvino-doc.iotg.sclab.intel.com/nncf-docs/openvino-workflow/model-optimization-guide/compressing-models-during-training.html


### Tickets:
 - 129586

---------

Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2024-05-22 13:22:55 +00:00
Luwei Zhou 0bac4612da
[CPU]Align dump_check.py with blob dump header precision switch from deprecated ePrecision to ov::element::Type_t. (#24617)
66a8600564 switched precision field in
dump header from ePrecision to ov::element::Type_t. update dump_check.py
to parse precision correctly.
2024-05-22 13:19:07 +00:00
Katarzyna Mitrus 0a5a369efa
[Op] ROIAlignRotated version alignment from opset14 to opset15 (#24585)
### Details:
- ROIAlignRotated as added within 2024.2, should be moved to the latest
opset15


### Tickets:
 - 141682
2024-05-22 13:06:06 +00:00
Damian Kurek da168d2bd7
[GPU] Remove link-time stringop overflow warning (#24628)
Remove stringop overflow warning as a temporal workaround for oneDNN
warning issue, which caused compilation issues on Ubuntu 24.04 (GCC 13 +
LTO)

### Details:
 - Remove warning from intel-gpu link flag properties

### Tickets:
 - CVS-141874
2024-05-22 12:53:59 +00:00
Jan Iwaszkiewicz 4031e791bc
[PyOV] Refactor dtype to type conversion (#24626)
### Details:
- Continuation of https://github.com/openvinotoolkit/openvino/pull/24588
- Initialized "int-to-type" map with more clear "string-to-type" map
first, using `num()` value from constructed dtypes.

### Tickets:
 - *...*
2024-05-22 12:38:12 +00:00
KianYong Gan 5a32c49f97
[NPU] Fix issue model name not return from meta-data (#24529)
### Details:
A new test case added in openvino
fd9a63cffd/src/tests/functional/plugin/shared/src/behavior/compiled_model/properties.cpp (L240)
but it encounter some issue in CID path where the model_name return is
null, this PR trying to solve the issue

### Tickets:
 - *EISW-121043*
2024-05-22 12:15:14 +00:00
Sergey Shlyapnikov 1e5f025bdd
[GPU] Add initial SDPA implementation (#24466)
### Details:
- Add initial SDPA implementation, input transpose fusions and GQA
related optimization (broadcast fusion)
2024-05-22 11:54:27 +00:00
KianYong Gan 710568bd58
[NPU] Add logger in src/plugins/intel_npu/src/backend/ (#24019)
[NPU] Add logger in src/plugins/intel_npu/src/backend/ to Increase
verbosity of errors returned

### Details:
 Improve log and debug message
 - src/plugins/intel_npu/src/backend/include/zero_backend.hpp
 - src/plugins/intel_npu/src/backend/src/zero_backend.cpp
 - src/plugins/intel_npu/src/backend/src/zero_device.cpp
 - src/plugins/intel_npu/src/backend/src/zero_executor.cpp
 - src/plugins/intel_npu/src/backend/src/zero_infer_request.cpp
 - src/plugins/intel_npu/src/backend/src/zero_init.cpp
 - src/plugins/intel_npu/src/backend/src/zero_pipeline.cpp

### Tickets:
 - *ticket-id*
2024-05-22 11:28:41 +00:00
River Li 0d95325972
[C API] fix element type mismatch issue (#24608)
### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*
2024-05-22 09:21:45 +00:00
Sebastian Golebiewski 09c05f12a0
[DOCS] Limitation of BF16 inference precision for LLMs (#24501)
Creating `Limitation of the bf16 inference precision` section to
describe an issue of higher accuracy loss than the pre-determined
threshold of 0.5% and present possible solutions.
This PR addresses JIRA ticket: 138832.
2024-05-22 08:45:26 +00:00
Stefania Hergane 63e043bf00
Extend network precision with `u4`, `i4` for L0 backend (#24432)
### Details:
 - *Update `zero_infer_request.cpp` with `u4` and `i4`* for intel_npu.
 - *...*

### Tickets:
 - *E#121561*
2024-05-22 08:04:57 +00:00
Surya Siddharth Pemmaraju e7c60bb18a
Fixed bug with inlined inputs (#24448)
### Details:
- Fixed bug with inlined inputs for fx decoder which were being added as
parameters and are not needed.

### Tickets:
 - (https://jira.devtools.intel.com/browse/CVS-116702)

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2024-05-22 07:29:36 +00:00
hyunback kim 7f4e76694b
[GPU] gemm_tile supports block read when leftover with 4byte-size align in dynamic. (#24535)
* Use block read in 4byte aligned left-over case. Static was already
used (https://github.com/openvinotoolkit/openvino/pull/23400) This PR
will apply in dynamic.



### Tickets:
 - *141032*

---------

Signed-off-by: hyunback <hyunback.kim@intel.com>
2024-05-22 07:24:13 +00:00
Mustafa Cavus 19fd28b433
Torchfx gptq pattern replacer (#23700)
Required for GPTQ int4 LLMs. (ChatGLM2, ChatGLM3, Llama2)
Includes the transformations below:
- GPTQ Decompression pattern replacer


![image](https://github.com/openvinotoolkit/openvino/assets/59713154/d68ad0c9-473c-4590-a8fe-e62171b72ab7)


- GPTQ Multiplication pattern replacer


![image](https://github.com/openvinotoolkit/openvino/assets/59713154/954b2f1e-b79c-4eed-b5f8-77d56cd776a9)

Ticket: CVS-139181

---------

Co-authored-by: Surya Siddharth Pemmaraju <surya.siddharth.pemmaraju@intel.com>
2024-05-22 05:55:43 +00:00
Aleksandr Voron a1b9b144ef
[CPU][ARM] Enable NHWC Pooling (#24492)
PR has to be merge after
https://github.com/openvinotoolkit/openvino/pull/24491 since ACL 24.04
contains needed fix for Pooling.
CVS-130054
2024-05-22 05:54:20 +00:00
Tingqian Li d8f5d7bdd3
[CPU] Support weight-compression dt s8 (#24457)
### Details:
- FC with symmetrically quantized/compressed weight may have i8 (instead
of u8) as weight data type (it saves the zero-point subtraction cost),
this change added support to such weight dt.
 - oneDNN fork PR: https://github.com/openvinotoolkit/oneDNN/pull/249

### Tickets:
 - *CVS-131042*
2024-05-22 05:37:03 +00:00
Vishniakov Nikolai 16e8db8023
[OV JS] Electron compatibility (#24558)
### Details:
- Fix Electron compatibility on Windows by specifying flag:
`CMAKE_SHARED_LINKER_FLAGS="/DELAYLOAD:NODE.EXE"`

### Tickets:
 - 141536

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-05-22 05:36:44 +00:00
dependabot[bot] c744950582
Update h5py requirement from <3.11.0,>=3.1.0 to >=3.1.0,<3.12.0 in /src/bindings/python (#24413)
Updates the requirements on [h5py](https://github.com/h5py/h5py) to
permit the latest version.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="2c80981022"><code>2c80981</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2405">#2405</a> from
takluyver/rever-3.11</li>
<li><a
href="76afe10048"><code>76afe10</code></a>
Add HDF5 1.14.4 fixes to release notes</li>
<li><a
href="009047936d"><code>0090479</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2406">#2406</a> from
ajelenak/libhdf5-1.14.4</li>
<li><a
href="0f071a4d64"><code>0f071a4</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2407">#2407</a> from
h5py/dependabot/github_actions/actions-45223d3826</li>
<li><a
href="944a4a6967"><code>944a4a6</code></a>
Bump peaceiris/actions-gh-pages from 3 to 4 in the actions group</li>
<li><a
href="8f513ced5e"><code>8f513ce</code></a>
Clean up release notes</li>
<li><a
href="62bd813202"><code>62bd813</code></a>
Rename new whatsnew file, add to index</li>
<li><a
href="9c305e23ce"><code>9c305e2</code></a>
Updated CHANGELOG for 3.11.0</li>
<li><a
href="9e107c4a78"><code>9e107c4</code></a>
bumped version to 3.11.0</li>
<li><a
href="71af64dec8"><code>71af64d</code></a>
Merge pull request <a
href="https://redirect.github.com/h5py/h5py/issues/2360">#2360</a> from
loichuder/visit-links</li>
<li>Additional commits viewable in <a
href="https://github.com/h5py/h5py/compare/3.1.0...3.11.0">compare
view</a></li>
</ul>
</details>
<br />


Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2024-05-22 00:11:31 +00:00
Asthestarsfalll afc3aac267
【Hackathon 6th No.43】add paddle tril_triu (#23982)
### Details:
add paddle tril and triu

### Reference
Code:
https://github.com/PaddlePaddle/Paddle/blob/release/2.6/python/paddle/tensor/creation.py#L1431
Support data type: int32, int64, float32, float64, float16, complex64,
complex128 (openvino do not support float64, float16, complex64
complex128)

### Python simulation code
```python
import paddle

a = paddle.randn((3, 4))


def func(x, diagonal=0, mode='triu'):
    h, w = x.shape
    horizontal_range = paddle.arange(0, w)
    horizontal_range = paddle.unsqueeze(horizontal_range, 0)
    vertical_range = paddle.arange(0, h)
    vertical_range = paddle.unsqueeze(vertical_range, 1)
    if diagonal != 0:
        vertical_range += diagonal
    if mode == 'triu':
        mask = horizontal_range >= vertical_range
    else:
        mask = horizontal_range <= vertical_range
    print(mask)
    return paddle.where(mask, x, paddle.zeros_like(x))


def tril(x, diagonal=0):
    return func(x, diagonal, 'tril')

def triu(x, diagonal=0):
    return func(x, diagonal, 'triu')



b = paddle.tril(a, -1)
c = tril(a, -1)
print(b)
print(c)
print((b==c).mean())

```

### Test


![240411_19h35m47s_screenshot](https://github.com/openvinotoolkit/openvino/assets/72954905/735e1fa0-cd5f-4b56-b7fd-388b95eb1177)


waiting for:
- https://github.com/openvinotoolkit/openvino/pull/23010

---------

Co-authored-by: mei, yang <yang.mei@intel.com>
2024-05-21 19:09:20 +00:00
Przemyslaw Wysocki fba3ec0d47
[Op] `Col2Im-15` reference implementation (#24548)
### Details:
- Similar in functionality to
https://pytorch.org/docs/stable/generated/torch.nn.Fold.html, Col2Im is
`torch.nn.Fold` restricted to two output spatial dimensions

### Tickets:
 - CVS-138919

### Related PRs:
- https://github.com/openvinotoolkit/openvino/pull/24197
- https://github.com/openvinotoolkit/openvino/pull/23947
- https://github.com/openvinotoolkit/openvino/pull/24569

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-05-21 18:46:35 +00:00