### Details:
- By PR(https://github.com/openvinotoolkit/openvino/pull/22245),
`clamp_fp16_output` opt pass was moved to ngraph
- Because nodes such as eltwise(`Add`, `Subtract`, `Multiply`, `Divide`)
that were fused into target node `gemm` are not supported in pattern,
corresponding pattern was extended for this purpose
### Tickets:
- 135060
### Details:
- Fuse `broadcast` and `reshape` layers into `gemm` layer for LLM's 2nd
latency optimization
- before : [`broadcast`] --> [`reshape`] --> `gemm`
- after : `gemm`
- `gemm` is extended to have `input0_target_shape`,
`input1_target_shape`, `input0_output_pattern` and
`input1_output_pattern` from `broadcast` and `reshape` layers
### Tickets:
- 128343
---------
Signed-off-by: Andrew Park <andrew.park@intel.com>
### Details:
- *Comparation function was changed to compare tensors based on element
comparation*
- *`std::abs(ref_value - plugin_value) <= abs_threshold + rel_threshold
* ref_value`*
- *`abs_threshold ` =
std::max(std::numeric_limits::eps<plugin_element_type>(),
std::numeric_limits::eps<ref_element_type>())*
- *`ref_threshold = eps_by_expected_type()`, which is based on half `bit
length of mantissa`*
### Tickets:
- [CVS-133173](https://jira.devtools.intel.com/browse/CVS-133173)
- [CVS-135540](https://jira.devtools.intel.com/browse/CVS-135540)
---------
Co-authored-by: sbalandi <sofya.balandina@intel.com>
### Details:
Limit the Concat layer to have maximum 3 children. The third one is
allowed to be a ShapeOf op only (to support Mixtral).
### Tickets:
- 135375
[TRANSFORMATIONS] Create python binding for pattern::Optional
Expose the C++ op::pattern::Optional to Python in order to
simplify patterns creation.
Cover the functionality with the dedicated tests.
### Tickets:
CVS-133523
Signed-off-by: Andrii Staikov <andrii.staikov@intel.com>
---------
Signed-off-by: Andrii Staikov <andrii.staikov@intel.com>
[TRANSFORMATIONS] Remove use of legacy names from transformations
API function create_ie_output_name() and get_ie_output_name() are
deprecated in a28a0004b4 ("Deprecated functions to operate with legacy
port names (#22717)")
Remove usages of create_ie_output_name() in Transformations
### Tickets:
CVS-132087
Signed-off-by: Andrii Staikov andrii.staikov@intel.com
---------
Signed-off-by: Andrii Staikov andrii.staikov@intel.com
### Details:
- Add notes with descriptions of: Out of Bounds, Indexing in Reverse,
Negative Indices
- Clarified length of masks
- Clarified the definition of `-1` value
- Described in detail the behavior of masks, aligned with Reference
Implementation
- Added more latex-like style, add the examples for the missing masks.
### Tickets:
- 90128
### Details:
- Adds buffer reset to 0 in `count_nonzero` impl in case of empty input
tensor as currently we may try to allocate random amount of memory in
subsequent `gather_nonzero` call
### Details:
- *Enable new property model_distribution_policy for CPU inference*
-- *Add C++ interface and test cases*
-- *Add Python interface and test cases*
### Tickets:
- *CVS-127844*
### Details:
- Since #22726 gemm is derived from multi-stage impl which had memory
reuse flag enforced to false for all sub-classes.
- This patch enables memory reuse back for gemm kernel to reduce memory
consumption.
### Tickets:
- *135361*
### Details:
- Extract the same logic structure from `CompileModel::input` and
`CompileModel::output`
- Add a private `CompileModel::get_node` method that gets the specified
input or output node.
Note:
No changes to argument validation or conversion.
### Tickets:
- *127617*
### Details:
- *Adding support for OnesLike operation on complex type tensor*
- Closes#22953
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
New op support for:
- torch.export updates
- benchmarking model support
- chatglm2 support
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
### Details:
- *enable concat nspc layout inplace for channel only cases, with these
concat node use inplace impl, urlnet model gain performance benefits,
and this(intermediate concat node is nspc layout but actually is one
dimension) could be common case especially for models with 1D input*
### Tickets:
- *130282*
### Details:
- *Element by element read is the bottle-neck in gemm_tiled kernel.
Enable block-read when N and K size are aligned 4byte with N and K are
leftover*.
- *Increasing tile_n_size has performance improvement when m_size and
n_size are not shallow and n_size is aligned at 32.*
- *Add GEMM_TILE_M/N/K/SIMD environment variables for convenience.*
### Tickets:
- *134279*
---------
Signed-off-by: hyunback <hyunback.kim@intel.com>
**Details:** Test `tf.keras.TextVectorization` on white-space string
input and Equal on empty string tensor.
**Ticket:** 135749
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Oleg Pipikin