Commit Graph

139 Commits

Author SHA1 Message Date
Andrei Kashchikhin 10177bfb89
[CI] [GHA] Introduce Dockerfiles for test jobs (#24742)
### Tickets:
 - *141574*
2024-05-30 09:46:12 +00:00
Andrei Kashchikhin cb85ddcb46
[CI] [GHA] Fix GPU job display name if the job is skipped (#23965)
### Details:
 - If the GPU job is skipped, the UI shows:

![image](https://github.com/openvinotoolkit/openvino/assets/65596953/6c8c8142-d12e-4f80-a2c3-ab17ff9e3b1f)

The jobs created by `matrix` will have the necessary distinguishable
properties in the `()` after the job name, e.g., for `Conformance`:

![image](https://github.com/openvinotoolkit/openvino/assets/65596953/d9104eda-3c33-4cee-ab33-4df0e41cc6f3)
so we do not need `matrix`.
2024-05-24 09:08:52 +00:00
Andrei Kashchikhin 8c5b357135
[CI] [GHA] Add Dockerfile for U20 and use it in the `Build` job in Linux workflow (#24573)
### Tickets:
 - *141573*
2024-05-22 18:27:43 +00:00
Alina Kladieva b014776bf4
[GHA] Checkout the latest OneDNN for GPU in nightly (#24534)
### Tickets:
 - CVS-139627
2024-05-22 14:57:06 +00:00
Ilya Lavrenov 92e88b28e7
Use custom TBB even on Linux (#24359)
### Details:
- System TBB provides lower performance than newer versions, so we have
to distribute our own one.
2024-05-17 09:07:41 +04:00
Ilya Lavrenov 935390b51a
Revert "Revert "Use only Java API, Custom ops in contrib build"" (#23789)
Reverts openvinotoolkit/openvino#23775
2024-05-05 21:19:53 +04:00
Andrei Kashchikhin 1728707d72
[CI] [GHA] Make GPU job required (#24348) 2024-05-02 16:20:57 +00:00
Andrey Babushkin 62d55aafd1
Switch Tensorflow models tests back on Azure runners (#24038)
### Details:
This switches TF Hub model tests back to self-hosted runners in AKS and
stores models in persistent storage in Azure
2024-04-25 18:43:03 +00:00
Ilya Lavrenov f28a0bb239
Returned back tests with ONNX RT (#24150)
### Details:
 - Returned back tests with ONNX RT
2024-04-22 08:03:10 +00:00
Mikhail Ryzhov a6265c136b
[GHA] Move tokenizers build to reusable job (#23909)
### Details:
 - Move tokenizers build to reusable job

### Tickets:
 - *132908*

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-04-19 19:12:17 +00:00
Andrei Kashchikhin d66b366401
[CI] [GHA] Introduce GPU job (#23870)
### Tickets:
 - *137815*
2024-04-10 08:25:00 +00:00
Andrey Babushkin c5fe0e6137
Revert "Use only Java API, Custom ops in contrib build" (#23775)
Reverts openvinotoolkit/openvino#23706
Probably causes Windows JS API job failure
2024-03-30 10:46:13 +00:00
Ilya Lavrenov 18cc7cefd0
Use only Java API, Custom ops in contrib build (#23706)
### Details:
 - Use only Java API, Custom ops in contrib build
- It will allow avoid breaking GHA pipelines with some changes in
Contrib repo

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2024-03-28 16:52:47 +00:00
Anastasiia Pnevskaia 981df38e71
Removed usage of matrix param in TF models tests job. (#23255)
### Details:
- Removed usage of matrix param in TF models tests job, as the timeout
is shared between jobs launched by matrix, which causes nightly jobs
abortion by timeout.

### Tickets:
 -
2024-03-05 10:10:10 +00:00
Sun Xiaoxia a605edbd77
Fix performance regression of conformance tests (#22938)
### Details:

fix performance regression of conformance tests

Root cause is `make_default_multi_threaded()` API which was refactored
in PR22414. This API is used to calculate the number of threads.
**Master version**: When the test machine has both Pcore and Ecore, it
recognized the machine type and will select proper cores (Pcores are
selected in general machine which pcores >Ecores / 2) to create
executor.
**Old version**: the input parameter `_threadBindingType` of config was
used to judge the type of current machine, and `_threadBindingType` is
always set to default value `None` in template plugin. So hybrid core
machine is regarded to core machine and physical cores (include Pcores
and Ecores) are used. `_threadBindingType` is deprecated in master now.
For example: ADL i9-12900K, 8 Pcore, 8Ecore. 
Old version: threads=16 in any cores. 
Master: threads=8 in Pcores. 
Actually, the threads calculated from `make_default_multi_threaded` of
master version is the best option in normal situation which not create
multi threads in app side. But in conformance test, 24 threads are
created to seize CPU resource. Of cause, all cores are must be used to
achieved the best performance.


### Tickets:
 - *CVS-131820*

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2024-03-04 07:44:36 +00:00
Andrei Kashchikhin 7ceff6a580
[CI] [GHA] Transition to the v4 for `actions/upload` and `actions/download`-`artifact` (#23142)
### Details:
- Should improve uploading and downloading stability of larger artefacts
(e.g., test packages), and [improve
speed](https://github.blog/changelog/2023-12-14-github-actions-artifacts-v4-is-now-generally-available/).

### Tickets:
 - *133744*
2024-02-28 17:22:05 +00:00
Anastasiia Pnevskaia a698628c7a
[TF FE] Add TF Hugging Face model tests into nightly (#23095)
### Details:
 - Added Hugging Face models to nightly

### Tickets:
 - 132904

---------

Co-authored-by: Andrei Kashchikhin <andrey.kashchikhin@intel.com>
2024-02-28 16:03:40 +00:00
Anastasiia Pnevskaia a819605986
[TF FE] Test TF Hugging Face models (#22970)
### Details:
 - TF Hugging face tests

### Tickets:
 - 132904

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-02-26 12:41:09 +00:00
Irina Efode 89d6da9531
[GHA] Extend pre-commit by Mandatory API conformance on TEMPLATE (#22602)
### Details:
 - *API mandatory scope on TEMPLATE should be 100%*

### Tickets:
 - *ticket-id*

---------

Co-authored-by: Andrei Kashchikhin <andrey.kashchikhin@intel.com>
2024-02-19 08:43:35 +00:00
Roman Kazantsev 9b22324109
[TF FE][OV Tokenizers] Deploy use of OpenVINO Tokenizers in FE layer tests (#22896)
**Details:** We are going to test OpenVINO Tokenizers conversion
extensions by FE layer tests. It gives better quality integration
between openvino and openvino-tokenizers. For example, operation on
string tensors such as tf.raw_ops.StringLower, tf.raw_ops.StringSplitV2
will supported via OV tokenizers near feature until we move them into
core part.

**Ticket:** 132667

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-02-17 17:32:05 +00:00
Mikhail Ryzhov f18cf55b06
[GHA] Switch tokenizers to public repo (#22814)
### Details:
- Tokenizers extension has been moved to dedicated rep -
https://github.com/openvinotoolkit/openvino_tokenizers

### Tickets:
 - *ticket-id*
2024-02-13 16:57:18 +00:00
Denis Orlov 778e16e3b4
[GHA] Increase timeout for Conformance tests (#22735)
### Details:
- Temporarily increase the timeout for Conformance op tests (the root
cause is to be investigated)

### Tickets:
 - 131820
2024-02-08 14:40:39 +00:00
Roman Kazantsev c7b4ba34c3
[GHA][Model Hub Tests] Use openvino-tokenizers in model hub tests (#22638)
**Details:** Use openvino-tokenizers in model hub tests.

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-02-04 07:30:36 +00:00
dependabot[bot] 3b267783fa
Bump mozilla-actions/sccache-action from 0.0.3 to 0.0.4 (#22552)
Bumps [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action) from 0.0.3 to 0.0.4.
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases)
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.3...v0.0.4)

---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-31 10:12:40 +00:00
Mikhail Ryzhov bd1e0001fd
[GHA] Openvino tokenizers build (#22461)
* init

* updated cmart ci

* updated runner

* Revert "updated runner"

This reverts commit 19d1e5c9e6.

* checkout python action

* checkout wa

* fixed checkout

* hardcoded path

* use default checkout dir

* revert ade

* fixed checkout action path

* changed steps order

* exlude setupvars

* build dependencies

* deps path

* openvino  package

* changed timeout

* speed up build

* increased threads

* test build core tokenizes

* unused code

* make this job mandatory

* align parallel jobs

* removed ade

* win job

* exclude dev package

* set win job mandatory

* fixed powershell cmd
2024-01-31 08:23:48 +00:00
Andrei Kashchikhin dab68a88bb
[CI] [GHA] Add retries for APT, update deadsnakes action (#22515)
* update setup_python version, add retries for apt in Linux workflows

* account for sudo

* use sudo via sh
2024-01-30 14:03:40 +00:00
Mikhail Ryzhov 2b114ab99b
[GHA] enabled sccache error logging (#22428)
* enabled sccache error logging

* reset ade

* changed log level to warn
2024-01-26 14:03:29 +00:00
Andrey Babushkin 61c56f41fb
Disable ONNX Models tests until they'll become more stable (#22435) 2024-01-25 18:19:48 +00:00
Alina Kladieva 9bc18771d1
[GHA] Add merge group trigger (#22425) 2024-01-25 14:12:04 +01:00
Andrey Babushkin eb58809bbc
[GHA] Change default port for sccache server to avoid collisions (#22364) 2024-01-24 11:06:35 +04:00
Alina Kladieva f1ef5f2058
[GHA] Set SCCACHE_IGNORE_SERVER_IO_ERROR (#22346) 2024-01-23 15:21:36 +01:00
Andrey Babushkin 3a70f53a2d
Bump sccache version (#22282) 2024-01-20 11:53:28 +04:00
Ilya Lavrenov d0619edd21
Removed IE and ngraph headers / cmake interfaces from package (#22203)
* Revert "Revert IE cmake config back"

* Update src/cmake/openvino.cmake

* Fixed for NVIDIA plugin

* Fixed tests compilation

* Use ilya's contrib repo

* Fixes for ONNX Runtime tests

* Use custom nVIDIA repo

* Disable ONNX Runtime
2024-01-19 16:48:27 +04:00
Alina Kladieva 222184ca28
[GHA] Run full scope on merge queue events (#22172) 2024-01-17 10:57:15 +01:00
Irina Efode 79447b3a36
[CONFORMANCE] Pre-commit migration over new version (#21725)
* [CONFORMANCE] Migration to new version

* Cache using in gha. Update expected failures

* Device in GHA

* Increase cpu_cnt used in run_conformance

* cache

* Increase Op conformance timeout up 20 min

* Update expected_failures_API.csv

* Update linux.yml

* Remove extra file

* Update run_conformance.py
2024-01-12 14:16:20 +00:00
Anastasia Kuporosova a561a2a484
[PyOV] Legacy IE Python API removal (#20908)
* [PyOV] Legacy IE Python API removal

* clean configs &cmake

* remove ngraph

* remove from yml

* try to fix build

* clean up

* remove old api from python snippets and docs (#170)

* remove old api from python snippets

* pysnippets removal p2

* remove ngraph snippet

* remove old api from docs

* remove migration snippets

* remove compatibility req after refactoring on master

* fix after merge

* fix after merge

* Update docs/articles_en/documentation/openvino_legacy_features/api_2_0_transition_guide/graph_construction.rst
2024-01-11 13:46:49 +01:00
Andrei Kashchikhin f0f1e7a31f
[CI] [GHA] Introduce JS API as a part of the existing workflows (#21898)
* add js api to linux

* try inside the ov repo

* use rel path

* use a separate job for js api

* correct command formatting

* add missing var

* use spacing

* mv js building

* add node installing

* add to windows

* check pwsh and cmd running npm

* add smart CI conditions; disable for win

* use node version as env var

* extract js job into a separate workflow, add to other *nix

* fix input name

* Activate js bindings tests for arm64

* upload ov js package

* correct formatting

* add missing syntax

---------

Co-authored-by: Vishniakov Nikolai <nikolai.vishniakov@intel.com>
2024-01-08 16:52:58 +04:00
Georgy Krivoruchko 03921ecd01
[ONNX] Frontend refactoring (#21903)
* Removed onnx_common and ngraph::test namespaces

* Removed usage of ngraph/log.hpp

* Fixed Code Style

* Added build of ONNX Runtime when FrontEnd is changed

---------

Co-authored-by: Pavel Durandin <pavel.durandin@intel.com>
2024-01-03 09:49:10 +04:00
Denis Orlov bc121c06c7
Move ONNX test parameters from Azure folder to ONNX frontend test folder (#21827)
* Remove remaining files for Azure pipelines

* Move the files instead of removal

* Fix the folder ref in linux.yml

* Fix the folder ref in linux_arm64.yml
2023-12-22 03:37:57 +04:00
Ilya Lavrenov 662aa57a92
Downgrade GHA for upload / download back to @v3 (#21770) 2023-12-20 00:48:31 +04:00
Alina Kladieva 224eb79ab6
[GHA] Prepare new required stages for precommit (#21766)
* Add Smart CI support to webassembly workflow

* Add ONNX_Models to required checks list
2023-12-19 22:52:12 +04:00
Andrey Kashchikhin 24b414c168
[CI] [GHA] Introduce ONNX Models Tests job in Linux workflow (#21581)
* add onnx models test job

* rm sudo

* add missing update

* add missing git-lfs

* add missing package

* correct var

* correct command

* try with pytest

* provide path to models

* use mounted path

* add msft models

* use symlinks

* correct name for model

* use -h

* create and use directory for models

* use share as source for models

* fix test names, use fresh onnx repo

* return names

* fix test names

* change folder structure for onnx model downloading

* skip tests; clean up logs; adapt azure counterpart

* make skip names lowercase

* increase parallel

* add missing git-lfs

* fix dir

* install git-lfs properly

* use sudo

* use 12 parallels; rm -f

* use skip

* rm unnecessary requirements

* rm pytorch from installing

* disable test
2023-12-16 12:37:37 +04:00
Ilya Lavrenov ccc79fb691
Updated versions for upload / download artifacts actions (#21691) 2023-12-15 20:43:22 +04:00
Evgeny Kotov f094ef81f0
remove tests (#21654) 2023-12-14 16:54:37 +04:00
Andrey Babushkin 5a4f632680
[workflows] New path for volumes (#21604) 2023-12-13 00:56:24 +04:00
Andrey Kashchikhin dfc91186a1
[CI] [GHA] Extract test jobs into reusable workflows (#21395)
* extract cpu func tests into a reusable workflow

* add needs

* check paths

* correct paths

* rm usage of setupvars

* extract samples

* use yaml string

* split mac workflow

* check variables

* try github workspace

* check full dir

* set variables

* try with sub directory

* Revert "try with sub directory"

This reverts commit d891ee3f28.

* extract c++ tests from linux

* change

* use cxx workflow in mac workflows

* add noninteractive

* extract cpu func tests

* rm unused

* enable mac

* fix reusable workflow name

* correct path for sparse-checkout

* extract python UT

* remove unnecessary asterisk

* remove another unnecessary asterisk

* use reusable action for linux cc

* add check for setupvars existence

* check with manually installed opencl

* add components input to samples workflow; rm pr triggers for mac workflows

* add missing needs

* add missing option for deps install  script

* use disables in test themselves instead of ifs in workflows

* use reusable workflow for cxx tests in linux arm

* use python reusable workflow in linux arm

* add missing endif

* use self-hosted for samples, add x86_64 constraint for jax

* check paths

* find gompby partial name

* skip failing tests on arm; correct gomp finding for ovc

* check tests

* add debian packages job; use job_ prefix for reusable workflows with jobs

* extract tf hub model tests

* extract tf model hub perf tests

* extract pytorch models tests

* do not use container on GHA runners

* extract onnx runtime

* add missing deps

* skip test for linux arm

* rm always()s

* fix quotes

* correct paths

* correct ifs, check dir for onnxruntime

* correct path for onnxruntime utils folder; install python3

* use self-hosted as input

* check for self-hosted runner via name, pass version

* skip cpu plugin unittest

* check cxx tests

* rm pr trigger
2023-12-07 23:44:45 +04:00
Sonder 6d3fbf4237
【Hackathon 5th No.113】Support paddle 2.5.1 (#20161)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back

* support paddle 2.5

* fix op test errors

* fix op test errors

* recover openvino/src/core/src/op/swish.cpp

* recover thirdparty open_model_zoo

* update cmakelist

* disable some tests

* fix code style

* enable paddle ci tests

* disable some tests

* fix np.long error

* recover reverse op

* update ci config

* recover set_value test codes

* rm linux_debian.yml

* Compatible with cases where different paddle versions have different output shapes

* remove set_value tests

* recover save_model.py

* Added ctest labels for FE tests only if FW is found

* recover thirdparty

* Update CMakeLists.txt

Fixed creation of paddle_tests target two times

* update paddle v2.5.1 proto file

* recover thirdparty

* fix Paddle_Reader_Tests.LoadModelMemoryToCore error

* fix Paddle_Places test issue in v2.5.1

* support some tests for low version paddle

* fix paddle FrontEndCutModelTest issue

* fix

* support all other tests for low version paddle

* fix codestyle

* fix codestyle

* Update generate_multi_tensor_split.py

* fix build error

* add testUnloadLibBeforeDeletingDependentObject into paddle skip tests config

* remove PROTOBUF_LITE from paddle CmakeList.txt

* fix path error

* add debug info

* add debug codes

* use make_model_path

* recover

* add option optimize_for

* use FrontEndTestUtils in read_paddle_model_test.cpp

* use FrontEndTestUtils in read_paddle_model_test.cpp

* fix grid_sample error when using dynamic shape

* fix error tests for 2.4 version

* add paddle version judge for floor_div

* fix grid_sample and add tests

* fix

* fix

* recover

* recover grid_sampler

* Apply suggestions from code review

* fix

* Apply suggestions from code review

* Apply suggestions from code review

* fix build error

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: meiyang-intel <yang.mei@intel.com>
2023-12-06 13:59:50 +04:00
Mikhail Ryzhov 27adf58220
[GHA] Switched CPU functional test runner (#21346)
* switched runners to 32gb

* increased onnx timeout
2023-12-01 12:50:06 +04:00
Andrey Babushkin a7de95a8a4
Rename AKS runners' labels for consistency (#21282) 2023-11-28 12:13:28 +00:00
Alina Kladieva d722e42052
[GHA] Smart CI for more pipelines (#21307)
* Add Smart CI for more pipelines. Refactor logic for workflow skip

Since different workflows may have different requirements for skipping them, I suggest to move these requirements to parameters instead of hardcoding them

* Use patterns for skipping pipeline for conformance-only

* Remove path filters for Android

* Return mistakenly deleted param

* Propagate params to Python script

* Add missing outputs mapping

* Return push trigger

* Skip CC CPU func when CPU is not affected

* Fix variable name
2023-11-27 18:43:54 +04:00