Commit Graph

232 Commits

Author SHA1 Message Date
Mikhail Ryzhov e8861fb16a
extended logs (#20442) 2023-10-14 13:19:36 +04:00
Andrey Kashchikhin 2e33019e68
[CI] [GHA] Align pipelines (#20388)
* add ONNX layer tests

* add parallelism for pytest; add missing stages to win; align execution steps

* add missng shell option

* add missing dep, update marker

* align stages and execution commands; rm parallelization

* enable trigger

* add missing export; rm not-applicable stage from mac and win pipeline

* add missing requirement, rm not-applicable stage

* add missing test parameters

* try to pi onnxruntime version; skip mxnet on mac; correct vars in win

* rm constraint

* skip on win

* use xfail

* remove always(), rm trigger for mac

* return push trigger for mac
2023-10-13 23:48:15 +04:00
Ilya Lavrenov 56d74a82cb
Relocatable developer package (#20327)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU

* Initial relocatable OpenVINO Developer package

* Improvements

* Try to fix

* improvements

* Export a lot of headers

* Removed NVIDIA pipeline; make it to be a job

* Fixes

* Fixes 2

* Try ilya-lavrenov repo

* Clean-up

* More imrpovements

* Even more improvements

* Override export, install

* Override export, install

* Disable pythonwheel generation for relocatable OV dev package

* Fixed issues with versions

* Fixed android build

* Fixed android build

* Fixed NPU build

* Update src/bindings/python/CMakeLists.txt
2023-10-12 22:59:04 +00:00
Ilya Lavrenov 9e4ec43f7c
Disabled sporadic test_backend.py::OnnxBackendNodeModelTest::test_div_uint8_cpu test (#20419) 2023-10-12 15:29:30 +04:00
Ilya Lavrenov 2604c33d1b
Don't add mxnet extras for openvino-dev on macOS arm64 (#20403) 2023-10-12 13:23:18 +04:00
Ilya Lavrenov d41e7fcc30
Revert "[CI] [GHA] Skip `test_div_uint8_cpu` on macOS only; unskip `test_onnx/test_backend.py` in GHA workflows (#20367)" (#20402)
This reverts commit a3d6d0bca9.
2023-10-12 03:00:14 +04:00
Ilya Lavrenov 10d1862715
Updated ade submodule (#20392) 2023-10-11 23:38:00 +04:00
Andrey Kashchikhin a3d6d0bca9
[CI] [GHA] Skip `test_div_uint8_cpu` on macOS only; unskip `test_onnx/test_backend.py` in GHA workflows (#20367)
* only skip test if mac

* unskip

* unskip trigger

* skip for onnx fe as well

* do not skip

* return skips and unskip test_backend in Python API 1.0

* rm pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-11 14:05:12 +04:00
Andrey Kashchikhin 0060b26b74
[CI] [GHA] [Azure] Unskip `test_div_uint8_cpu`, unskip `src/frontends/onnx/tests/test_python/test_zoo_models.py` in Win and Linux pipelines (#20366)
* only skip test if mac

* unskip

* skip for onnx fe as well

* remove skips

* rm unused imports

* revert import
2023-10-10 21:06:18 +04:00
Andrey Kashchikhin 3ebadc14d1
[CI] [GHA] mac pipeline review leftovers; small cleanup of the Linux pipeline (#20353)
* skip gna-related tests on mac; rm unused in pipelines

* rm unused env var

* use if instead of commenting out

* add name

* return pr trigger

* rm pr trigger
2023-10-10 17:10:46 +04:00
Andrey Kashchikhin 1454e77bbf
[CI] [GHA] Introduce GHA macOS Pipeline (#20212)
* start transferring

* start with samples

* start with initial two stages

* change name

* skip pytorch tests; rm unused comments

* rm setupvars sourcing; make test steps similar to those in linux pipeline

* add missing options and setupvars sourcing

* add skips for mac

* install wheels directly

* add deployment target

* add skips for pytorch layer tests; experiment with samples

* do not exclude files for archives; set rpath

* apply comments; rm unnecessary stages

* Update mac.yml

fixed MO Python API tests

* Update .github/workflows/mac.yml

* Update openvino.cmake

add LC_RPATH to libopenvino.dylib

* Update src/cmake/openvino.cmake

* Update CMakeLists.txt

reverted changes in samples build

* Update openvino.cmake

removed rpath changes

* add setupvars

* disable pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-10 14:43:09 +04:00
Andrey Kashchikhin fca34c6f9f
[CI] [GHA] Refactor Win pipeline: split the `Build` job, remove unnecessary requirements installation (#20320)
* split build job; rm unnecessary requirements installation

* add missing OV Contrib build

* align requirements install

* rm incorrectly place vsvars, apply comments: add missing tests

* rm build and source options in the cmake OV Contrib command

* add missing build directory

* add logs

* Update windows.yml

Fixed rebuild from scratch with OpenVINO Contrib

* verbose archive extraction

* Fixed path for extraction of openvino_tests package

* Use windows-latest-8-cores for samples

* Update windows.yml

* Update .github/workflows/windows.yml

* use filename for wheel; build ov contrib with ov

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-10 13:35:35 +04:00
Ilya Lavrenov ead4b8a0ec
Moved cmake functions, variables to API 2.0 naming style (#20281)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
2023-10-09 22:30:32 +04:00
Ilya Lavrenov ba6a676484
Aligned tests with azure linux.yml (#20304)
* Aligned tests with azure linux.yml

* Apply suggestions from code review

fixed comments

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>

---------

Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-10-09 12:55:26 +04:00
Mikhail Ryzhov e1faf3ddd0
[GHA] Parallel test script code style (#20119)
* fixed code style

* extend logs

* fixed  comments

* comments
2023-10-09 10:23:57 +02:00
Ilya Lavrenov ffbffed749
Enabled warnings as errors for static Ubuntu 22.04 (#20302) 2023-10-08 23:23:54 +04:00
yanlan song ad41d0f52f
rework auto test cases (#19862)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* clean up

Signed-off-by: fishbell <bell.song@intel.com>

* fix windows build failure

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto func tests

Signed-off-by: fishbell <bell.song@intel.com>

* enable auto_func_test to ci

Signed-off-by: fishbell <bell.song@intel.com>

* some clean up in gpu case

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable new tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix build warning

Signed-off-by: fishbell <bell.song@intel.com>

* enable consistency test

Signed-off-by: fishbell <bell.song@intel.com>

* try fix build error on manylinux

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpplint

Signed-off-by: fishbell <bell.song@intel.com>

* enable clang-format

Signed-off-by: fishbell <bell.song@intel.com>

enable some tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix typo

Signed-off-by: fishbell <bell.song@intel.com>

* clang for unit tests

Signed-off-by: fishbell <bell.song@intel.com>

* fix merge conflict

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-10-07 14:44:25 +04:00
Mikhail Ryzhov 7e7b6482aa
[GHA][HF] Switch python nightly tests to github runners (#20286)
* switched runners to GHA

* excluded timm models from nightly scope

* added sudo steps

* switched precommit too
2023-10-07 02:22:32 +04:00
Mikhail Ryzhov 27ae3fb217
changed script path (#20285) 2023-10-06 13:05:03 +00:00
Przemyslaw Wysocki 9fe6be21ea
[PyOV] Drop Python 3.7 in OpenVINO Runtime (#19534)
* Drop 37

* Fix linter

* Minor change

* Minor changes

* update add_lib_path

* Minor changes

* Update pypi pages

* Update pypi pages

* Fix linter

* Minor changes

---------

Co-authored-by: Anastasia Kuporosova <anastasia.kuporosova@intel.com>
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-06 08:28:27 +00:00
Ilya Lavrenov d6c2a10b38
Merge Linux CC + static build + clang compiler (#20243)
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
2023-10-06 00:30:11 +04:00
Mikhail Ryzhov a79c07b3a0
[GA] Enable win workflow (#19646)
* Enable win workflow and cpu parallel tests

* removed test code

* update cache naming

* extended logs collections

* Revert "extended logs collections"

This reverts commit 0dd6620832.

* revert lost code during the merge

* missed dependencies

* enabled push trigger

* changed the cache key name

* skipped failed test

* fixed github action condition and added comments

* Update src/core/tests/check.cpp

* cache generation fix

* Apply suggestions from code review

* fixed python test configuration

* Revert "cache generation fix"

This reverts commit 0feab650fe.

* debug parallel tests

* Revert "Revert "cache generation fix""

This reverts commit e385b04410.

* Revert "debug parallel tests"

This reverts commit e4459472a7.

* fixed steps conditions

* concurrency updated

* fixed test skip condition on win

* review changes

* collect debug logs

* overwrite test list

* debug commit

* Revert "debug commit"

This reverts commit 8720b87c8f.
2023-10-05 16:49:39 +04:00
Andrey Kashchikhin 4ad68e8ff2
[CI] [GHA] Introduce conformance tests (#19841)
* check dirs

* cmake, build, instlll

* use make

* use build dir

* use target

* add missing

* execute conformance tests

* correct path for requirements

* setupvars

* add API conformance

* conformance as a separate job; install all necessary files

* uncomment

* merge

* install deps

* use matrix, upload expected failures to gh cache

* use 8-core

* use the same paths

* uncomment

* comment

* change

* use csv

* add exit if there are failed tests

* always upload logs

* check dir

* use another dir for expected_failures

* upload always

* rm

* new key

* rm unused

* change

* update

* update

* rm unused

* do not exit if update is set

* copy file

* do not fail in failures check

* use specific branch

* run clean

* add expected failures

* uncomment

* comment out

* correctly add failed tests to fix_priority; check for unexpected failures in case of an update

* use azure runners for conformance

* use 4-core

* uncomment

* comment out

* split deps installation

* add missing deps for setup-python

* print error

* install certs

* do not verify ssl

* add ca-certificates install

* uncomment

* comment

* pack artifacts, rm unused deps

* rm unused dep

* always pack artifacts

* rm for func tests

* use less cores

* use var

* store int

* do not exit if non-zero code

* only 4 core

* use gh runner

* use sudo

* add missing sudo

* use expected failures

* uncomment

* comment

* create fresh expected failures

* use expected failures

* use specific ref and repo

* use expected failures

* uncomment

* comment out

* check caches

* fix str

* rm unused

* restore by restore key

* create dir

* use array

* use diff path

* mv after each download

* add sleeping and more logs

* add saving of hash table

* change

* uncomment

* comment

* download cache entries

* check dir

* use better dir

* uncomment

* rm unused

* add skip configs

* update lists

* rm unused dir; add docs

* rm unused

* rm hardcoded repo ref

* rm unused options; use better name for job

* rm unnecessary dir creation
2023-10-05 14:39:28 +04:00
dependabot[bot] 397c4fac98
Bump actions/checkout from 3 to 4 (#20249)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-05 11:32:40 +04:00
Andrey Kashchikhin 78e3ed6a75
[CI] [GHA] Introduce GHA Linux CUDA Pipeline (#19884)
* add pipeline

* rm triggers

* address comments

* use uninteractive as env

* rm triggers

* rm unused testdata

* use better concurrency group

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>

* use aks runner

* correct path

* provide path

* add missing cmake options; rm unnecessary dir creation

* use image from private docker

* split OV and plugin cmake & build; do not fail on warning for plugin build

* use different build_dir for nvidia plugin

* add missing options

* rm unnecessary options; add target for build

* Apply suggestions from code review

try fix for NVIDIA plugin

* Apply suggestions from code review

revert to default contrib repo, used ccache for CUDA files

---------

Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-04 11:50:57 +04:00
Przemyslaw Wysocki 9dd5fe97cb
Add field for JIRA ticket in Good First Issue template (#20187)
* Add gfi

* Minor change

* Fix linter

* fix typo

* Fix typo'

* Add new field

* Minor change
2023-10-02 21:55:14 +04:00
Andrey Kashchikhin bcd331d145
[CI] [GHA] Transfer Linux ONNX Runtime to AKS runners (#20157)
* transition to aks runners

* correct name

* incorporate onnxruntime into linux pipeline

* add missing python installation

* install build dependencies

* add path

* rm unused

* mv stage

* correct dir

* use 16-core for onnxruntime job

* rm obsolete

* rm logs

* rm unnecessary step

* rm unnecessary dir creation
2023-10-02 21:45:17 +04:00
Ilya Lavrenov 95e3096684
Added build on RedHat system to build & test RPM packages (#20134)
* Added GHA workflow for RPM packages

* Avoid rebuild for RPM / Debian packages

* Removed conditional include headers

* try only post-build

* Beautification

* Fixed testdata generation for mulit-config generators
2023-10-01 23:23:06 +04:00
Andrey Kashchikhin 77e043d342
[CI] [GHA] Transfer Linux CC to AKS runners (#20146)
* transfer to aks runner

* add missing git lfs

* use 22 ubuntu; rm unused ninja installation
2023-09-29 20:37:07 +04:00
Andrey Kashchikhin 74251ce932
rm obsolete pipeline (#20155) 2023-09-29 18:37:15 +04:00
Andrey Babushkin 201403ecd0
More RAM for 4 core AKS runner (#20138) 2023-09-29 15:00:52 +01:00
Mikhail Ryzhov f85a276782
[GHA] Azure pip cache (#20029)
* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* reset onednn

* added cleanup workload

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* added cleanup workload

* reset onednn

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* review fixes

* remove  cache files using atime

* mtime->atime

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
Mikhail Ryzhov d2ba528993
switched to 8 core runner (#20120) 2023-09-28 15:42:55 +04:00
Ilya Lavrenov 23e602f06f
Fixed NCC style check (#20121) 2023-09-28 15:01:52 +04:00
Roman Kazantsev 7761fc754c
[Hub Tests] Move TF Hub tests to AKS runners (#20049)
* [Hub Tests] Move Hub tests to self-host runners

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Not all directories possible to clean up

* Move Hub models tests to AKS nodes

* Add install actions python setup

* Add ca-certificate deps to install

* Fix bug for PT models

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Update .github/workflows/linux.yml

* Revert changes for PT models tests

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Install correct version of OV

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 09:10:39 +00:00
Ilya Lavrenov 1be993dd39
[GHA] Don't build documentation in post-commit (#20099) 2023-09-28 12:11:14 +04:00
Ilya Lavrenov 20ec04bfcc
Try to use vcpkg cache (#20102) 2023-09-28 12:03:46 +04:00
Ilya Lavrenov 920d1badf3
Added WebAssembly workflow (#20092) 2023-09-28 01:18:17 +04:00
Ilya Lavrenov ce7366bc90
Enabled Android arm64 GHA in precommit (#20094) 2023-09-28 01:15:36 +04:00
Ilya Lavrenov 132bada331
Enable PDPD tests build (#20078)
* Fixed comments for linux-riscv64 GHA workflow

* Try to enable PDPD tests back
2023-09-27 18:03:02 +04:00
Ilya Lavrenov a6e7bac962
Added RISC-V Conan build (#20064) 2023-09-27 12:24:20 +04:00
Ilya Lavrenov 8349849e1c
Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Mikhail Ryzhov 6f55feb592
[GHA] concurrency fix (#20040)
* fixed cancelation issue in post-commits

* hardcoded os suffix

* added comments

* Update .github/workflows/linux.yml

* improved condition to support release branches
2023-09-26 17:35:23 +02:00
Ilya Lavrenov 5616c26d19
Debian packages on GHA (#20033)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests

* Try to build debian packages in GHA

* Fixed debian packages build for multi-config generators
2023-09-26 01:54:41 +04:00
Ilya Lavrenov 85145cd60c
Refactored Linix GHA pipeline (#20021)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests
2023-09-25 17:00:30 +04:00
Andrey Kashchikhin 6d3f94762e
fix (#20037) 2023-09-25 16:44:14 +04:00
Andrey Babushkin 3e82849f3c
[workflows/linux] Switch to self-hosted runners in Azure Kubernetes Service (#19183)
* [workflows/liux] Trying AKS runners

* Remove sudo usages

* Fix repositories path

* Well, adding debug output

* execution bit?

* more debug output

* using bash...

* We should use shell syntax for env variables in 'run' sections

* again, may be we should use bash...

* fix cloning path for openvino repo

* more debug output

* Trying to populate WORKSPACE var in other way

* Trying different WORKSPACE

* export ALL variables for samples tests

* Trying to put openvino build into correct directory

* Replace more occurences of BUILD_DIR...

* Use shell expansion instead of Actions syntax in run steps

* Skip unit test failures

* Oops, there's no pytest for MO unit tests

* Oops, typo

* Fix LAYER_TESTS_INSTALL_DIR variable expansion

* Fix LAYER_TESTS_INSTALL_DIR for new stages

* Replace all the varibles

* Comment out CCACHE_DIR

I want to test worst-case scenario

* Comment setup ccache step

* Revert "Comment out CCACHE_DIR"

This reverts commit 046663a9f1.

* Just checking something

* Update with new stages from master

* One more stage to fix

* Fix INSTALL_DIR again (new stages were merged to master?)

* Remove concurrency limit (for test purposes)

* Trigger one more pipeline

* Disable concurrency settings

* Trigger another build

* Disable ccache (for testing purposes)

* trigger another build to measure duration without ccache

* And one more test commit

* Return back ccache

* Testing new image

* Enable concurrency back

* Using new image

* And another image

* Trying build on the clean image

* Install git

Upstream ubuntu image doesn't have git

* Oops, forgot apt-get update

* Upstream Ubuntu image, but using ACR cache

* Remove debug output

* Use Ubuntu image from ACR cache for the rest of the stages

* Display version of ccache

* Swith to ubuntu 20 temporarily (I hope)

* Set CCACHE_TEMP_DIR outside of shared space

* Revert "Swith to ubuntu 20 temporarily (I hope)"

This reverts commit 2e53109d83.

* trying ccche nohardlink option

* Trying to disable ccache file cloning

* fix CCACHE_TEMPDIR

* Install git to Python unit tests stage

* Install libsnappy-dev as tests require it

* Install python to test stage

* Fix env vars syntax in few places

* Update docker image name

* Increase timeout for CPU tests

* Debug output - trying to find out what's wrong with test reports

* Change file name in debug-output 'find' command

* let's try shell syntax for upload artifact action...

It most likely won't work but I see strange output in the logs:
Error: No files were found with the provided path: /__w/openvino/openvino/install/tests/TEST*.xml
/runner/_work/openvino/openvino/install/tests/logs/failed/*.log
/runner/_work/openvino/openvino/install/tests/logs/crashed/*.log
/runner/_work/openvino/openvino/install/tests/logs/hanged/*.log
/runner/_work/openvino/openvino/install/tests/logs/interapted/*.log
/runner/_work/openvino/openvino/install/tests/logs/disabled_tests.log. No
artifacts will be uploaded.

So the first path is translated to the path inside the container
correctly and the rest are not O_o

* Revert "let's try shell syntax for upload artifact action..."

This reverts commit eb19b4f319.

* Leave just disabled_tests.log (as it is the only one present)

* Use my own directory instead of github.workspace

Inside-container path translation doesn't work for upload-artifact
actions (it works only for the first path, but not for the rest)

* Revert "Leave just disabled_tests.log (as it is the only one present)"

This reverts commit 4321827880.

* Okay, let's try hardcoded workspace path...

* Okay, path should be inside "official" workspace. Hardcode it

* Missed some variables, replace github.workspace to hard-coded value

* Remove debug output 'find' command

* Remove old-style cache setup

* Clean ccache stats after cmake

* Change docker image to the one with non-root user

* Oops, switch to Ubuntu 20

* Playing with concurrency group name

* Oops, forgot sudo for ninja installation

* Revert "Oops, forgot sudo for ninja installation"

This reverts commit a7e1730279.

* Revert "Oops, switch to Ubuntu 20"

This reverts commit 19fe75f4af.

* Revert "Change docker image to the one with non-root user"

This reverts commit 553116492d.

* Use Ubuntu 20 DockerHub image

* Trying to force apt-get packages not to wait for user input

* Make DEBIAN_FRONTED for all stages

* Update reason of skipped MO unit test

* Add DEBIAN_FRONTED to all jobs

* Fix environment variables expansion in newly-added stages

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Fix review comments

* More review comment fixes

* Remove DEBIAN_FRONTEND from Python Models job

* "Get tools versions" step is absent on master

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-23 13:02:28 +04:00
Maxim Vafin 02f5b7a7e3
[PT FE] Add huggingface hub tests (#19858)
* [PT FE] Add huggingface hub tests

* Update requirements.txt

* natten can't be installed

* Remove librosa

* Add xfail and skip marks

* Remove t5

* Free up space

* Apply suggestions from code review

* Report free space

* Clean pip cache

* Temporarily disable det2 models

* More du info

* Remove tmp info

* More du stats

* Fix du report

* Optimize du

* Ignore error

* Finalize changes

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Ilya Lavrenov f53d880b2c
Updated dependabot config for GHA updates (#19970) 2023-09-20 13:52:05 +04:00
dependabot[bot] a558ebd4bc
Bump actions/checkout from 3 to 4 (#19964)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-20 10:31:34 +04:00