Roman Kazantsev
bac895b33d
[TF Hub] Mark up tests failing with error "No signature found" ( #21920 )
...
* [TF Hub] Mark up tests failing with error "No signature found"
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tests/model_hub_tests/tf_hub_tests/nightly_models
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-01-02 16:30:16 +01:00
Maxim Vafin
98c309f96b
[PT FE] Filter timm models prio smaller, adjust models failed in nightly ( #21912 )
...
* [PT FE] Filter timm models prio smaller, adjust models failed in nightly
* Remove debug output
* Update tests/model_hub_tests/torch_tests/test_timm.py
2023-12-29 21:12:24 +01:00
Roman Kazantsev
fe9c56f688
[TF Hub] Support pb models for testing ( #21883 )
...
* [TF Hub] Support pb models for testing
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix model hub tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-12-27 20:37:10 +04:00
Roman Kazantsev
26c01d683d
[TF Hub] Update precommit with model containing TensorListConcatV2 op ( #21859 )
...
* [TF Hub] Update precommit with model containing TensorListConcatV2 op
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tests/model_hub_tests/tf_hub_tests/precommit_models
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-12-27 12:06:22 +01:00
Ilya Lavrenov
c79ae17bbf
Removed GNA plugin from 2024.0 ( #21800 )
2023-12-21 13:39:06 +01:00
Pavel Esir
137180bce5
[tests] resolves skipped HF tests: 3rd batch ( #21678 )
...
* resolves skipped HF tests: 3rd batch
* remove comments
* minor corrections
* replace example input *argc -> **kwargc
* use config instead of dict in example input
* add kwargs
2023-12-15 19:58:12 +04:00
Maxim Vafin
be7c70c8c4
[PT FE] Support aten::scatter_add ( #21633 )
2023-12-13 17:54:33 +01:00
Pavel Esir
20ad8b43a1
Enable dinov2-base ( #21626 )
...
with the newest transformers dinov-2-base started to pass
2023-12-13 13:52:52 +00:00
Maxim Vafin
34b2b66b69
[PT FE] Report unsupported operations with model list ( #21607 )
...
* [PT FE] Report unsupported operations with model list
* Continue on error
* Disable more models
* Check if file exists
* continue of error
* Fix on failure
* Fix file path
* Apply suggestions from code review
2023-12-12 21:25:27 +00:00
Maxim Vafin
0f6b9abee8
Support aten::lstm, aten::gru and aten::rnn_{relu,tanh} operations ( #21579 )
...
* [PT FE] Initial LSTM impl
* Support aten::lstm operation
* Support aten::gru and aten::rnn_{relu,tanh}
* Apply suggestions from code review
* Fix build
* Simplify implementation
* More simplification
* Update src/frontends/pytorch/src/op/lstm.cpp
* Simplification
* Use default LSTM helpers
---------
Co-authored-by: Roboreptile <piotr.krzeminski@intel.com>
2023-12-11 19:06:51 +00:00
Pavel Esir
948fc265b4
[tests] resolve skipped HF models: 2nd batch ( #21526 )
...
* resolve skipped HF models: 2nd batch
* commented out models with no info and less than 10 downloads
* Revert "commented out models with no info and less than 10 downloads"
This reverts commit a55861ed69 .
* replace with self.image
* resolve todo
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-12-11 15:12:12 +04:00
Evgeny Kotov
90087dbb48
Use time limits instead of number iterations limits in GHA performance tests ( #21407 )
...
* use perf_counter_ns to measure performance; meausure within time not count
* fixes
* remove nightly
* set 60 secs by default
* fix output html
* code review fixes
* fix runtime duration
* remove unneeded inference
* cleanup
2023-12-07 11:53:27 +04:00
Ekaterina Aidova
d1f72e2d01
add gptq model test in pytorch hub tests ( #21399 )
...
* conflict
* refactor test
* fix for case if can not instantiate config
2023-12-01 10:56:05 +00:00
Maxim Vafin
db6aeb7a65
[PT FE] Add torchbenchmark models to GHA tests ( #21401 )
...
* [PT FE] Add torchbenchmark models to GHA tests
* Fix teardown
* Fix requirements
* Update tests/model_hub_tests/torch_tests/torchbench_models
* Update tests/model_hub_tests/torch_tests/torchbench_models
* Update tests/model_hub_tests/torch_tests/test_torchbench.py
2023-12-01 09:44:12 +01:00
Roman Kazantsev
c1cfb00f81
[TF Hub] Fix typo in test file name ( #21408 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-30 23:49:01 +00:00
Maxim Vafin
fa7a4f44b5
[PT FE] Update torch to 2.1 in GHA tests ( #21391 )
...
* [PT FE] Update torch to 2.1 in GHA tests
* Adjust requirements for natten
* Add upper bound
* Use sys.executable
2023-11-30 17:48:40 +00:00
Pavel Esir
d5d9fd11b3
[tests] resolve skipped HF tests: 1st batch ( #21305 )
...
* initial
* some corrections for the first batch
* corrected classes for generate, corrected xfail
* leave only models with correct example input
* remove an obsolete line
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* update musicgen
* cleanup test_hf_transformers.py
* typo fix
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
* move to up: corrected xfail
* revert back accidentally deleted elif
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-11-30 14:37:41 +00:00
Maxim Vafin
3cae6e7aea
[PT FE] Fix timm model list according to newest version ( #21376 )
...
* [PT FE] Fix timm model list according to newest version
* Remove xfail for hf model passed in latest nightly
* Fix code for loading vit_h model
* Restore torchvision
2023-11-30 08:17:21 +04:00
Maxim Vafin
007b6fd82c
[PT FE] Add support for GFPGAN model ( #21371 )
...
* [PT FE] Add support for GFPGAN model
* Remove logs
* Fix codestyle
* Add support for aten::normal
2023-11-29 23:05:46 +00:00
Maxim Vafin
f3fe6b3f00
[PT FE] Add EDSR models to GHA tests ( #21350 )
...
* [PT FE] Add EDSR models to GHA tests
* Apply suggestions from code review
2023-11-28 21:05:33 +00:00
Roman Kazantsev
7c590bf180
[Hub Tests] Apply Python code formatting ( #21286 )
...
* Apply Python code formatting
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Apply Python code formatting
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-28 16:54:02 +04:00
Maxim Vafin
e52f922d35
[PT FE] Unify hub tests, add marks for timm models ( #21283 )
...
* Unify hub tests, add marks for timm models
* Fix hf tests
2023-11-27 12:22:13 +04:00
Luo Cheng
91660b1c05
[CPU] Fix ScaledDotProductAttension accuracy problem ( #21217 )
2023-11-26 14:47:04 +04:00
Evgeny Kotov
965313ba0b
[TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths ( #21023 )
...
* begin
* fixes
* measure time and compare
* fix bug + update precommint models
* cleanup
* add wget to install requirements; add to linux.yml
* fixes + improvements
* output results to html
* remove unneeded code
* fix
* code review fixes
* store downloaded models in cache
* use 1000 runs
* use model paths from tf-hub tests
* use tf hub api to download instead of wget; measure some time stats
* small fixes
* remove unneeded files
* use own list of models
* remove uneeded if
* remove unstable models
* remove unstable models
* fix requirements
* code review fixes
* Update .github/workflows/linux.yml
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* fix round_num function
* remove unstable network
* Update tests/model_hub_tests/models_hub_common/test_performance_model.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* code review fixes
* build fix
* code review fixes
* code review fixes
* code review fixes
* Update tests/model_hub_tests/models_hub_common/test_performance_model.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Update tests/model_hub_tests/models_hub_common/test_performance_model.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* code review fixes: use autoflake
* remove unneeded tensorflow_text
* Update .github/workflows/linux.yml
* Update linux.yml
Added TensorFlow_Hub_Performance_Models_Tests to final status check
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00
Roman Kazantsev
bb773137f1
[TF Hub] Move all nightly scope to Kaggle links ( #21169 )
...
7 models are skipped since they are not moved there. Now they are not available.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-20 13:33:21 +04:00
Roman Kazantsev
2928b6bfed
[TF Hub] Move pre-commit to Kaggle model links ( #21113 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-16 14:24:45 +04:00
Maxim Vafin
369831caef
[PT FE] Use system model cache when running torch hub tests locally ( #21047 )
...
* Use system model cache when running torch hub tests locally
* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-11-14 11:43:06 +01:00
Roman Kazantsev
75c72157dd
[TF Hub] Add yamnet with complex tensors into precommit ( #21035 )
...
After fixing ov.Tensor creation for empty numpy array, we are ready to support yamnet
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-13 17:42:13 +04:00
Maxim Vafin
cdd342ea49
[PT FE] Add ALIKED to model tests ( #20899 )
...
* Add ALIKED to model tests
* Update tests/model_hub_tests/torch_tests/test_aliked.py
* Update tests/model_hub_tests/torch_tests/test_aliked.py
2023-11-07 09:34:26 +01:00
Maxim Vafin
e976e7b90c
[PT FE] Add tests for Speech-Transformer ( #20847 )
...
* Add tests for Speech-Transformer
* Update tests/model_hub_tests/torch_tests/test_speech-transformer.py
* Update tests/model_hub_tests/torch_tests/test_speech-transformer.py
2023-11-07 08:32:22 +01:00
Roman Kazantsev
494a9cf9a9
[TF FE] Refine tests for complex tensors support ( #20905 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-07 10:29:45 +04:00
Roman Kazantsev
4a6e6e64c5
[TF FE] Fix conversion of FILM of keras.Model format ( #20825 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-02 12:46:57 +04:00
Ekaterina Aidova
c21fd2ea61
[PT FE]: fix object has no attribute 'dtype' ( #20755 )
...
* [PT FE]: fix object has no attribute 'dtype'
* add model in tests
* update test
2023-10-30 18:36:08 +00:00
Maxim Vafin
bc9b52ef7e
Increase timeout for hub tests ( #20764 )
2023-10-30 18:27:00 +04:00
Ekaterina Aidova
53c9a0f3d4
update pytorch layer tests for torch 2.1 compatibility ( #20264 )
...
* update pytorch layer tests for torch 2.1 compatibility
2023-10-30 08:30:01 +04:00
Maxim Vafin
f029ebb8e2
[PT FE] Fix mask2former model marks in tests ( #20717 )
...
* [PT FE] Fix mask2former model marks in tests
* Use better machine
* Add more models
* Update .github/workflows/linux.yml
2023-10-27 21:04:30 +04:00
Maxim Vafin
46f46c6cc6
[PT FE] Fix xmod model test ( #20682 )
2023-10-25 08:00:34 +02:00
Maxim Vafin
b17d0fe7f5
Update model list for hf hub tests ( #20485 )
...
* Update model list and install cpu torch
* Move to hub tests
* Update tests/model_hub_tests/torch_tests/requirements.txt
* Make pytorch mainteiners owners of torch tests
2023-10-20 20:12:00 +04:00
Mateusz Mikolajczyk
891f79ac84
[PT FE] Add aten::as_strided ( #19482 )
...
* Add aten::as_strided
* rm commented code
* Update src/frontends/pytorch/src/op/as_strided.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update src/frontends/pytorch/src/op/as_strided.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Fix CI error
* Fix CI issues
* mark_node for remaining constants
* Add test reproducing issue
* Use strides from torchscript
* Add led model to test suite
* Add sugested changes
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-10-20 14:24:10 +04:00
Ekaterina Aidova
222fbb1aec
[PT FE]: support aten::fill_diagonal_, aten::fill ( #20395 )
...
* [PT FE]: support aten::fill_diagonal_, aten::fill
* remove xfail
* Update src/frontends/pytorch/src/op/full.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-10-18 10:58:54 +02:00
Maxim Vafin
f3b61d77e3
[GHA] Filter timm scope for model hub tests ( #20525 )
...
* Filter timm scope
* Apply suggestions from code review
2023-10-17 23:01:50 +04:00
Maxim Vafin
0fec05ecf2
Mark models according to last validation and fix some problems in models ( #20324 )
...
* Mark models according to last validation and fix some problems in models
* Update tests/model_hub_tests/torch_tests/hf_transformers_models
2023-10-10 11:23:23 +02:00
Mikhail Ryzhov
7e7b6482aa
[GHA][HF] Switch python nightly tests to github runners ( #20286 )
...
* switched runners to GHA
* excluded timm models from nightly scope
* added sudo steps
* switched precommit too
2023-10-07 02:22:32 +04:00
Maxim Vafin
6664164ce4
Fix results validation ( #20246 )
...
* Fix results validation
* Remove pt quantization
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor requirements
* Revert "Refactor requirements"
This reverts commit f78fe3d774 .
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-05 18:31:06 +04:00
Maxim Vafin
64cc3a96bb
Restrict version of pytorch-quantization ( #20137 )
2023-09-28 23:11:41 +04:00
Mikhail Ryzhov
f85a276782
[GHA] Azure pip cache ( #20029 )
...
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* changed wheel installation way
* reset onednn
* added cleanup workload
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* changed wheel installation way
* added cleanup workload
* reset onednn
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* review fixes
* remove cache files using atime
* mtime->atime
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
Maxim Vafin
f735999e7b
Improve testing for hf models ( #20017 )
2023-09-22 20:10:33 +00:00
Maxim Vafin
2151e5f979
[PT FE] Add tests for timm models ( #19997 )
...
* Add tests for timm models
* Apply suggestions from code review
* Some improvements
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
Maxim Vafin
058b45e608
[PT FE] Fix aten::repeat regression ( #19991 )
...
* Revert "[PT FE] Simplify repeat operation (#19926 )"
This reverts commit f926e0e392 .
* Fix aten::repeats regression
* Simplify
* Update src/frontends/pytorch/src/op_table.cpp
* Add impacted model
2023-09-21 23:58:09 +02:00
Maxim Vafin
02f5b7a7e3
[PT FE] Add huggingface hub tests ( #19858 )
...
* [PT FE] Add huggingface hub tests
* Update requirements.txt
* natten can't be installed
* Remove librosa
* Add xfail and skip marks
* Remove t5
* Free up space
* Apply suggestions from code review
* Report free space
* Clean pip cache
* Temporarily disable det2 models
* More du info
* Remove tmp info
* More du stats
* Fix du report
* Optimize du
* Ignore error
* Finalize changes
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Anastasiia Pnevskaia
215a2f435b
tf.Graph decoder accuracy fixes ( #19903 )
...
* Fixed outputs passing from decoder.
* Fixed get_variable method.
* Code style.
* Removed xfails from precommit models.
* Minor fix.
* Comment fixed.
* Added test.
2023-09-19 19:04:24 +02:00
Maxim Vafin
c10b45fe9e
[PT FE] Fix issue with http error when using torch.hub ( #19901 )
...
* [PT FE] Fix issue with http error when using torch.hub
* Mark failing models as xfail
* Remove incorrect model names
2023-09-18 17:04:39 +02:00
Roman Kazantsev
d90ceb93d1
[TF Hub][TF FE] Fix 5D case for FusedBatchNorm ( #19904 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:51:33 +00:00
Roman Kazantsev
df19699e3a
[TF Hub API][TF FE] Support TF Keras Model OOB without example_input ( #19892 )
...
* [TF Hub] Cover TF Hub use cases with adoption to OpenVINO
This is necessarily to demonstrate support of models programmed with TF Hub API
through OV notebooks.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Preserve original keras input and output tensor names
* Add tests with TF Hub API models
* No KerasLayer handling
* Handle specific signature
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:18:05 +00:00
Maxim Vafin
a4cbac3dee
[PT FE] Add tests for detectron2 models ( #19888 )
...
* [PT FE] Add tests for detectron2 models
* Fix names of tests
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Create secondary requirements file
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-18 13:40:40 +02:00
Maxim Vafin
3c762240f3
[PT FE] Add tests for torchvision models ( #19702 )
...
* [PT FE] Add tests for torchvision models
* Update tests/model_hub_tests/torch_tests/requirements.txt
* Apply review comments
* Clean tmp directory and make this separate job
* Update .github/workflows/linux.yml
* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-09-13 15:24:09 +04:00
Roman Kazantsev
d1a8c8f914
[TF Hub] Set seed for input data generation and fix integer input data ( #19765 )
...
* [TF Hub] Set seed for input data generation and fix integer input data
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Clean-up workflow
* Update precommit model scope
* Avoid legacy generator
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-13 00:30:39 +04:00
Roman Kazantsev
530da61a4e
[TF Hub] Fix compute output size issue in test ( #19719 )
...
It helps to get 4 new models passed and other 2 models failed with accuracy issue.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-11 12:14:09 +04:00
Roman Kazantsev
37f61551a3
[TF FE][TF Hub] Use ConcreteFunc input and output signatures ( #19690 )
...
* [TF Hub][TF FE] Preserve outputs of ConcreteFunction from signature and their names
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix naming and complete TODO
* Apply code-review: extra assert to check input_signature
* Fix inputs for fw
* Fix input data preparation and import convert_model
* Correct variable detection among all inputs
* Handle special input and output signature
* Fix adjust_saved_model_names
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-10 03:46:01 +00:00
Roman Kazantsev
63a6d4c41e
[TF Hub][GA] Set correct scheduler and model scope for regular validation ( #19658 )
...
* [TF Hub][GA] Set correct scheduler and model scope for regular validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove empty line
* Update .github/workflows/linux.yml
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
* Correct a path to output html report
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-09-06 22:51:31 +02:00
Roman Kazantsev
4f7ac430fc
[TF Hub][TF FE][GA] Establish regular validation for all TF Hub models ( #19649 )
...
* [TF Hub][TF FE] Establish regular validation for all TF Hub models
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Correct names of reports
* Simplify configuration
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 17:02:59 +02:00
Roman Kazantsev
023a2f462a
[TF Hub][Notebook] Secure future notebook models in the precommit ( #19652 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 18:43:30 +04:00
Roman Kazantsev
188d53d813
[TF Hub][TF FE] Clean-up all downloaded files for TF Hub models validation ( #19612 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 13:07:13 +00:00
Roman Kazantsev
4eadef9e61
[TF Hub][TF FE] Make TF Hub validation more robust and add convenient xfail test marking ( #19596 )
...
* [TF Hub][TF FE] Use multiprocessing based tests for TF Hub validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix import and initialization
* [TF Hub][TF FE] Make TF Hub validation more robust and add convenient marking for failing cases
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 09:41:01 +04:00
Roman Kazantsev
44657183f3
[TF Hub][TF FE] Fix TF Hub models validation and extend precommit ( #19567 )
...
* Add all scope of models for testing
* Fix signature in test
* Fix workaround with output tensor names
* Fix unknown rank input resource case
* [TF Hub][TF FE] Fix TF Hub model validation and extend precommit
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unneeded comments
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-04 07:41:42 +02:00
Roman Kazantsev
1d0d00bf22
[TF Hub][GitHub Actions][TF FE] Introduce TF Hub Models Validation in GitHub Actions ( #19368 )
2023-08-23 18:40:31 +00:00