c21fd2ea61
[PT FE]: fix object has no attribute 'dtype' ( #20755 )
...
* [PT FE]: fix object has no attribute 'dtype'
* add model in tests
* update test
2023-10-30 18:36:08 +00:00
bc9b52ef7e
Increase timeout for hub tests ( #20764 )
2023-10-30 18:27:00 +04:00
53c9a0f3d4
update pytorch layer tests for torch 2.1 compatibility ( #20264 )
...
* update pytorch layer tests for torch 2.1 compatibility
2023-10-30 08:30:01 +04:00
f029ebb8e2
[PT FE] Fix mask2former model marks in tests ( #20717 )
...
* [PT FE] Fix mask2former model marks in tests
* Use better machine
* Add more models
* Update .github/workflows/linux.yml
2023-10-27 21:04:30 +04:00
46f46c6cc6
[PT FE] Fix xmod model test ( #20682 )
2023-10-25 08:00:34 +02:00
b17d0fe7f5
Update model list for hf hub tests ( #20485 )
...
* Update model list and install cpu torch
* Move to hub tests
* Update tests/model_hub_tests/torch_tests/requirements.txt
* Make pytorch mainteiners owners of torch tests
2023-10-20 20:12:00 +04:00
891f79ac84
[PT FE] Add aten::as_strided ( #19482 )
...
* Add aten::as_strided
* rm commented code
* Update src/frontends/pytorch/src/op/as_strided.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update src/frontends/pytorch/src/op/as_strided.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Fix CI error
* Fix CI issues
* mark_node for remaining constants
* Add test reproducing issue
* Use strides from torchscript
* Add led model to test suite
* Add sugested changes
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-10-20 14:24:10 +04:00
222fbb1aec
[PT FE]: support aten::fill_diagonal_, aten::fill ( #20395 )
...
* [PT FE]: support aten::fill_diagonal_, aten::fill
* remove xfail
* Update src/frontends/pytorch/src/op/full.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update tests/model_hub_tests/torch_tests/test_hf_transformers.py
---------
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-10-18 10:58:54 +02:00
f3b61d77e3
[GHA] Filter timm scope for model hub tests ( #20525 )
...
* Filter timm scope
* Apply suggestions from code review
2023-10-17 23:01:50 +04:00
0fec05ecf2
Mark models according to last validation and fix some problems in models ( #20324 )
...
* Mark models according to last validation and fix some problems in models
* Update tests/model_hub_tests/torch_tests/hf_transformers_models
2023-10-10 11:23:23 +02:00
7e7b6482aa
[GHA][HF] Switch python nightly tests to github runners ( #20286 )
...
* switched runners to GHA
* excluded timm models from nightly scope
* added sudo steps
* switched precommit too
2023-10-07 02:22:32 +04:00
6664164ce4
Fix results validation ( #20246 )
...
* Fix results validation
* Remove pt quantization
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Refactor requirements
* Revert "Refactor requirements"
This reverts commit f78fe3d774
2023-10-05 18:31:06 +04:00
64cc3a96bb
Restrict version of pytorch-quantization ( #20137 )
2023-09-28 23:11:41 +04:00
f85a276782
[GHA] Azure pip cache ( #20029 )
...
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* changed wheel installation way
* reset onednn
* added cleanup workload
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* switched PyTorch_Models
* fixed root issue
* upgrade pip
* set bash environments
* install pip deps
* added git installation
* added g++ deps
* added python-dev package
* get particular python-dev package
* fixed package name
* removed python-dev
* cython dep
* debug
* fixed inlude path
* test cache
* set home dir
* changed disk space calculation
* crosspipeline pip cache
* added tag for source builded deps
* immutable deps
* use commit id instead of tag
* Update .github/workflows/linux.yml
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* fixed logs upload condition
* removed pip upgrade
* changed detectotron version
* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* changed wheel installation way
* added cleanup workload
* reset onednn
* cleanup test
* fixed reqs install
* test cache depending on pip version
* syntax fix
* env overwriting test
* test env output
* fixed set env step
* move pip cahc initialization to step
* changed pip ver regexp
* set custom pip cahce for each step
* cleanup code and enabled test cleanup job
* test cleanup 2
* speedup removal
* check existed dir
* Enabled cache for samples job
* removed debug job
* changed way how to get pip ver
* improved pip version extration
* revert omz
* review fixes
* remove cache files using atime
* mtime->atime
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
f735999e7b
Improve testing for hf models ( #20017 )
2023-09-22 20:10:33 +00:00
2151e5f979
[PT FE] Add tests for timm models ( #19997 )
...
* Add tests for timm models
* Apply suggestions from code review
* Some improvements
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
058b45e608
[PT FE] Fix aten::repeat regression ( #19991 )
...
* Revert "[PT FE] Simplify repeat operation (#19926 )"
This reverts commit f926e0e392
2023-09-21 23:58:09 +02:00
02f5b7a7e3
[PT FE] Add huggingface hub tests ( #19858 )
...
* [PT FE] Add huggingface hub tests
* Update requirements.txt
* natten can't be installed
* Remove librosa
* Add xfail and skip marks
* Remove t5
* Free up space
* Apply suggestions from code review
* Report free space
* Clean pip cache
* Temporarily disable det2 models
* More du info
* Remove tmp info
* More du stats
* Fix du report
* Optimize du
* Ignore error
* Finalize changes
* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
215a2f435b
tf.Graph decoder accuracy fixes ( #19903 )
...
* Fixed outputs passing from decoder.
* Fixed get_variable method.
* Code style.
* Removed xfails from precommit models.
* Minor fix.
* Comment fixed.
* Added test.
2023-09-19 19:04:24 +02:00
c10b45fe9e
[PT FE] Fix issue with http error when using torch.hub ( #19901 )
...
* [PT FE] Fix issue with http error when using torch.hub
* Mark failing models as xfail
* Remove incorrect model names
2023-09-18 17:04:39 +02:00
d90ceb93d1
[TF Hub][TF FE] Fix 5D case for FusedBatchNorm ( #19904 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:51:33 +00:00
df19699e3a
[TF Hub API][TF FE] Support TF Keras Model OOB without example_input ( #19892 )
...
* [TF Hub] Cover TF Hub use cases with adoption to OpenVINO
This is necessarily to demonstrate support of models programmed with TF Hub API
through OV notebooks.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Preserve original keras input and output tensor names
* Add tests with TF Hub API models
* No KerasLayer handling
* Handle specific signature
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:18:05 +00:00
a4cbac3dee
[PT FE] Add tests for detectron2 models ( #19888 )
...
* [PT FE] Add tests for detectron2 models
* Fix names of tests
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Create secondary requirements file
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-09-18 13:40:40 +02:00
3c762240f3
[PT FE] Add tests for torchvision models ( #19702 )
...
* [PT FE] Add tests for torchvision models
* Update tests/model_hub_tests/torch_tests/requirements.txt
* Apply review comments
* Clean tmp directory and make this separate job
* Update .github/workflows/linux.yml
* Update tests/model_hub_tests/torch_tests/test_torchvision_models.py
2023-09-13 15:24:09 +04:00
d1a8c8f914
[TF Hub] Set seed for input data generation and fix integer input data ( #19765 )
...
* [TF Hub] Set seed for input data generation and fix integer input data
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Clean-up workflow
* Update precommit model scope
* Avoid legacy generator
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-13 00:30:39 +04:00
530da61a4e
[TF Hub] Fix compute output size issue in test ( #19719 )
...
It helps to get 4 new models passed and other 2 models failed with accuracy issue.
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-11 12:14:09 +04:00
37f61551a3
[TF FE][TF Hub] Use ConcreteFunc input and output signatures ( #19690 )
...
* [TF Hub][TF FE] Preserve outputs of ConcreteFunction from signature and their names
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix naming and complete TODO
* Apply code-review: extra assert to check input_signature
* Fix inputs for fw
* Fix input data preparation and import convert_model
* Correct variable detection among all inputs
* Handle special input and output signature
* Fix adjust_saved_model_names
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-10 03:46:01 +00:00
63a6d4c41e
[TF Hub][GA] Set correct scheduler and model scope for regular validation ( #19658 )
...
* [TF Hub][GA] Set correct scheduler and model scope for regular validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove empty line
* Update .github/workflows/linux.yml
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
* Correct a path to output html report
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Andrey Kashchikhin <andrey.kashchikhin@intel.com>
2023-09-06 22:51:31 +02:00
4f7ac430fc
[TF Hub][TF FE][GA] Establish regular validation for all TF Hub models ( #19649 )
...
* [TF Hub][TF FE] Establish regular validation for all TF Hub models
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Correct names of reports
* Simplify configuration
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 17:02:59 +02:00
023a2f462a
[TF Hub][Notebook] Secure future notebook models in the precommit ( #19652 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-06 18:43:30 +04:00
188d53d813
[TF Hub][TF FE] Clean-up all downloaded files for TF Hub models validation ( #19612 )
...
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 13:07:13 +00:00
4eadef9e61
[TF Hub][TF FE] Make TF Hub validation more robust and add convenient xfail test marking ( #19596 )
...
* [TF Hub][TF FE] Use multiprocessing based tests for TF Hub validation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix import and initialization
* [TF Hub][TF FE] Make TF Hub validation more robust and add convenient marking for failing cases
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-05 09:41:01 +04:00
44657183f3
[TF Hub][TF FE] Fix TF Hub models validation and extend precommit ( #19567 )
...
* Add all scope of models for testing
* Fix signature in test
* Fix workaround with output tensor names
* Fix unknown rank input resource case
* [TF Hub][TF FE] Fix TF Hub model validation and extend precommit
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove unneeded comments
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-04 07:41:42 +02:00
1d0d00bf22
[TF Hub][GitHub Actions][TF FE] Introduce TF Hub Models Validation in GitHub Actions ( #19368 )
2023-08-23 18:40:31 +00:00
Ekaterina Aidova