natas_hw
/
openvino
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[TF FE] Add testing model with tokenizer to precommit (#22141) 

* [TF FE] Add testing model with tokenizer to precommit

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix typo

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
This commit is contained in:
Roman Kazantsev 2024-01-16 10:36:29 +04:00 committed by GitHub
parent cc597ee4fd
commit 464c35181a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 10 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
tests/model_hub_tests/models_hub_common/test_convert_model.py
View File

@ -8,6 +8,13 @@ from models_hub_common.utils import compare_two_tensors
from openvino import convert_model
from openvino.runtime import Core
try:
# 129480 - remove try-except when openvino-tokenizers wheel is built in OpenVINO GHA Workflow
# noinspection PyUnresolvedReferences
import openvino_tokenizers # do not delete, needed for text models
except:
pass
# set seed to have deterministic input data generation
# to avoid sporadic issues in inference results
rng = np.random.default_rng(seed=56190)

4
tests/model_hub_tests/tf_hub_tests/precommit_models
View File

@ -21,4 +21,6 @@ esrgan-tf2,https://www.kaggle.com/models/kaggle/esrgan-tf2/frameworks/tensorFlow
film,https://www.kaggle.com/models/google/film/frameworks/tensorFlow2/variations/film/versions/1
planet/vision/classifier/planet_v2,https://www.kaggle.com/models/google/planet-v2/frameworks/tensorFlow1/variations/planet-vision-classifier-planet-v2/versions/1
# TF1 models in .pb format
i3d-rgb,https://storage.openvinotoolkit.org/repositories/open_model_zoo/public/2022.1/i3d-rgb-tf/rgb.frozen.pb
i3d-rgb,https://storage.openvinotoolkit.org/repositories/open_model_zoo/public/2022.1/i3d-rgb-tf/rgb.frozen.pb
# Model with SentencePiece tokenizer, use openvino-tokenizers package
universal-sentence-encoder-multilingual,https://www.kaggle.com/models/google/universal-sentence-encoder/frameworks/tensorFlow2/variations/multilingual/versions/2,skip, 129480 - Add openvino-tokenizers wheel build to OpenVINO GHA Workflow