natas_hw
/
openvino
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[TRANSFORMATIONS] Extend PositionIDsReplacer pattern (#24890) 

Extend PositionIDsReplacer pattern to support more models:
 - facebook/opt-350m

Signed-off-by: Andrii Staikov <andrii.staikov@intel.com>

### Tickets:
 - CVS-143065

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
This commit is contained in:
Andrii Staikov 2024-06-09 01:36:32 +02:00 committed by GitHub
parent f6e6f2af56
commit 6e67110da1
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
src/common/transformations/src/transformations/sdpa_to_paged_attention/position_ids_replacer.cpp
View File

@ -6,6 +6,8 @@
#include "openvino/cc/pass/itt.hpp"
#include "openvino/op/gather.hpp"
#include "openvino/op/matmul.hpp"
#include "openvino/pass/pattern/op/optional.hpp"
#include "openvino/pass/pattern/op/wrap_type.hpp"
#include "transformations/utils/utils.hpp"
@ -26,7 +28,9 @@ ov::pass::PositionIDsReplacer::PositionIDsReplacer(const Output<Node>& position_
auto convert = pattern::wrap_type<v0::Convert>({add_offset});
auto position_embed = pattern::wrap_type<v8::Gather>({pattern::any_input(), convert, pattern::any_input()});
auto add = pattern::wrap_type<v1::Add>({input_embed, position_embed});
auto mul = pattern::optional<v0::MatMul>({input_embed, pattern::any_input()});
auto add = pattern::wrap_type<v1::Add>({mul, position_embed});
ov::matcher_pass_callback callback = [=](ov::pass::pattern::Matcher& m) {
const auto& pattern_map = m.get_pattern_value_map();