Commit Graph

9 Commits

Author SHA1 Message Date
zhoufeng ec7f9f395a fix cmake lint
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-03-21 15:43:33 +08:00
xsmq 73b7154e55 fix cmakelint error 2021-01-23 21:04:29 +08:00
xiaoyisd 424999267a mac build 2020-12-08 19:13:47 +08:00
xulei2020 55e386567a add gitee repo for thirdpary lib download 2020-10-15 15:27:02 +08:00
mayang 094bdbe253 MD5 value update in icu4c.cmake 2020-09-17 20:15:50 +08:00
qianlong 4c49d557d2 fix icu4c compile 2020-09-16 11:03:18 +08:00
qianlong 0c35247b58 change icu4c compile way 2020-07-07 14:54:49 +08:00
qianlong c737098017 fix icu complie error 2020-06-18 21:59:18 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
2020-06-17 15:47:04 +08:00