Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/huggingface/sentence-transformers
/ functions
Functions
404 in github.com/huggingface/sentence-transformers
⨍
Functions
404
◇
Types & classes
85
Method
tokenize
(self, text: str)
sentence_transformers/models/LSTM.py:41
Method
tokenize
(self, text: str)
sentence_transformers/models/tokenizer/WhitespaceTokenizer.py:25
Method
tokenize
(self, text: str)
sentence_transformers/models/tokenizer/PhraseTokenizer.py:49
Method
tokenize
(self, text: str)
sentence_transformers/models/tokenizer/WordTokenizer.py:17
← previous
401–404 of 404, ranked by callers