Code
Hub
Workspaces
Connect
Indexed graphs
Engine
MCP
copy
hub
/
github.com/huggingface/transformers
/ __init__
Method
__init__
src/transformers/tokenization_python.py:51–55 ·
view source on GitHub ↗
(self, *args)
Source
from the content-addressed store, hash-verified
49
""
"
50
51
def
__init__(self, *args):
52
self.data = {}
53
self._tokens = set()
54
self._termination_char =
""
55
self.update(*args)
56
57
def
update(self, *args):
58
""
"
Callers
2
__init__
Method · 0.45
__init__
Method · 0.45
Calls
1
update
Method · 0.95
Tested by
no test coverage detected