Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/huggingface/transformers
/ functions
Functions
4,119 in github.com/huggingface/transformers
⨍
Functions
4,119
◇
Types & classes
939
↳
Endpoints
4
Method
save_vocabulary
Save the sentencepiece vocabulary (copy original file) and special tokens file to a directory. Args: save_directory (:ob
src/transformers/tokenization_camembert.py:268
Method
save_vocabulary
Save the tokenizer vocabulary to a directory. This method does *NOT* save added tokens and special token mappings. Please us
src/transformers/tokenization_utils.py:902
Method
sep_token
Separation token (string). E.g. separate context and query in an input sequence. Log an error if used while not having been set.
src/transformers/tokenization_utils_base.py:742
Method
sep_token_id
Id of the separation token in the vocabulary. E.g. separate context and query in an input sequence. Log an error if used while not having been set.
src/transformers/tokenization_utils_base.py:835
Function
serve_command_factory
Factory function used to instantiate serving server from provided command line arguments. :return: ServeCommand
src/transformers/commands/serving.py:30
Method
setUp
(self)
templates/adding_a_new_model/tests/test_tokenization_xxx.py:29
Method
setUp
(self)
templates/adding_a_new_model/tests/test_modeling_tf_xxx.py:222
Method
setUp
(self)
templates/adding_a_new_model/tests/test_modeling_xxx.py:243
Method
setUp
(self)
tests/test_modeling_roberta.py:234
Method
setUp
(self)
tests/test_modeling_tf_albert.py:232
Method
setUp
(self)
tests/test_tokenization_common.py:64
Method
setUp
(self)
tests/test_modeling_bart.py:128
Method
setUp
(self)
tests/test_modeling_transfo_xl.py:194
Method
setUp
(self)
tests/test_modeling_tf_transfo_xl.py:175
Method
setUp
(self)
tests/test_modeling_tf_distilbert.py:208
Method
setUp
(self)
tests/test_modeling_tf_electra.py:190
Method
setUp
(self)
tests/test_tokenization_ctrl.py:29
Method
setUp
(self)
tests/test_modeling_albert.py:277
Method
setUp
(self)
tests/test_tokenization_xlnet.py:33
Method
setUp
(self)
tests/test_modeling_gpt2.py:315
Method
setUp
(self)
tests/test_modeling_tf_mobilebert.py:277
Method
setUp
(self)
tests/test_modeling_bert.py:449
Method
setUp
(self)
tests/test_tokenization_transfo_xl.py:35
Method
setUp
(self)
tests/test_modeling_mobilebert.py:385
Method
setUp
(self)
tests/test_modeling_tf_bert.py:273
Method
setUp
(self)
tests/test_modeling_tf_ctrl.py:164
Method
setUp
(self)
tests/test_modeling_tf_gpt2.py:282
Method
setUp
(self)
tests/test_tokenization_albert.py:32
Method
setUp
(self)
tests/test_tokenization_gpt2.py:31
Method
setUp
(self)
tests/test_tokenization_fast.py:44
Method
setUp
(self)
tests/test_modeling_distilbert.py:248
Method
setUp
(self)
tests/test_modeling_tf_xlnet.py:390
Method
setUp
(self)
tests/test_tokenization_bert.py:40
Method
setUp
(self)
tests/test_modeling_openai.py:180
Method
setUp
(self)
tests/test_modeling_t5.py:312
Method
setUp
(self)
tests/test_modeling_ctrl.py:174
Method
setUp
(self)
tests/test_tokenization_roberta.py:30
Method
setUp
(self)
tests/test_modeling_tf_xlm.py:283
Method
setUp
(self)
tests/test_modeling_longformer.py:290
Method
setUp
(self)
tests/test_modeling_tf_t5.py:226
Method
setUp
(self)
tests/test_modeling_tf_roberta.py:207
Method
setUp
(self)
tests/test_model_card.py:26
Method
setUp
(self)
tests/test_tokenization_xlm_roberta.py:34
Method
setUp
(self)
tests/test_tokenization_xlm.py:31
Method
setUp
(self)
tests/test_modeling_tf_openai_gpt.py:195
Method
setUp
(self)
tests/test_modeling_xlm.py:358
Method
setUp
(self)
tests/test_modeling_xlnet.py:471
Method
setUp
(self)
tests/test_tokenization_bert_japanese.py:163
Method
setUp
(self)
tests/test_tokenization_openai.py:30
Method
setUp
(self)
tests/test_tokenization_t5.py:33
Method
setUp
(self)
tests/test_pipelines.py:46
Method
setUp
(self)
tests/test_modeling_reformer.py:513
Method
setUp
(self)
tests/test_modeling_reformer.py:569
Method
setUp
(self)
tests/test_modeling_flaubert.py:328
Method
setUp
(self)
tests/test_tokenization_marian.py:40
Method
setUp
(self)
tests/test_modeling_electra.py:333
Method
setUp
(self)
examples/seq2seq/bertabs/test_utils_summarization.py:24
Method
setUpClass
(cls)
tests/test_modeling_bart.py:223
Method
setUpClass
(cls)
tests/test_modeling_marian.py:77
Method
setUpClass
Share this valid token in all tests below.
tests/test_hf_api.py:58
Method
setUpClass
(cls)
examples/seq2seq/test_seq2seq_examples.py:106
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_electra.py:221
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_distilbert.py:401
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_ctrl.py:320
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_albert.py:526
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_transfo_xl.py:473
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_xlnet.py:655
Method
set_input_embeddings
(self, value)
src/transformers/modeling_bart.py:888
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_openai.py:232
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_xlm.py:388
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_bert.py:516
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_distilbert.py:431
Method
set_input_embeddings
(self, value)
src/transformers/modeling_reformer.py:1525
Method
set_input_embeddings
(self, value)
src/transformers/modeling_bert.py:657
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_gpt2.py:242
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_gpt2.py:364
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_xlnet.py:398
Method
set_input_embeddings
(self, value)
src/transformers/modeling_albert.py:462
Method
set_input_embeddings
(self, value)
src/transformers/modeling_mobilebert.py:741
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_xlm.py:316
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_t5.py:872
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_t5.py:1008
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_openai.py:350
Method
set_input_embeddings
(self, value)
src/transformers/modeling_roberta.py:161
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_tf_t5.py:894
Method
set_input_embeddings
(self, new_embeddings)
src/transformers/modeling_tf_t5.py:1037
Method
set_input_embeddings
(self, value)
src/transformers/modeling_electra.py:256
Method
set_input_embeddings
(self, value)
src/transformers/modeling_mmbt.py:275
Method
set_input_embeddings
(self, value)
src/transformers/modeling_tf_ctrl.py:219
Method
set_input_embeddings
(self, value)
examples/movement-pruning/emmental/modeling_bert_masked.py:491
Method
set_patience
(self, patience)
examples/bert-loses-patience/pabee/modeling_pabee_albert.py:78
Method
set_regression_threshold
(self, threshold)
examples/bert-loses-patience/pabee/modeling_pabee_albert.py:75
Method
shape
separate heads
src/transformers/modeling_distilbert.py:159
Method
shape
projection
src/transformers/modeling_xlm.py:142
Method
shape
separate heads
src/transformers/modeling_tf_distilbert.py:243
Method
shape
projection
src/transformers/modeling_tf_xlm.py:154
Method
shape
projection
src/transformers/modeling_tf_t5.py:234
Method
shape
projection
examples/seq2seq/bertabs/modeling_bertabs.py:449
Function
slow
Decorator marking a test as slow. Slow tests are skipped by default. Set the RUN_SLOW environment variable to a truthy value to run them
tests/utils.py:47
Method
span_to_answer
When decoding from token probalities, this method maps token indexes to actual word in the initial context. Args:
src/transformers/pipelines.py:1307
← previous
next →
3,301–3,400 of 4,119, ranked by callers