Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/huggingface/transformers
/ functions
Functions
4,119 in github.com/huggingface/transformers
⨍
Functions
4,119
◇
Types & classes
939
↳
Endpoints
4
Method
get_output_embeddings
(self)
src/transformers/modeling_openai.py:480
Method
get_output_embeddings
(self)
src/transformers/modeling_openai.py:572
Method
get_output_embeddings
(self)
src/transformers/modeling_roberta.py:178
Method
get_output_embeddings
(self)
src/transformers/modeling_tf_t5.py:541
Method
get_output_embeddings
(self)
src/transformers/modeling_tf_t5.py:891
Method
get_output_embeddings
(self)
src/transformers/modeling_electra.py:560
Method
get_output_embeddings
(self)
src/transformers/modeling_tf_ctrl.py:552
Method
get_rust_tokenizer
(self, **kwargs)
tests/test_tokenization_distilbert.py:27
Method
get_rust_tokenizer
(self, **kwargs)
tests/test_tokenization_roberta.py:71
Function
get_setup_file
()
examples/test_examples.py:44
Function
get_setup_file
()
examples/bert-loses-patience/test_run_glue_with_pabee.py:15
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
templates/adding_a_new_model/tokenization_xxx.py:171
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_xlm_roberta.py:204
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_roberta.py:191
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_albert.py:261
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_xlnet.py:265
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_bert.py:261
Method
get_special_tokens_mask
Get list where entries are [1] if a token is [eos] or [pad] else 0.
src/transformers/tokenization_marian.py:215
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_camembert.py:169
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_utils_base.py:2051
Method
get_test_examples
Gets a collection of :class:`InputExample` for the test set.
src/transformers/data/processors/utils.py:102
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:188
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:230
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:259
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:284
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:327
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:369
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:459
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:501
Method
get_test_examples
See base class.
src/transformers/data/processors/glue.py:543
Method
get_test_examples
See base class.
src/transformers/data/processors/xnli.py:52
Method
get_test_examples
Gets a collection of `InputExample`s for the test set.
examples/multiple-choice/utils_multiple_choice.py:227
Method
get_test_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:257
Method
get_test_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:316
Method
get_test_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:362
Method
get_tokenizer
(self, **kwargs)
templates/adding_a_new_model/tests/test_tokenization_xxx.py:51
Method
get_tokenizer
(self, **kwargs)
tests/test_tokenization_bert_japanese.py:172
Method
get_tokenizer
(self, **kwargs)
tests/test_tokenization_marian.py:54
Method
get_train_examples
Gets a collection of :class:`InputExample` for the train set.
src/transformers/data/processors/utils.py:94
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:179
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:222
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:276
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:319
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:361
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:451
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:493
Method
get_train_examples
See base class.
src/transformers/data/processors/glue.py:535
Method
get_train_examples
See base class.
src/transformers/data/processors/xnli.py:36
Method
get_train_examples
Returns the training examples from the data directory. Args: data_dir: Directory containing the data files used for trai
src/transformers/data/processors/squad.py:513
Method
get_train_examples
Gets a collection of `InputExample`s for the train set.
examples/multiple-choice/utils_multiple_choice.py:219
Method
get_train_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:239
Method
get_train_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:306
Method
get_train_examples
See base class.
examples/multiple-choice/utils_multiple_choice.py:352
Method
get_varlen_iter
(self, start=0, std=5, min_len=5, max_deviation=3)
src/transformers/tokenization_transfo_xl.py:538
Method
get_vocab
(self)
src/transformers/tokenization_xlm_roberta.py:264
Method
get_vocab
(self)
src/transformers/tokenization_openai.py:128
Method
get_vocab
(self)
src/transformers/tokenization_albert.py:161
Method
get_vocab
(self)
src/transformers/tokenization_reformer.py:121
Method
get_vocab
(self)
src/transformers/tokenization_gpt2.py:177
Method
get_vocab
(self)
src/transformers/tokenization_transfo_xl.py:336
Method
get_vocab
(self)
src/transformers/tokenization_ctrl.py:157
Method
get_vocab
(self)
src/transformers/tokenization_xlm.py:702
Method
get_vocab
(self)
src/transformers/tokenization_xlnet.py:164
Method
get_vocab
(self)
src/transformers/tokenization_bert.py:205
Method
get_vocab
(self)
src/transformers/tokenization_marian.py:190
Method
get_vocab
Returns the vocabulary as a dict of {token: index} pairs. `tokenizer.get_vocab()[token]` is equivalent to `tokenizer.convert_tokens_to_ids(token)` wh
src/transformers/tokenization_utils.py:174
Method
gpu_list
(self)
src/transformers/benchmark/benchmark_args_tf.py:93
Function
hans_data_collator
Data collator that removes the "pairID" key if present.
examples/adversarial/run_hans.py:86
Method
hidden_size
(self)
templates/adding_a_new_model/configuration_xxx.py:105
Method
hidden_size
(self)
src/transformers/configuration_bart.py:135
Method
hidden_size
(self)
src/transformers/configuration_ctrl.py:129
Method
hidden_size
(self)
src/transformers/configuration_openai.py:163
Method
hidden_size
(self)
src/transformers/configuration_xlm.py:243
Method
hidden_size
(self)
src/transformers/configuration_distilbert.py:130
Method
hidden_size
(self)
src/transformers/configuration_t5.py:104
Method
hidden_size
(self)
src/transformers/configuration_xlnet.py:211
Method
hidden_size
(self)
src/transformers/configuration_transfo_xl.py:198
Method
hidden_size
(self)
src/transformers/configuration_gpt2.py:168
Function
info_command_factory
(_)
src/transformers/commands/env.py:9
Method
init_mems
(self, bsz)
src/transformers/modeling_tf_transfo_xl.py:801
Method
init_mems
(self, bsz)
src/transformers/modeling_transfo_xl.py:935
Method
is_fast
(self)
src/transformers/tokenization_utils_fast.py:116
Method
is_fast
Indicate if this BatchEncoding was generated from the result of a PreTrainedTokenizerFast Returns: True if generated from subclasses
src/transformers/tokenization_utils_base.py:162
Method
is_fast
(self)
src/transformers/tokenization_utils.py:166
Method
is_gpu
(self)
src/transformers/benchmark/benchmark_args.py:85
Method
is_gpu
(self)
src/transformers/benchmark/benchmark_args_tf.py:104
Function
is_memory_tracing_enabled
()
src/transformers/benchmark/benchmark_utils.py:103
Method
is_tpu
(self)
src/transformers/benchmark/benchmark_args.py:65
Method
is_tpu
(self)
src/transformers/benchmark/benchmark_args_tf.py:83
Function
keras_serializable
Decorate a Keras Layer class to support Keras serialization. This is done by: 1. adding a `transformers_config` dict to the Keras config
src/transformers/modeling_tf_utils.py:49
Method
length_average
Returns the average probability of tokens in a sequence.
examples/seq2seq/bertabs/modeling_bertabs.py:725
Method
length_none
Returns unmodified scores.
examples/seq2seq/bertabs/modeling_bertabs.py:731
Method
length_wu
NMT length re-ranking score from "Google's Neural Machine Translation System" :cite:`wu2016google`.
examples/seq2seq/bertabs/modeling_bertabs.py:716
Method
load_dataset
Load datasets. Called after prepare data.
examples/text-classification/run_pl_glue.py:75
Method
load_hf_checkpoint
(self, *args, **kwargs)
examples/lightning_base.py:98
Function
load_pytorch_model_in_tf2_model
Load pytorch checkpoints in a TF 2.0 model
src/transformers/modeling_tf_pytorch_utils.py:97
Method
log_stats
(self)
examples/bert-loses-patience/pabee/modeling_pabee_albert.py:85
Function
lr_lambda
(current_step)
src/transformers/optimization.py:39
Function
make_es_index_snippets
(es_client, passages_dset, index_name="english_wiki_kilt_snippets_100w")
examples/longform-qa/eli5_utils.py:27
Function
make_qa_dense_index
( qa_embedder, tokenizer, passages_dset, batch_size=512, max_length=128, index_name="k
examples/longform-qa/eli5_utils.py:555
← previous
next →
3,001–3,100 of 4,119, ranked by callers