MCPcopy Create free account

hub / github.com/huggingface/transformers / functions

Functions4,119 in github.com/huggingface/transformers

Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the sequen
src/transformers/modeling_tf_distilbert.py:702
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size, sequence_length)`, `optional`, defaults to :obj:`None`): Labels for comp
src/transformers/modeling_tf_distilbert.py:786
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the multip
src/transformers/modeling_tf_distilbert.py:881
Methodcall
r""" start_positions (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for position (i
src/transformers/modeling_tf_distilbert.py:996
Methodcall
r""" Returns: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.RobertaConfig`) an
src/transformers/modeling_tf_roberta.py:206
Methodcall
(self, features)
src/transformers/modeling_tf_roberta.py:255
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.RobertaConfig`) and
src/transformers/modeling_tf_roberta.py:279
Methodcall
(self, features, training=False)
src/transformers/modeling_tf_roberta.py:323
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.RobertaConfig`) and
src/transformers/modeling_tf_roberta.py:347
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the multip
src/transformers/modeling_tf_roberta.py:434
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size, sequence_length)`, `optional`, defaults to :obj:`None`): Labels for comp
src/transformers/modeling_tf_roberta.py:554
Methodcall
r""" start_positions (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for position (i
src/transformers/modeling_tf_roberta.py:637
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_gpt2.py:139
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_gpt2.py:194
Methodcall
( self, inputs, past=None, attention_mask=None, token_type_ids=None,
src/transformers/modeling_tf_gpt2.py:252
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.GPT2Config`) and in
src/transformers/modeling_tf_gpt2.py:496
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.GPT2Config`) and in
src/transformers/modeling_tf_gpt2.py:544
Methodcall
r""" mc_token_ids (:obj:`tf.Tensor` or :obj:`Numpy array` of shape :obj:`(batch_size, num_choices)`, `optional`, default to index of the last
src/transformers/modeling_tf_gpt2.py:597
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_xlnet.py:204
Methodcall
(self, inp, training=False)
src/transformers/modeling_tf_xlnet.py:321
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_xlnet.py:339
Methodcall
(self, hidden_states)
src/transformers/modeling_tf_xlnet.py:363
Methodcall
( self, inputs, attention_mask=None, mems=None, perm_mask=None,
src/transformers/modeling_tf_xlnet.py:514
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.XLNetConfig`) and i
src/transformers/modeling_tf_xlnet.py:843
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.XLNetConfig`) and i
src/transformers/modeling_tf_xlnet.py:915
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the sequen
src/transformers/modeling_tf_xlnet.py:989
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the multip
src/transformers/modeling_tf_xlnet.py:1096
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size, sequence_length)`, `optional`, defaults to :obj:`None`): Labels for comp
src/transformers/modeling_tf_xlnet.py:1234
Methodcall
r""" start_positions (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for position (i
src/transformers/modeling_tf_xlnet.py:1326
Methodcall
(self, inputs, return_mean=True, training=False)
src/transformers/modeling_tf_transfo_xl_utilities.py:117
Methodcall
( self, inputs, attention_mask=None, langs=None, token_type_ids=None,
src/transformers/modeling_tf_flaubert.py:127
Methodcall
Self-attention (if kv is None) or attention over source sentence (provided by kv).
src/transformers/modeling_tf_xlm.py:137
Methodcall
(self, input, training=False)
src/transformers/modeling_tf_xlm.py:211
Methodcall
( self, inputs, attention_mask=None, langs=None, token_type_ids=None,
src/transformers/modeling_tf_xlm.py:330
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.XLMConfig`) and inp
src/transformers/modeling_tf_xlm.py:619
Methodcall
(self, hidden_states)
src/transformers/modeling_tf_xlm.py:668
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.XLMConfig`) and inp
src/transformers/modeling_tf_xlm.py:704
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the sequen
src/transformers/modeling_tf_xlm.py:746
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for computing the multip
src/transformers/modeling_tf_xlm.py:842
Methodcall
r""" labels (:obj:`tf.Tensor` of shape :obj:`(batch_size, sequence_length)`, `optional`, defaults to :obj:`None`): Labels for comp
src/transformers/modeling_tf_xlm.py:971
Methodcall
r""" start_positions (:obj:`tf.Tensor` of shape :obj:`(batch_size,)`, `optional`, defaults to :obj:`None`): Labels for position (i
src/transformers/modeling_tf_xlm.py:1059
Methodcall
(self, x)
src/transformers/modeling_tf_t5.py:71
Methodcall
(self, hidden_states, training=False)
src/transformers/modeling_tf_t5.py:85
Methodcall
(self, hidden_states, training=False)
src/transformers/modeling_tf_t5.py:100
Methodcall
Self-attention (if kv is None) or attention over source sentence (provided by kv).
src/transformers/modeling_tf_t5.py:196
Methodcall
( self, hidden_states, attention_mask=None, position_bias=None, head_m
src/transformers/modeling_tf_t5.py:314
Methodcall
( self, hidden_states, kv, attention_mask=None, position_bias=None,
src/transformers/modeling_tf_t5.py:351
Methodcall
(self, inputs, mode="embedding")
src/transformers/modeling_tf_t5.py:492
Methodcall
( self, inputs, attention_mask=None, encoder_hidden_states=None, encod
src/transformers/modeling_tf_t5.py:553
Methodcall
r""" Returns: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.T5Config`) and inp
src/transformers/modeling_tf_t5.py:911
Methodcall
r""" Returns: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.T5Config`) and inp
src/transformers/modeling_tf_t5.py:1053
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_ctrl.py:106
Methodcall
(self, inputs, training=False)
src/transformers/modeling_tf_ctrl.py:163
Methodcall
( self, inputs, past=None, attention_mask=None, token_type_ids=None,
src/transformers/modeling_tf_ctrl.py:232
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.CTRLConfig`) and in
src/transformers/modeling_tf_ctrl.py:495
Methodcall
(self, hidden_states)
src/transformers/modeling_tf_ctrl.py:534
Methodcall
r""" Return: :obj:`tuple(tf.Tensor)` comprising various elements depending on the configuration (:class:`~transformers.CTRLConfig`) and in
src/transformers/modeling_tf_ctrl.py:564
Methodcheck_hidden_states_output
(inputs_dict, config, model_class)
tests/test_modeling_common.py:492
Methodcheck_hidden_states_output
(config, inputs_dict, model_class)
tests/test_modeling_tf_common.py:411
Methodcheck_loss_output
(self, result)
tests/test_modeling_gpt2.py:144
Methodcheck_loss_output
(self, result)
tests/test_modeling_openai.py:105
Methodcheck_loss_output
(self, result)
tests/test_modeling_ctrl.py:110
Methodcheck_same_values
(layer_1, layer_2)
tests/test_modeling_common.py:603
Methodcls_token
Classification token (string). E.g. to extract a summary of an input sequence leveraging self-attention along the full depth of the model. Log an err
src/transformers/tokenization_utils_base.py:758
Methodcls_token_id
Id of the classification token in the vocabulary. E.g. to extract a summary of an input sequence leveraging self-attention along the full depth of th
src/transformers/tokenization_utils_base.py:854
Functioncollate_fn
(batch)
examples/contrib/mm-imdb/utils_mmimdb.py:88
Functioncollate_fn
(data)
examples/text-generation/pplm/run_pplm_discrim_train.py:101
Functioncollate_fn
(data)
examples/seq2seq/bertabs/run_summarization.py:189
Methodcollate_fn
(self, batch)
examples/seq2seq/utils.py:127
Methodcompute_loss
(self, labels, logits)
src/transformers/modeling_tf_utils.py:121
Methodcompute_loss
(self, labels, logits)
src/transformers/modeling_tf_utils.py:133
Methodcompute_loss_and_backprob_encoder
()
src/transformers/benchmark/benchmark.py:175
Methodcompute_loss_and_backprob_encoder_decoder
()
src/transformers/benchmark/benchmark.py:180
Functioncompute_metrics
(p: EvalPrediction)
tests/test_trainer_distributed.py:79
Functioncompute_metrics
(p: EvalPrediction)
examples/multiple-choice/run_tf_multiple_choice.py:173
Functioncompute_metrics
(p: EvalPrediction)
examples/token-classification/run_tf_ner.py:193
Functioncompute_metrics_fn
(p: EvalPrediction)
examples/text-classification/run_glue.py:152
Functionconfig
r""" # Using torch.hub ! import torch config = torch.hub.load('huggingface/transformers', 'config', '
hubconf.py:23
Methodconfigure_optimizers
Prepare optimizer and schedule (linear warmup and decay)
examples/lightning_base.py:101
Methodconfigure_optimizers
Prepare optimizer and schedule (linear warmup and decay)
examples/seq2seq/distillation.py:159
Functionconvert_all_sentencepiece_models
Requires 300GB
src/transformers/convert_marian_to_pytorch.py:206
Functionconvert_checkpoint_from_disk
(checkpoint_path, **config_kwargs)
src/transformers/convert_bart_original_pytorch_checkpoint_to_pytorch.py:81
Functionconvert_command_factory
Factory function used to convert a model TF 1.0 checkpoint in a PyTorch checkpoint. :return: ServeCommand
src/transformers/commands/convert.py:7
Methodconvert_ids_to_tokens
Converts a single index or a sequence of indices (integers) in a token " (resp.) a sequence of tokens (str), using the vocabulary and add
src/transformers/tokenization_utils_fast.py:221
Methodconvert_tokens_to_ids
Converts a token string (or a sequence of tokens) in a single integer id (or a sequence of ids), using the vocabulary.
src/transformers/tokenization_utils_fast.py:188
Methodconvert_tokens_to_string
Converts a sequence of tokens (strings for sub-words) in a single string.
src/transformers/tokenization_xlm_roberta.py:287
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_openai.py:198
Methodconvert_tokens_to_string
(self, tokens)
src/transformers/tokenization_albert.py:231
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_reformer.py:163
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_gpt2.py:240
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_transfo_xl.py:324
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_ctrl.py:223
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_xlm.py:847
Methodconvert_tokens_to_string
Converts a sequence of tokens (strings for sub-words) in a single string.
src/transformers/tokenization_xlnet.py:234
Methodconvert_tokens_to_string
Converts a sequence of tokens (string) in a single string.
src/transformers/tokenization_bert.py:230
Methodconvert_tokens_to_string
Uses target language sentencepiece model
src/transformers/tokenization_marian.py:114
Methodconvert_tokens_to_string
Converts a sequence of tokens (strings for sub-words) in a single string.
src/transformers/tokenization_camembert.py:263
Functionconvert_whole_dir
(path=Path("marian_ckpt/"))
src/transformers/convert_marian_to_pytorch.py:239
Functioncopy_decoder_layers
(teacher, student, l2copy=[0, 2, 4, 7, 9, 11])
examples/seq2seq/initialization_utils.py:13
Methodcount_sents
sents : a list of sentences, each a list of tokenized symbols
src/transformers/tokenization_transfo_xl.py:163
← previousnext →2,401–2,500 of 4,119, ranked by callers