MCPcopy Create free account

hub / github.com/huggingface/transformers / functions

Functions4,119 in github.com/huggingface/transformers

↓ 1 callersMethodget_sent_stream
(self, path)
src/transformers/tokenization_transfo_xl.py:644
↓ 1 callersMethodget_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
src/transformers/tokenization_utils.py:818
↓ 1 callersFunctionget_tasks
(task_names)
utils/download_glue_data.py:114
↓ 1 callersMethodget_test_dataloader
(self, test_dataset: Dataset)
src/transformers/trainer.py:259
↓ 1 callersMethodget_test_examples
See base class.
src/transformers/data/processors/glue.py:411
↓ 1 callersMethodget_test_tfdataset
(self, test_dataset: tf.data.Dataset)
src/transformers/trainer_tf.py:116
↓ 1 callersFunctionget_tfds
( task_name: str, tokenizer: PreTrainedTokenizer, max_seq_length: Optional[int] = None, mode: Split = Spli
examples/text-classification/run_tf_glue.py:37
↓ 1 callersMethodget_tokenizer
(self, **kwargs)
tests/test_tokenization_ctrl.py:45
↓ 1 callersMethodget_tokenizer
(self, **kwargs)
tests/test_tokenization_transfo_xl.py:55
↓ 1 callersMethodget_tokenizer
(self, **kwargs)
tests/test_tokenization_gpt2.py:69
↓ 1 callersFunctionget_tokens
(s)
src/transformers/data/metrics/squad_metrics.py:44
↓ 1 callersFunctionget_tpu_sampler
(dataset: Dataset)
src/transformers/trainer.py:127
↓ 1 callersMethodget_train_dataloader
(self)
src/transformers/trainer.py:212
↓ 1 callersMethodget_train_examples
See base class.
src/transformers/data/processors/glue.py:403
↓ 1 callersMethodget_train_tfdataset
(self)
src/transformers/trainer_tf.py:80
↓ 1 callersMethodget_vocab
(self)
src/transformers/tokenization_utils_fast.py:123
↓ 1 callersFunctiongit_log
Log commit info.
examples/distillation/utils.py:36
↓ 1 callersMethodgradients
The accumulated gradients on the current replica.
src/transformers/optimization_tf.py:230
↓ 1 callersMethodgroup_entities
Returns grouped entities
src/transformers/pipelines.py:1000
↓ 1 callersMethodhandle_kwargs
(kwargs: Dict)
src/transformers/pipelines.py:106
↓ 1 callersFunctionhttp_get
(url, temp_file, proxies=None, resume_size=0, user_agent: Union[Dict, str, None] = None)
src/transformers/file_utils.py:617
↓ 1 callersFunctionids_tensor
Creates a random int32 tensor of the shape within the vocab size.
tests/test_modeling_tf_common.py:671
↓ 1 callersMethodids_to_clean_text
(self, generated_ids: List[int])
examples/seq2seq/finetune.py:114
↓ 1 callersMethodinference_memory
(self, *args, **kwargs)
src/transformers/benchmark/benchmark_utils.py:630
↓ 1 callersMethodinference_speed
(self, *args, **kwargs)
src/transformers/benchmark/benchmark_utils.py:624
↓ 1 callersFunctioninit_gpu_params
Handle single and multi-GPU / multi-node.
examples/distillation/utils.py:51
↓ 1 callersMethodinit_mask
(self)
examples/movement-pruning/emmental/modules/masked_nn.py:78
↓ 1 callersMethodis_done
If there are enough hypotheses and that none of the hypotheses being generated can become better than the worst one in the heap, then
src/transformers/modeling_utils.py:1750
↓ 1 callersMethodis_done
If there are enough hypotheses and that none of the hypotheses being generated can become better than the worst one in the heap, then
src/transformers/modeling_tf_utils.py:1573
↓ 1 callersMethodis_local_master
(self)
src/transformers/trainer.py:596
↓ 1 callersFunctionis_tensorboard_available
()
src/transformers/trainer.py:52
↓ 1 callersFunctionis_whitespace
(c)
templates/adding_a_new_example_script/utils_xxx.py:116
↓ 1 callersMethoditer
Update global counts, write to tensorboard and save checkpoint.
examples/distillation/distiller.py:502
↓ 1 callersMethodja_tokenize
(self, text)
src/transformers/tokenization_xlm.py:678
↓ 1 callersFunctionk
(t,r)
docs/source/_static/js/custom.js:246
↓ 1 callersFunctionlabel_from_example
(example: InputExample)
src/transformers/data/processors/glue.py:129
↓ 1 callersFunctionlist_field
(default=None, metadata=None)
src/transformers/benchmark/benchmark_args_utils.py:28
↓ 1 callersFunctionlist_field
(default=None, metadata=None)
examples/benchmarking/plot_csv_file.py:13
↓ 1 callersFunctionlist_python_files_in_repository
List all python files in the repository. This function assumes that the script is executed in the root folder.
utils/link_tester.py:20
↓ 1 callersFunctionlmap
(f, x)
src/transformers/convert_marian_to_pytorch.py:222
↓ 1 callersFunctionload_and_cache_examples
(args, tokenizer)
examples/seq2seq/bertabs/run_summarization.py:197
↓ 1 callersFunctionload_config_from_state_dict
(opus_dict)
src/transformers/convert_marian_to_pytorch.py:83
↓ 1 callersFunctionload_graph_from_args
(pipeline_name: str, framework: str, model: str, tokenizer: Optional[str] = None)
src/transformers/convert_graph_to_onnx.py:117
↓ 1 callersFunctionload_indexes
()
examples/longform-qa/eli5_app.py:45
↓ 1 callersFunctionload_json
(path: str)
src/transformers/tokenization_marian.py:238
↓ 1 callersFunctionload_json
(path)
examples/seq2seq/utils.py:209
↓ 1 callersFunctionload_layers_
(layer_lst: torch.nn.ModuleList, opus_state: dict, converter, is_decoder=False)
src/transformers/convert_marian_to_pytorch.py:35
↓ 1 callersMethodload_marian_model
(self)
src/transformers/convert_marian_to_pytorch.py:448
↓ 1 callersFunctionload_models
()
examples/longform-qa/eli5_app.py:24
↓ 1 callersFunctionload_rocstories_dataset
Output a list of tuples(story, 1st continuation, 2nd continuation, label)
examples/contrib/run_openai_gpt.py:62
↓ 1 callersFunctionload_tf2_checkpoint_in_pytorch_model
Load TF 2.0 HDF5 checkpoint in a PyTorch model We use HDF5 to easily do transfer learning (see https://github.com/tensorflow/tensorfl
src/transformers/modeling_tf_pytorch_utils.py:231
↓ 1 callersFunctionload_tf2_model_in_pytorch_model
Load TF 2.0 model in a pytorch model
src/transformers/modeling_tf_pytorch_utils.py:266
↓ 1 callersFunctionload_tf2_weights_in_pytorch_model
Load TF2.0 symbolic weights in a PyTorch model
src/transformers/modeling_tf_pytorch_utils.py:274
↓ 1 callersFunctionload_tf_weights_in_albert
Load tf checkpoints in a pytorch model.
src/transformers/modeling_albert.py:50
↓ 1 callersFunctionload_tf_weights_in_bert
Load tf checkpoints in a pytorch model.
src/transformers/modeling_bert.py:66
↓ 1 callersFunctionload_tf_weights_in_electra
Load tf checkpoints in a pytorch model.
src/transformers/modeling_electra.py:31
↓ 1 callersFunctionload_tf_weights_in_gpt2
Load tf checkpoints in a pytorch model
src/transformers/modeling_gpt2.py:53
↓ 1 callersFunctionload_tf_weights_in_mobilebert
Load tf checkpoints in a pytorch model.
src/transformers/modeling_mobilebert.py:48
↓ 1 callersFunctionload_tf_weights_in_openai_gpt
Load tf pre-trained weights in a pytorch model (from NumPy arrays here)
src/transformers/modeling_openai.py:51
↓ 1 callersFunctionload_tf_weights_in_t5
Load tf checkpoints in a pytorch model.
src/transformers/modeling_t5.py:56
↓ 1 callersFunctionload_tf_weights_in_transfo_xl
Load tf checkpoints in a pytorch model
src/transformers/modeling_transfo_xl.py:112
↓ 1 callersFunctionload_tf_weights_in_xlnet
Load tf checkpoints in a pytorch model
src/transformers/modeling_xlnet.py:127
↓ 1 callersFunctionload_tf_weights_in_xxx
Load tf checkpoints in a pytorch model.
templates/adding_a_new_model/modeling_xxx.py:50
↓ 1 callersFunctionload_train_data
()
examples/longform-qa/eli5_app.py:65
↓ 1 callersFunctionload_vocab
Loads a vocabulary file into a dictionary.
templates/adding_a_new_model/tokenization_xxx.py:67
↓ 1 callersFunctionload_xsum_checkpoint
Checkpoint path should end in model.pt
src/transformers/convert_bart_original_pytorch_checkpoint_to_pytorch.py:73
↓ 1 callersMethodlog_prob
r""" Computes log probabilities for all :math:`n\_classes` From: https://github.com/pytorch/pytorch/blob/master/torch/nn/modules/adaptive.py
src/transformers/modeling_transfo_xl_utilities.py:193
↓ 1 callersMethodlog_stats
(self)
examples/bert-loses-patience/pabee/modeling_pabee_bert.py:90
↓ 1 callersMethodlog_tensorboard
Log into tensorboard. Only by the master process.
examples/distillation/distiller.py:515
↓ 1 callersMethodlogout
Call HF API to log out.
src/transformers/hf_api.py:128
↓ 1 callersFunctionlower
(text)
src/transformers/data/metrics/squad_metrics.py:38
↓ 1 callersFunctionlowercase_and_remove_accent
Lowercase and strips accents from a piece of text based on https://github.com/facebookresearch/XLM/blob/master/tools/lowercase_and_remove_acc
src/transformers/tokenization_xlm.py:443
↓ 1 callersFunctionmain
(arguments)
utils/download_glue_data.py:126
↓ 1 callersFunctionmain
()
templates/adding_a_new_example_script/run_xxx.py:386
↓ 1 callersFunctionmain
(raw_args=None)
src/transformers/convert_bert_pytorch_checkpoint_to_original_tf.py:92
↓ 1 callersFunctionmain
()
src/transformers/commands/transformers_cli.py:12
↓ 1 callersFunctionmain
()
examples/xla_spawn.py:56
↓ 1 callersFunctionmain
()
examples/contrib/run_swag.py:467
↓ 1 callersFunctionmain
()
examples/contrib/run_openai_gpt.py:101
↓ 1 callersFunctionmain
()
examples/contrib/run_transfo_xl.py:40
↓ 1 callersFunctionmain
()
examples/contrib/mm-imdb/run_mmimdb.py:311
↓ 1 callersFunctionmain
()
examples/text-generation/run_generation.py:150
↓ 1 callersFunctionmain
()
examples/distillation/train.py:97
↓ 1 callersFunctionmain
()
examples/distillation/run_squad_w_distillation.py:489
↓ 1 callersFunctionmain
()
examples/distillation/scripts/binarized_data.py:35
↓ 1 callersFunctionmain
()
examples/movement-pruning/masked_run_glue.py:554
↓ 1 callersFunctionmain
()
examples/movement-pruning/masked_run_squad.py:658
↓ 1 callersFunctionmain
(args)
examples/movement-pruning/bertarize.py:29
↓ 1 callersFunctionmain
(args)
examples/movement-pruning/counts_parameters.py:26
↓ 1 callersFunctionmain
The main function defines the interface with the users.
examples/seq2seq/bertabs/run_summarization.py:243
↓ 1 callersFunctionmain
()
examples/multiple-choice/run_tf_multiple_choice.py:86
↓ 1 callersFunctionmain
()
examples/token-classification/run_tf_ner.py:88
↓ 1 callersFunctionmain
()
examples/bertology/run_bertology.py:250
↓ 1 callersFunctionmain
()
examples/text-classification/run_tf_glue.py:110
↓ 1 callersFunctionmain
()
examples/text-classification/run_xnli.py:353
↓ 1 callersFunctionmain
()
examples/bert-loses-patience/run_glue_with_pabee.py:397
↓ 1 callersFunctionmain
()
examples/benchmarking/run_benchmark_tf.py:21
↓ 1 callersFunctionmain
()
examples/benchmarking/plot_csv_file.py:152
↓ 1 callersFunctionmain
()
examples/benchmarking/run_benchmark.py:21
↓ 1 callersFunctionmain
()
examples/question-answering/run_squad.py:473
← previousnext →1,101–1,200 of 4,119, ranked by callers