Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/IDEA-CCNL/Fengshenbang-LM
/ functions
Functions
2,547 in github.com/IDEA-CCNL/Fengshenbang-LM
⨍
Functions
2,547
◇
Types & classes
564
↳
Endpoints
10
↓ 1 callers
Function
get_scheduler
Unified API to get any scheduler from its name. Args: name (`str` or `SchedulerType`): The name of the scheduler to use.
fengshen/models/model_utils.py:212
↓ 1 callers
Method
get_text_features
r""" Returns: text_features (`torch.FloatTensor` of shape `(batch_size, output_dim`): The text embeddings obtained by
fengshen/models/clip/modeling_taiyi_clip.py:64
↓ 1 callers
Method
get_token_type
(self, context, tokentypes=None)
fengshen/data/t5_dataloader/t5_gen_datasets.py:193
↓ 1 callers
Function
get_tokenizer
(tokenizer_type, pretrained_model_path)
fengshen/examples/finetune_bart_qg/finetune_bart.py:384
↓ 1 callers
Function
get_topology
()
fengshen/models/megatron/mpu/initialize.py:257
↓ 1 callers
Function
get_train_valid_test_split_
Get dataset splits from comma or '/' separated string list.
fengshen/data/megatron_dataloader/dataset_utils.py:703
↓ 1 callers
Method
get_watermark_score
(self, images)
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:174
↓ 1 callers
Function
getattribute_from_module
(module, attr)
fengshen/models/auto/auto_factory.py:540
↓ 1 callers
Function
if_final_dir
(path: str)
fengshen/data/taiyi_stable_diffusion_datasets/taiyi_datasets.py:97
↓ 1 callers
Function
infer_dataset_impl
(path)
fengshen/data/megatron_dataloader/indexed_dataset.py:35
↓ 1 callers
Method
init_aesthetics_model
(self, )
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:111
↓ 1 callers
Method
init_clip_model
(self, )
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:101
↓ 1 callers
Function
init_hf_modules
Creates the cache directory for modules with an init, and adds it to the Python path.
fengshen/models/auto/dynamic.py:38
↓ 1 callers
Function
init_method_normal
Init method based on N(0, sigma).
fengshen/models/megatron/layers/init_functions.py:20
↓ 1 callers
Method
init_model
(self)
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:195
↓ 1 callers
Method
init_watermark_model
(self, )
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:119
↓ 1 callers
Method
init_weight_map
(self, args)
fengshen/utils/llama_convert/convert_fs_llama_tp.py:73
↓ 1 callers
Method
initialize_embedding
(self)
fengshen/models/megatron/layers/word_embeddings.py:177
↓ 1 callers
Function
inverse_square_root_schedule
( optimizer: Optimizer, num_warmup_steps: int = 4000, lr_min=1e-9, lr_max=1e-4
fengshen/models/model_utils.py:101
↓ 1 callers
Function
is_chinese_char
(uchar)
fengshen/utils/utils.py:37
↓ 1 callers
Method
is_kernel_available
(self, mask, b, np, sq, sk)
fengshen/models/megatron/layers/fused_softmax.py:148
↓ 1 callers
Method
kl_loss
(self, mean, log_var)
fengshen/models/PPVAE/pluginVAE.py:21
↓ 1 callers
Function
latent_code_from_text
(text, tokenizer_encoder, model_vae, args, scale=1.0)
fengshen/models/DAVAE/run_latent_generation.py:115
↓ 1 callers
Function
load_audio
(manifest_path, max_keep, min_keep)
fengshen/data/hubert/hubert_dataset.py:39
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/predict2submit/csl_submit.py:13
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/predict2submit/chid_submit.py:12
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/iflytek_preprocessing.py:132
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/ocnli_preprocessing.py:9
↓ 1 callers
Function
load_data
(file_path,label2id)
fengshen/examples/clue1.1/data_preprocessing/chid_preprocessing.py:68
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/cmrc2018_preprocessing.py:45
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/c3_preprocessing.py:7
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/afqmc_preprocessing.py:8
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/csl_preprocessing.py:10
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/wsc_preprocessing.py:9
↓ 1 callers
Function
load_data
(file_path,is_training=False)
fengshen/examples/clue1.1/data_preprocessing/tnews_preprocessing.py:21
↓ 1 callers
Method
load_data
(self, data_path)
fengshen/data/task_dataloader/task_datasets.py:85
↓ 1 callers
Method
load_data
(self, data_path)
fengshen/data/task_dataloader/medicalQADataset.py:33
↓ 1 callers
Method
load_data
load data from raw data return untokoenized data
fengshen/data/t5_dataloader/t5_gen_datasets.py:97
↓ 1 callers
Method
load_data
(self, args)
fengshen/data/t5_dataloader/t5_gen_datasets.py:237
↓ 1 callers
Method
load_data
(self, data_path)
fengshen/data/t5_dataloader/t5_datasets.py:113
↓ 1 callers
Method
load_data
(self, data_path)
fengshen/data/t5_dataloader/t5_datasets.py:454
↓ 1 callers
Method
load_data
(self, processor, mode)
fengshen/data/sequence_tagging_dataloader/sequence_tagging_datasets.py:114
↓ 1 callers
Method
load_data
(self, data_path, processor, mode)
fengshen/examples/zen2_finetune/fengshen_token_level_ft_task.py:360
↓ 1 callers
Method
load_data
(self, data_path, processor, mode)
fengshen/examples/zen2_finetune/fengshen_sequence_level_ft_task.py:359
↓ 1 callers
Method
load_data
(self, data_path, args)
fengshen/examples/classification/finetune_classification.py:68
↓ 1 callers
Method
load_data
(self, data_path, processor, mode)
fengshen/examples/zen1_finetune/fengshen_token_level_ft_task.py:335
↓ 1 callers
Method
load_data
(self, data_path, processor, mode)
fengshen/examples/zen1_finetune/fengshen_sequence_level_ft_task.py:339
↓ 1 callers
Method
load_dictionaries
(self)
fengshen/examples/hubert/pretrain_hubert.py:38
↓ 1 callers
Function
load_fused_kernels
()
fengshen/models/megatron/fused_kernels/__init__.py:32
↓ 1 callers
Function
load_label
(label_path, inds, tot)
fengshen/data/hubert/hubert_dataset.py:67
↓ 1 callers
Function
load_label_offset
(label_path, inds, tot)
fengshen/data/hubert/hubert_dataset.py:77
↓ 1 callers
Method
load_model
(cls, args, labels_dict=None)
fengshen/examples/deepVAE/vae_pl_module.py:60
↓ 1 callers
Method
load_model
(cls, config)
fengshen/models/DAVAE/DAVAEModel.py:43
↓ 1 callers
Function
load_model_source
(model_path, load_in_8bit=True)
fengshen/examples/ziya_inference/hf_quantizatin_inference.py:20
↓ 1 callers
Method
load_packed_data
(self, data_path)
fengshen/data/t5_dataloader/t5_gen_datasets.py:85
↓ 1 callers
Function
load_schema
(train_answer,dev_answer)
fengshen/examples/clue1.1/data_preprocessing/chid_preprocessing.py:11
↓ 1 callers
Method
load_schema
(self, data_path, args)
fengshen/examples/zen2_finetune/fengshen_sequence_level_ft_task.py:498
↓ 1 callers
Method
load_schema
(self, data_path, args)
fengshen/examples/classification/finetune_classification.py:184
↓ 1 callers
Method
load_schema
(self, data_path, args)
fengshen/examples/zen1_finetune/fengshen_sequence_level_ft_task.py:459
↓ 1 callers
Function
load_stopwords
(stopwords_path)
fengshen/examples/pegasus/data_utils.py:115
↓ 1 callers
Function
load_tf_weights_in_bert
Load tf checkpoints in a pytorch model
fengshen/models/zen1/modeling.py:88
↓ 1 callers
Method
load_tokenized_data
(self, data_path)
fengshen/data/t5_dataloader/t5_datasets.py:146
↓ 1 callers
Method
load_tokenized_memory_data
(self, data)
fengshen/data/t5_dataloader/t5_datasets.py:151
↓ 1 callers
Function
load_vocab
Loads a vocabulary file into a dictionary.
fengshen/examples/pegasus/tokenizers_pegasus.py:28
↓ 1 callers
Function
load_vocab
Loads a vocabulary file into a dictionary.
fengshen/models/zen1/tokenization.py:68
↓ 1 callers
Function
load_vocab
Loads a vocabulary file into a dictionary.
fengshen/models/zen2/tokenization.py:90
↓ 1 callers
Function
logkv
Log a value of some diagnostic Call this once for each diagnostic quantity, each iteration If called many times, last value will be used.
fengshen/examples/disco_project/guided_diffusion/guided_diffusion/logger.py:211
↓ 1 callers
Method
logkv
(self, key, val)
fengshen/examples/disco_project/guided_diffusion/guided_diffusion/logger.py:346
↓ 1 callers
Function
main
()
fengshen/cli/fengshen_pipeline.py:7
↓ 1 callers
Function
main
()
fengshen/examples/tcbert/example.py:5
↓ 1 callers
Function
main
()
fengshen/examples/qa_t5/finetune_t5_cmrc.py:305
↓ 1 callers
Function
main
()
fengshen/examples/unimc/example.py:5
↓ 1 callers
Function
main
()
fengshen/examples/finetune_bart_qg/finetune_bart.py:395
↓ 1 callers
Function
main
()
fengshen/examples/clue1.1/solution/clue_unimc.py:23
↓ 1 callers
Function
main
()
fengshen/examples/clue1.1/solution/clue_ubert.py:14
↓ 1 callers
Function
main
()
fengshen/examples/uniex/example.py:17
↓ 1 callers
Function
main
()
fengshen/examples/sequence_tagging/finetune_sequence_tagging.py:277
↓ 1 callers
Function
main
()
fengshen/examples/pegasus/pretrain_pegasus.py:141
↓ 1 callers
Function
main
()
fengshen/examples/finetune_taiyi_stable_diffusion/evaluate_model.py:279
↓ 1 callers
Function
main
()
fengshen/examples/pretrain_t5/pretrain_t5.py:125
↓ 1 callers
Function
main
()
fengshen/examples/pretrain_t5/convert_ckpt_to_bin.py:13
↓ 1 callers
Function
main
()
fengshen/examples/pretrain_t5/finetune_t5.py:105
↓ 1 callers
Function
main
()
fengshen/examples/summary/seq2seq_summary.py:142
↓ 1 callers
Function
main
()
fengshen/examples/zen2_finetune/fengshen_token_level_ft_task.py:646
↓ 1 callers
Function
main
()
fengshen/examples/zen2_finetune/fengshen_sequence_level_ft_task.py:619
↓ 1 callers
Function
main
()
fengshen/examples/translate/finetune_deltalm.py:375
↓ 1 callers
Function
main
(file_path, src_lang, tgt_lang)
fengshen/examples/translate/prepare_dataset.py:9
↓ 1 callers
Function
main
()
fengshen/examples/ubert/example.py:7
↓ 1 callers
Function
main
()
fengshen/examples/classification/finetune_classification.py:344
↓ 1 callers
Function
main
()
fengshen/examples/wenzhong_qa/finetune_wenzhong.py:116
↓ 1 callers
Function
main
()
fengshen/examples/wenzhong_qa/finetune_medicalQA.py:121
↓ 1 callers
Function
main
()
fengshen/examples/zen1_finetune/fengshen_token_level_ft_task.py:615
↓ 1 callers
Function
main
()
fengshen/examples/zen1_finetune/fengshen_sequence_level_ft_task.py:580
↓ 1 callers
Function
main
()
fengshen/examples/mt5_summary/mt5_summary.py:189
↓ 1 callers
Function
main
()
fengshen/models/unimc/modeling_unimc.py:622
↓ 1 callers
Function
main
()
fengshen/models/uniex/modeling_uniex.py:1948
↓ 1 callers
Function
make_delta
(base_model_path, target_model_path, delta_path)
fengshen/utils/make_delta.py:16
↓ 1 callers
Function
make_log_bucket_position
(relative_pos, bucket_size, max_position)
fengshen/models/deberta_v2/modeling_deberta_v2.py:534
↓ 1 callers
Function
make_output_dir
root_dir |--- part_0 |___ part_1
fengshen/utils/llama_convert/convert_fs_llama_tp.py:15
↓ 1 callers
Function
make_output_format
(format, ev_dir, log_suffix="")
fengshen/examples/disco_project/guided_diffusion/guided_diffusion/logger.py:190
← previous
next →
701–800 of 2,547, ranked by callers