MCPcopy Create free account

hub / github.com/hankcs/HanLP / functions

Functions2,968 in github.com/hankcs/HanLP

Functiondfs_linearize_tokenize
(sample: dict, tokenizer: PENMANBartTokenizer, remove_space=False, text_key='snt')
hanlp/components/amr/seq2seq/dataset/dataset.py:69
Functiondfs_linearize_tokenize_with_linguistic_structures
(sample: dict, tokenizer: PENMANBartTokenizer, remove_sp
hanlp/components/amr/seq2seq/dataset/dataset.py:171
Methoddict_blacklist
(self)
hanlp/components/ner/transformer_ner.py:233
Methoddict_combine
The low priority dictionary which perform longest-prefix-matching on model predictions and combing them. Examples: >>> tok.dict_
hanlp/components/tokenizers/transformer.py:72
Methoddict_combine
(self)
hanlp/components/mtl/tasks/tok/tag_tok.py:178
Methoddict_force
r""" The high priority dictionary which perform longest-prefix-matching on inputs to split them into two subsets: 1. spans containing no keyw
hanlp/components/tokenizers/transformer.py:43
Methoddict_force
(self)
hanlp/components/mtl/tasks/tok/tag_tok.py:168
Methoddict_tags
r""" A custom dictionary to override predicted tags by performing longest-prefix-matching. Examples: >>> pos.dict_tags = {'HanLP'
hanlp/components/taggers/tagger.py:205
Methoddict_whitelist
(self)
hanlp/components/ner/transformer_ner.py:223
Methoddistill
(self, teacher: str, trn_data, dev_data, save_
hanlp/components/taggers/transformers/transformer_tagger.py:281
Methoddistill
(self, teacher: str, trn_data, dev_data, save_
hanlp/components/distillation/distillable_component.py:21
Methoddummy_inputs
(self)
hanlp/components/amr/amrbart/model_interface/modeling_bart.py:518
Methodedges
(self)
hanlp/components/parsers/parse_alg.py:78
Methodedges
(self)
hanlp/components/parsers/biaffine_tf/alg.py:158
Functioneisner
r""" First-order Eisner algorithm for projective decoding. References: - Ryan McDonald, Koby Crammer and Fernando Pereira. 2005.
hanlp/components/parsers/alg.py:102
Methodelapsed
(self)
hanlp/utils/time_util.py:99
Methodelapsed_average
(self)
hanlp/utils/time_util.py:111
Methodelapsed_average_human
(self)
hanlp/utils/time_util.py:115
Methodelapsed_human
(self)
hanlp/utils/time_util.py:107
Methodembed
(self, word)
hanlp/layers/embeddings/fast_text_tf.py:41
Methodembedding_dim
(self)
hanlp/layers/embeddings/contextual_string_embedding.py:94
Methodembedding_dim
(self)
hanlp/layers/embeddings/word2vec.py:76
Methodembedding_dim
(self)
hanlp/layers/embeddings/char_rnn.py:68
Methodembedding_dim
(self)
hanlp/layers/embeddings/embedding.py:19
Methodembedding_dim
(self)
hanlp/layers/embeddings/embedding.py:72
Functionembedding_uniform
(tensor:torch.Tensor, seed=233)
hanlp/utils/init_util.py:11
Methodembeddings
(self)
hanlp/layers/embeddings/embedding.py:86
Functionenable_debug
(debug=True)
hanlp/utils/log_util.py:64
Functionencode
(g, top=None, indent=-1, compact=False)
hanlp/components/amr/amrbart/preprocess/penman_interface.py:78
Methodequals
(Object o)
plugins/hanlp_restful_java/src/main/java/com/hankcs/hanlp/restful/Span.java:42
Methodestimate_num_batches
(self, seq_len=None)
hanlp/datasets/lm/loaders/lm_dataset.py:113
Methodet_eta
(self)
hanlp/utils/time_util.py:146
Methodet_eta_human
(self)
hanlp/utils/time_util.py:154
Methodeta
(self)
hanlp/utils/time_util.py:89
Methodeta_human
(self)
hanlp/utils/time_util.py:119
Functionevaluate
Evaluate using official CoNLL-X evaluation script (Yuval Krymolowski) Args: gold_file(str): The gold conllx file pred_file(str): The
hanlp/metrics/parsing/conllx_eval.py:12
Methodevaluate
(self, tst_data, save_dir=None, logger: logging.Logger = None, batch_size=None, output=True,
hanlp/components/amr/seq2seq/seq2seq_amr_parser.py:501
Methodevaluate
(self, tst_data, save_dir=None, logger: logging.Logger = None, batch_size=None, output=True, **kwargs)
hanlp/components/amr/amrbart/bart_amr_parser.py:207
Methodevaluate
(self, input_path: str, save_dir=None, output=False, batch_size=None, logger: logging.Logger = None,
hanlp/components/parsers/biaffine_parser_tf.py:149
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/components/amr/amrbart/bart_amr_generation.py:63
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, ratio_width=None,
hanlp/components/amr/amrbart/bart_amr_parser.py:170
Methodevaluate_dataloader
(self, data, criterion, logger=None, ratio_width=None, **kwargs)
hanlp/components/ner/rnn_ner.py:27
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/components/classifiers/transformer_regression_hf.py:54
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/components/classifiers/transformer_classifier_hf.py:54
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/components/lm/mlm.py:65
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, output=False, **kwargs)
hanlp/components/mtl/tasks/__init__.py:143
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable,
hanlp/components/mtl/tasks/amr.py:135
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/layers/embeddings/fast_text.py:147
Methodevaluate_dataloader
(self, data: DataLoader, criterion: Callable, metric=None, output=False, **kwargs)
hanlp/layers/embeddings/word2vec.py:207
Methodevaluate_dataset
(self, tst_data, callbacks, output, num_batches, ret_scores=None, **kwargs)
hanlp/components/parsers/biaffine_parser_tf.py:291
Methodevaluate_output
(self, tst_data, out, num_batches, metric)
hanlp/components/classifiers/transformer_classifier_tf.py:125
Methodevaluate_output_to_file
(self, batch, outputs, out)
hanlp/components/tokenizers/tok_tf.py:62
Functionevaluate_retrieval
Evaluation for unlabeled retrieval. Args: gold_spans: Set of tuples of (start, end). span_starts: span_ends: span_score
hanlp/components/srl/span_rank/srl_eval_utils.py:43
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/amr/seq2seq/seq2seq_amr_parser.py:138
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/amr/amrbart/bart_amr_generation.py:56
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/amr/amrbart/bart_amr_parser.py:60
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/taggers/tagger.py:67
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer,
hanlp/components/taggers/rnn_tagger.py:36
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader,
hanlp/components/ner/biaffine_ner/biaffine_ner.py:80
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/parsers/constituency/crf_constituency_parser.py:47
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/parsers/ud/ud_parser.py:214
Methodexecute_training_loop
(self, trn, dev, devices, epochs, logger, patience, save_dir, optimizer, gradien
hanlp/components/parsers/biaffine/biaffine_dep.py:194
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/classifiers/transformer_regression_hf.py:47
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/classifiers/transformer_classifier.py:147
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/classifiers/transformer_classifier_hf.py:47
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/lm/mlm.py:58
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/sts/transformer_sts.py:80
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader,
hanlp/components/srl/span_rank/span_rank.py:80
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader,
hanlp/components/srl/span_bio/span_bio.py:78
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader,
hanlp/components/eos/ngram.py:97
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/mtl/multi_task_learning.py:276
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/components/mtl/tasks/__init__.py:146
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/layers/embeddings/fast_text.py:140
Methodexecute_training_loop
(self, trn: DataLoader, dev: DataLoader, epochs, criterion, optimizer, metric, save_dir,
hanlp/layers/embeddings/word2vec.py:200
Methodextra_repr
(self)
hanlp/components/parsers/biaffine_tf/layers.py:26
Methodextra_repr
(self)
hanlp/components/parsers/biaffine_tf/layers.py:73
Methodextra_repr
(self)
hanlp/components/parsers/biaffine_tf/layers.py:105
Methodextra_repr
(self)
hanlp/layers/dropout.py:74
Methodextra_repr
(self)
hanlp/layers/dropout.py:127
MethodextractiveSummarization
()
plugins/hanlp_restful_java/src/test/java/com/hankcs/hanlp/restful/HanLPClientTest.java:127
MethodextractiveSummarization
Single document summarization is the task of selecting a subset of the sentences which best represents a summary of the document, with a balance of sa
plugins/hanlp_restful_java/src/main/java/com/hankcs/hanlp/restful/HanLPClient.java:437
Methodfeed_batch
(self, batch: dict)
hanlp/components/tokenizers/multi_criteria_cws_transformer.py:52
Methodfeed_batch
(self, batch: dict)
hanlp/components/tokenizers/transformer.py:297
Methodfeed_batch
(self, batch)
hanlp/components/parsers/biaffine/structual_attention.py:165
Methodfeed_batch
(self, batch)
hanlp/components/parsers/biaffine/biaffine_sdp.py:45
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor], mask: torch.BoolTensor, decode
hanlp/components/mtl/tasks/sdp.py:130
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor],
hanlp/components/mtl/tasks/constituency.py:101
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor],
hanlp/components/mtl/tasks/__init__.py:175
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor], mask: torch.BoolTensor, decode
hanlp/components/mtl/tasks/dep.py:133
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor],
hanlp/components/mtl/tasks/amr.py:150
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor], mask: torch.BoolTensor, decode
hanlp/components/mtl/tasks/ud.py:137
Methodfeed_batch
(self, h: torch.FloatTensor, batch: Dict[str, torch.Tensor], mask: torch.BoolTensor, decode
hanlp/components/mtl/tasks/srl/bio_srl.py:107
Methodfile_to_inputs
(self, filepath: str, gold=True)
hanlp/transform/conll_tf.py:348
Methodfile_to_inputs
(self, filepath: str, gold=True)
hanlp/transform/conll_tf.py:628
Methodfile_to_inputs
(self, filepath: str, gold=True)
hanlp/transform/txt_tf.py:164
Methodfile_to_inputs
(self, filepath: str, gold=True)
hanlp/transform/tacred_tf.py:52
Methodfile_to_inputs
(self, filepath: str, gold=True)
hanlp/transform/table_tf.py:26
Methodfilecache
(self)
hanlp/datasets/lm/loaders/lm_dataset.py:141
Functionfilter_v_args
(sample: dict)
hanlp/datasets/srl/loaders/conll2012.py:170
Methodfinalize_document
(self, doc: Document, task_name: str)
hanlp/components/lemmatizer.py:57
← previousnext →2,101–2,200 of 2,968, ranked by callers