Find the most likely tag sequence using Viterbi algorithm. Args: emissions (`~torch.Tensor`): Emission score tensor of size

Unlock this vocab so that new tokens can be added in. Returns: Itself.

Abstract Meaning Representation (AMR) captures “who is doing what to whom” in a sentence. Each sentence is represented as a rooted, directed,

By default, call build_types_shapes_values, usually called in component's build method. You can perform other building task here. Rem

Execute the external command and get its exitcode, stdout and stderr. See https://stackoverflow.com/a/21000308/3730690 Args: cmd: Comma

r""" .. code-block:: >>> seq_len = torch.arange(2, 16) >>> mask = lengths_to_mask(seq_len) >>> print(mask.size())

Load from a local/remote component. Args: save_dir: An identifier which can be a local path or a remote URL or a pre-defined stri

Parse a raw document. @param text Document content which can have multiple sentences. @param tasks Tasks to perform. @param skipTasks Tasks

Map a URL to a local path. Args: url: Remote URL. save_dir: The root folder to save this file. prefix: The prefix of offi

Split a document into sentences and tokenize them. Note that it is always faster to tokenize a whole document than to tokenize each sentence

Uncompress a file and clean up uncompressed files once an error is triggered. Args: path: The path to a compressed file dest: The des

Copy properties from a dict so that it can json de-serialized. Args: item: A dict holding ``token_to_idx`` Returns:

Decide which GPUs to use Args: query: (Default value = None) Returns:

Filter OntoNotes5 data based on CoNLL2012 (coref) doc ids. https://github.com/bcmi220/unisrl/blob/master/scripts/filter_conll2012_data.py Arg

Get value by the prefix of a key. Args: prefix: The prefix of a key. If multiple keys are matched, only the first one wi

Home directory for HanLP resources. Returns: Data directory in the filesystem for storage, for example when downloading models. Thi

Generate a Doxygen-flavor Markdown table from records. See https://stackoverflow.com/questions/13394140/generate-markdown-tables file -- Any

Find the `topk` most similar words of a given word or phrase. Args: words: A word or phrase or multiple words/phrases.

Parse a piece of text. Args: text: A document (str), or a list of sentences (List[str]). tokens: A list of s

Replace the extension of filepath to ext. Args: filepath: Filepath to be replaced. ext: Extension to replace. Returns:

Returns a moderately tiny value for a given PyTorch data type that is used to avoid numerical issues such as division by zero. This is differe

A word2vec style embedding builder which maps a token to its embedding through looking up a pre-defined table. Args: fiel