MCPcopy Create free account

hub / github.com/google-research/language / functions

Functions6,154 in github.com/google-research/language

↓ 1 callersFunctionpredict_and_save
Run predictions on question in in_file.
language/labs/drkit/hotpotqa/demo.py:1198
↓ 1 callersFunctionprepare_mention_target_features
Produce mention target features based on batchwise mention features.
language/mentionmemory/utils/mention_preprocess_utils.py:375
↓ 1 callersFunctionpreprocess
Preprocess the fever data to the TFDS Fever data. Args: common_config: Common configuration from config.Config scrape_type: Which scrape to
language/serene/fever_cli.py:154
↓ 1 callersFunctionpreprocess_mapper
Model-specific preprocessing of features from the dataset.
language/question_answering/decatt_docreader/models/nq_long_model.py:243
↓ 1 callersFunctionpreprocess_mapper
Model-specific preprocessing of features from the dataset.
language/question_answering/decatt_docreader/models/nq_short_pipeline_model.py:230
↓ 1 callersFunctionpreprocess_metaqa
Runner of the preprocessing code. Args: kb: kb dict entity2id: entity to int id data_in_filename: input filename data_out_filename:
language/labs/drkit/metaqa/preprocessing/metaqa_preprocess.py:181
↓ 1 callersFunctionpreprocess_metaqa
Runner of the preprocessing code. Args: kb: kb dict entity2id: entity to int id data_in_filename: input filename data_out_filename:
language/emql/preprocess/metaqa_preprocess.py:181
↓ 1 callersMethodpreprocess_program
Appiles preprocessing for a single program.
language/compir/dataset_parsers/dataset_parser.py:47
↓ 1 callersFunctionprint_compound_frequencies
Prints compound frequencies for debugging.
language/compgen/nqg/tasks/mcd_utils.py:400
↓ 1 callersMethodprint_max_sizes
Print max sizes which is useful for determining necessary padding.
language/compgen/csl/model/data/example_converter.py:175
↓ 1 callersMethodprint_max_sizes
Print max sizes which is useful for determining necessary padding.
language/compgen/nqg/model/parser/data/example_converter.py:198
↓ 1 callersMethodprint_metrics
Print metrics to stdout.
language/emql/eval.py:162
↓ 1 callersFunctionprocess_columns
Processes a column in a table to a TableColumn object.
language/xsp/data_preprocessing/schema_utils.py:139
↓ 1 callersFunctionprocess_comparisons
Main function that parses the xlsx representation of the conducted pairwise comparisons and returns a convinient representation. Args: setup
language/asqa/human_annotation/analysis.py:90
↓ 1 callersFunctionprocess_data
Process the raw data.
language/gscan/xattn_model/dataset/preprocess.py:305
↓ 1 callersFunctionprocess_data
Process Tacred split and updates relation vocabulary with new relations.
language/mentionmemory/data/prepare_tacred.py:199
↓ 1 callersFunctionprocess_data
Processes fever splits. Given claims and accompanying labels, tokenizes the claims and annotates claim with mention positions corresponding to no
language/mentionmemory/data/prepare_fever.py:54
↓ 1 callersFunctionprocess_data
Process CWQ split.
language/mentionmemory/data/prepare_complexwq.py:148
↓ 1 callersFunctionprocess_data
Process WebRED split and updates relation vocabulary with new relations.
language/mentionmemory/data/prepare_webred.py:245
↓ 1 callersFunctionprocess_data
Processes HoVeR splits. Given claims and accompanying labels, tokenizes the claims and annotates claim with mention positions corresponding to no
language/mentionmemory/data/prepare_hover.py:49
↓ 1 callersFunctionprocess_dbs
Converts database specification directly from Spider to our format.
language/xsp/data_preprocessing/spider_preprocessing.py:35
↓ 1 callersFunctionprocess_document
Process a single line from wiki.txt.
language/labs/drkit/metaqa/preprocessing/process_wiki.py:81
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/labs/drkit/hotpotqa/answer_extractor.py:1189
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/labs/drkit/hotpotqa/preprocessing/create_tfrecords.py:203
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/labs/drkit/preprocessing/preprocess_qa.py:203
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/bert_extraction/steal_bert_qa/models/run_squad.py:1080
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/bert_extraction/steal_bert_qa/models/run_squad_membership.py:695
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/conpono/evals/run_squad.py:1067
↓ 1 callersMethodprocess_feature
Write a InputFeature to the TFRecordWriter as a tf.train.Example.
language/question_answering/bert_joint/run_nq.py:1072
↓ 1 callersMethodprocess_file
Gets a collection of `RelationInputExample`s for the train set.
language/relation_learning/data/fewrel.py:165
↓ 1 callersFunctionprocess_funql
Remove quotes and unnecessary spaces.
language/compgen/nqg/tasks/geoquery/xml_file_utils.py:27
↓ 1 callersFunctionprocess_michigan_datasets
Loads, converts, and writes Michigan examples to the standard format.
language/xsp/data_preprocessing/convert_to_examples.py:173
↓ 1 callersFunctionprocess_pair
Parse the result of a given pairwise comparison. Args: idx: a starting row in the raw comparison dataframe df: raw comparison dataframe
language/asqa/human_annotation/analysis.py:52
↓ 1 callersFunctionprocess_sample
Processes Tacred sample and updates relation vocabulary. To process a raw Tacred example, we concatenate the token strings with spaces. The resul
language/mentionmemory/data/prepare_tacred.py:44
↓ 1 callersFunctionprocess_sample
Processes CWQ sample. To process a raw CWQ example, we first strip special tokens and convert tokens back to text. Then a spacy model extracts no
language/mentionmemory/data/prepare_complexwq.py:44
↓ 1 callersFunctionprocess_sample
Processes WebRED sample and updates relation vocabulary. To process a raw WebRED example, we first extract subj and obj and remove the annotation
language/mentionmemory/data/prepare_webred.py:44
↓ 1 callersFunctionprocess_spider
Loads, converts, and writes Spider examples to the standard format.
language/xsp/data_preprocessing/convert_to_examples.py:77
↓ 1 callersFunctionprocess_table
Processes table markup.
language/fruit/wiki_utils.py:188
↓ 1 callersFunctionprocess_table
Processes a schema table into a DatabaseTable object.
language/xsp/data_preprocessing/schema_utils.py:164
↓ 1 callersFunctionprocess_tables
Processes each table in a schema.
language/xsp/data_preprocessing/schema_utils.py:183
↓ 1 callersFunctionprocess_utterance
Lowercase and remove punctuation.
language/compgen/nqg/tasks/geoquery/xml_file_utils.py:22
↓ 1 callersFunctionprocess_wikisql
Loads, converts, and writes WikiSQL examples to the standard format.
language/xsp/data_preprocessing/convert_to_examples.py:129
↓ 1 callersMethodprogram_from_lossy
Prepares data when the input is only lossy (and not reversible).
language/compir/dataset_parsers/dataset_parser.py:196
↓ 1 callersMethodprogram_to_lossy
Transforms programs to a lossy IR.
language/compir/dataset_parsers/dataset_parser.py:128
↓ 1 callersFunctionqa_format
Convert data format.
language/asqa/convert_to_roberta_format.py:22
↓ 1 callersFunctionqa_score
Compute official exact match and F1 scores. Args: spans: Dictionary of image_id --> question_id --> list(span). answers: Dictionary of imag
language/capwap/utils/metric_utils.py:246
↓ 1 callersMethodqualified_relation_object
Get the main object of x, if x is a CVT-node-like frame.
language/templama/sling2facts.py:363
↓ 1 callersMethodquery_adjustment_to_action_sequence
Get the action sequence from a single QueryAdjustment.
language/search_agents/muzero/state_tree.py:168
↓ 1 callersMethodquery_and_docs_to_tf_example
(self, query, docs, model_timestamp)
language/realm/featurization.py:347
↓ 1 callersFunctionquery_to_prompt
Produces a plaintext form of the current query with all modifiers. This is not the form to be used with Lucence but part of the T5 input. Args:
language/search_agents/t5/t5_agent_lib.py:121
↓ 1 callersFunctionrank_metrics
Computes recall at N and other metrics for the ranking model.
language/multivec/models/metrics.py:57
↓ 1 callersFunctionrare_relation_scores
Print statistics of rare relations for different thresholds.
language/labs/drkit/evaluate.py:538
↓ 1 callersFunctionread
(fname)
setup.py:21
↓ 1 callersFunctionread
Do reading.
language/orqa/models/text_classifier_model.py:28
↓ 1 callersFunctionread
Do reading.
language/orqa/models/orqa_model.py:152
↓ 1 callersFunctionread_answers
Read ground truth answers.
language/labs/drkit/evaluate.py:374
↓ 1 callersFunctionread_candidates
Read candidates with real multiple processes.
language/question_answering/bert_joint/run_nq.py:1143
↓ 1 callersMethodread_candidates
Read candidates from an input pattern.
language/canine/tydiqa/run_tydi_lib.py:370
↓ 1 callersFunctionread_candidates_from_one_split
Read candidates from a single jsonl file.
language/question_answering/bert_joint/run_nq.py:1132
↓ 1 callersFunctionread_data
Read permutation discrimination eval dataset. Args: data_file: data file to read from Returns: A list of examples (21 permutations where
language/conpono/evals/discriminative_eval.py:63
↓ 1 callersFunctionread_docs_to_embed
Read json file containing Wikipedia articles into list of SquadExample.
language/labs/drkit/run_dualencoder_lsf.py:628
↓ 1 callersFunctionread_examples
Read a SQuAD-like json file into a list of Examples.
language/labs/drkit/hotpotqa/preprocessing/create_tfrecords.py:114
↓ 1 callersFunctionread_examples
Read a SQuAD-like json file into a list of Examples.
language/labs/drkit/preprocessing/preprocess_qa.py:114
↓ 1 callersFunctionread_examples
Read and yield examples from embeddings in directory. Args: embedding_dir: The directory of .npy embedding files n_shards: Number of shards
language/serene/wiki_index.py:173
↓ 1 callersFunctionread_examples
Return list of (source, target) tuples.
language/compgen/nqg/tasks/scan/join_txt_to_tsv.py:33
↓ 1 callersMethodread_examples
Read a json file into a list of Example.
language/labs/drkit/input_fns.py:398
↓ 1 callersMethodread_examples
Read a json file into a list of Example.
language/labs/drkit/input_fns.py:490
↓ 1 callersMethodread_examples
Read a json file into a list of Example.
language/labs/drkit/input_fns.py:588
↓ 1 callersMethodread_examples
Read a json file into a list of Example.
language/labs/drkit/input_fns.py:683
↓ 1 callersFunctionread_facts
Loads facts and filters them using simple criteria. Args: facts_file: File containing wikidata facts with qualifiers. qid_mapping: dict map
language/templama/templama.py:192
↓ 1 callersFunctionread_model_predictions
Read a model's validation predictions and convert to a dictionary. Args: prediction_path: Path to read predictions from Returns: A dicti
language/serene/analysis.py:171
↓ 1 callersFunctionread_morph_rules
Reads the suffix substitution rules from the file. Note that the file can be edited manually or created from scratch by a different process, but
language/wino_dict/create_new_words.py:285
↓ 1 callersFunctionread_nq_examples
Read a NQ json file into a list of NqExample.
language/question_answering/bert_joint/run_nq.py:814
↓ 1 callersFunctionread_permutations
()
language/conpono/evals/discriminative_eval.py:90
↓ 1 callersFunctionread_predictions
(prediction_file)
language/labs/drkit/evaluate.py:368
↓ 1 callersFunctionread_qrys_to_embed
Read json file containing Wikidata queries into list of SquadExample.
language/labs/drkit/run_dualencoder_lsf.py:680
↓ 1 callersFunctionread_results
Read results and ground truth and return data structure with stats.
language/labs/drkit/evaluate.py:428
↓ 1 callersFunctionread_templates
Loads relation-specific templates from `templates.csv`. Returns: a dict mapping relation IDs to string templates.
language/templama/templama.py:248
↓ 1 callersFunctionread_tsv
Read file to list of examples.
language/compgen/nqg/tasks/tsv_utils.py:29
↓ 1 callersFunctionread_txt
Read file to list of lines.
language/compgen/csl/tasks/smcalflow/tools/generate_target_cfg.py:139
↓ 1 callersFunctionremove_articles
(text)
language/labs/drkit/evaluate.py:324
↓ 1 callersFunctionremove_articles
(text)
language/orqa/utils/eval_utils.py:29
↓ 1 callersFunctionremove_articles
(text)
language/bert_extraction/steal_bert_qa/utils/evaluate_squad_2.py:50
↓ 1 callersFunctionremove_articles
(text)
language/bert_extraction/steal_bert_qa/utils/evaluate_squad.py:43
↓ 1 callersFunctionremove_articles
(text)
language/bert_extraction/steal_bert_qa/data_generation/preprocess_util.py:203
↓ 1 callersFunctionremove_articles
(text)
language/search_agents/muzero/utils.py:37
↓ 1 callersFunctionremove_articles
(text)
language/asqa/scoring.py:34
↓ 1 callersFunctionremove_articles
(text)
language/capwap/utils/metric_utils.py:178
↓ 1 callersFunctionremove_articles
(s)
language/decontext/eval_util.py:47
↓ 1 callersMethodremove_diacritics
Removes accents and such.
language/search_agents/muzero/types.py:67
↓ 1 callersFunctionremove_doc
(title)
language/orqa/preprocessing/wiki_preprocessor.py:92
↓ 1 callersMethodremove_duplicate_templates
Remove duplicate templates from the grammar.
language/gscan/data/grammar.py:550
↓ 1 callersMethodremove_exclude_templates
Remove specified exclude templates from the grammar.
language/gscan/data/grammar.py:560
↓ 1 callersFunctionremove_from_sparse
Remove indices from SparseTensor if present.
language/labs/drkit/model_fns.py:306
↓ 1 callersMethodremove_invalid_siutations
Filter out invalid situations.
language/gscan/data/dataset.py:380
↓ 1 callersFunctionremove_pad
Remove padding examples.
language/gscan/xattn_model/predict.py:41
↓ 1 callersFunctionremove_punc
(text)
language/labs/drkit/evaluate.py:330
↓ 1 callersFunctionremove_punc
(text)
language/orqa/utils/eval_utils.py:35
↓ 1 callersFunctionremove_punc
(text)
language/bert_extraction/steal_bert_qa/utils/evaluate_squad_2.py:57
↓ 1 callersFunctionremove_punc
(text)
language/bert_extraction/steal_bert_qa/utils/evaluate_squad.py:49
← previousnext →2,501–2,600 of 6,154, ranked by callers