MCPcopy Create free account

hub / github.com/allenai/OLMo / functions

Functions3,821 in github.com/allenai/OLMo

Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:102
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:171
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:233
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:287
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:376
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:434
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/webqs.py:41
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_test.py:116
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/pile.py:33
Methodhas_validation_docs
Whether the task has a validation set
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:119
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/sat.py:45
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/storycloze.py:51
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/headqa.py:35
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:46
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/arithmetic.py:38
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:36
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/mutual.py:37
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/pubmedqa.py:41
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/lambada.py:86
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/openbookqa.py:37
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/asdiv.py:42
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/logiqa.py:38
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/coqa.py:39
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/swag.py:35
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/prost.py:45
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/wikitext.py:72
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/mc_taco.py:45
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/quac.py:36
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/mathqa.py:35
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/squad.py:59
Methodhas_validation_docs
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/race.py:48
Methodhf_device_map
(self)
inference/compression/dependencies/AutoGPTQ/auto_gptq/modeling/_base.py:157
Functionhfclassification_convert
( instance: Dict[str, Any], *, task_name: str, label_map: Dict[int, str], premise_field: s
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/huggingface.py:201
Functionhfclassification_convert
( instance: Dict[str, Any], *, task_name: str, label_map: Dict[int, str], premise_field: s
inference/efficiency/dependencies/previous_version/efficiency_benchmark/tasks/huggingface.py:201
Functionhfmc_convert
( instance: Dict[str, Any], *, context_field: Optional[str] = None, question_field: str, a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/huggingface.py:132
Functionhfmc_convert
( instance: Dict[str, Any], *, context_field: Optional[str] = None, question_field: str, a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/tasks/huggingface.py:132
Methodhidden_size
(self)
hf_olmo/configuration_olmo.py:37
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:502
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:599
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:640
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/drop.py:274
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/cbt.py:132
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/triviaqa.py:91
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/winogrande.py:125
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/wsc273.py:164
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:146
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:325
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/blimp.py:102
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/unscramble.py:73
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/gsm8k.py:121
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/naturalqs.py:119
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/qasper.py:225
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:97
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:145
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:205
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:268
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:319
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:370
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:425
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:477
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:554
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:87
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:142
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:214
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:272
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:355
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:417
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:482
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/webqs.py:96
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:191
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/storycloze.py:131
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:84
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:118
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:169
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:219
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:288
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:345
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:395
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/arithmetic.py:78
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:85
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/mutual.py:97
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/pubmedqa.py:85
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/lambada.py:73
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/asdiv.py:89
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/anli.py:118
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/coqa.py:164
Methodhigher_is_better
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/mc_taco.py:111
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/quac.py:116
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/squad.py:196
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/race.py:161
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:502
Methodhigher_is_better
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:599
Methodhigher_is_better
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:640
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/drop.py:274
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/cbt.py:132
Methodhigher_is_better
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/triviaqa.py:91
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/winogrande.py:125
Methodhigher_is_better
:returns: {str: bool} A dictionary where keys are the names of submetrics and values are whether a higher value of th
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/wsc273.py:164
Methodhigher_is_better
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:146
Methodhigher_is_better
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:325
← previousnext →2,801–2,900 of 3,821, ranked by callers