Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/allenai/OLMo
/ functions
Functions
3,821 in github.com/allenai/OLMo
⨍
Functions
3,821
◇
Types & classes
799
↳
Endpoints
9
Method
add_data
(self, data)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/decontamination/archiver.py:84
Function
add_paths
(token_sources, output_yaml_file, start_point="preanneal")
scripts/microanneal_config_maker.py:419
Function
add_paths
(token_sources, output_yaml_file)
scripts/peteish7_config_maker.py:421
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:605
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:671
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/drop.py:266
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/cbt.py:124
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/triviaqa.py:86
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/winogrande.py:117
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/wsc273.py:156
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:143
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:306
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/blimp.py:107
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/unscramble.py:70
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/gsm8k.py:113
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/naturalqs.py:110
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/qasper.py:198
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:100
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:148
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:208
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:271
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:322
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:373
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:428
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:480
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:545
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:90
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:156
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:217
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:275
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:361
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:420
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:485
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/webqs.py:91
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:179
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/storycloze.py:123
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:80
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:115
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:166
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:216
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:285
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:342
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:392
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/arithmetic.py:73
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:82
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/mutual.py:94
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/pubmedqa.py:82
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/lambada.py:70
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/asdiv.py:86
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/anli.py:110
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/coqa.py:170
Method
aggregation
(self)
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/mc_taco.py:105
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/quac.py:107
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/squad.py:171
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/race.py:153
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:605
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:671
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/drop.py:266
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/cbt.py:124
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/triviaqa.py:86
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/winogrande.py:117
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/wsc273.py:156
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:143
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/truthfulqa.py:306
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/blimp.py:107
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/unscramble.py:70
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/gsm8k.py:113
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/naturalqs.py:110
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/qasper.py:198
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:100
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:148
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:208
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:271
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:322
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:373
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:428
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:480
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/glue.py:545
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:90
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:156
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:217
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:275
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:361
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:420
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/superglue.py:485
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/webqs.py:91
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:179
Method
aggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/storycloze.py:123
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:80
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:115
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:166
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:216
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:285
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:342
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_ethics.py:392
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/arithmetic.py:73
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:82
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/mutual.py:94
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/pubmedqa.py:82
Method
aggregation
(self)
inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/lambada.py:70
← previous
next →
1,601–1,700 of 3,821, ranked by callers