Functions — github.com/allenai/OLMo

CodeHub MCPcopy Create free account

hub / github.com/allenai/OLMo / functions

Functions3,821 in github.com/allenai/OLMo

⨍ Functions 3,821◇ Types & classes 799↳ Endpoints 9

↓ 1 callersMethodtrainer_state_dict

olmo/train.py:321

↓ 1 callersMethodtraining_docs

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/naturalqs.py:46

↓ 1 callersMethodtraining_docs

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/naturalqs.py:46

↓ 1 callersFunctionunflatten_dict

(d: Dict[STKey, torch.Tensor])

olmo/safetensors_util.py:51

↓ 1 callersMethodunmerge

inference/compression/dependencies/AutoGPTQ/auto_gptq/utils/peft_utils.py:60

↓ 1 callersMethodunmerge

inference/compression/dependencies/AutoGPTQ/auto_gptq/utils/peft_utils.py:214

↓ 1 callersMethodunshard_checkpoint

( self, load_path: PathOrStr, *, local_cache: Optional[PathOrStr] = None,

olmo/checkpoint.py:1741

↓ 1 callersFunctionunshard_run_checkpoints

(run_path: str, checkpoints_dest_dir: str, config: UnshardCheckpointsConfig)

scripts/storage_cleaner.py:1001

↓ 1 callersFunctionupload_local_checkpoint

(local_checkpoint_dir: str, destination_dir: str)

hf_olmo/convert_olmo_to_hf.py:206

↓ 1 callersFunctionversion_of

(dataset, language_pair)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:44

↓ 1 callersFunctionversion_of

(dataset, language_pair)

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/translation.py:44

↓ 1 callersFunctionwhite_space_fix

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/qasper.py:52

↓ 1 callersFunctionwhite_space_fix

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/qasper.py:52

↓ 1 callersFunctionwikitext_detokenizer

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/wikitext.py:30

↓ 1 callersFunctionwikitext_detokenizer

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/wikitext.py:30

↓ 1 callersFunctionword_ngrams_indices

Splits a string into pairs of (ngram words, their start/end indices)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/decontamination/janitor.py:78

↓ 1 callersFunctionword_ngrams_indices

Splits a string into pairs of (ngram words, their start/end indices)

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/decontamination/janitor.py:78

↓ 1 callersFunctionwrite_accuracy_data

Data for accuracy evaluation.

inference/efficiency/dependencies/efficiency-pentathlon/scripts/process_data.py:15

↓ 1 callersFunctionwrite_json

scripts/convert_olmo_to_hf_new.py:54

↓ 1 callersFunctionwrite_json

scripts/convert_olmo2_to_hf.py:59

↓ 1 callersFunctionwrite_model

( model_path, input_base_path, include_tokenizer=True, tokenizer_path=None, safe_serializa

scripts/convert_olmo_to_hf_new.py:59

↓ 1 callersFunctionwrite_model

( model_path, input_base_path, include_tokenizer=True, tokenizer_path=None, safe_serializa

scripts/convert_olmo2_to_hf.py:64

↓ 1 callersFunctionwrite_offline_data

Data for offline scenario efficiency evaluation.

inference/efficiency/dependencies/efficiency-pentathlon/scripts/process_data.py:29

↓ 1 callersFunctionwrite_single_stream_data

Data for single stream scenario efficiency evaluation.

inference/efficiency/dependencies/efficiency-pentathlon/scripts/process_data.py:20

Concatenate one :class:`MemMapDataset` with another.

olmo/data/memmap_dataset.py:223

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/metrics.py:197

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/metrics.py:197

(self, input_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs)

inference/eval/utils.py:22

(self, input_ids: torch.LongTensor, scores: torch.FloatTensor)

inference/compression/dependencies/AutoGPTQ/examples/benchmark/generation_speed.py:31

(self, items: Union[List[Dict[str, Any]], List[torch.Tensor]])

olmo/data/collator.py:23

Method__contains__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/utils.py:43

Method__contains__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:70

Method__contains__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:170

Method__contains__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/utils.py:43

Method__contains__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:70

Method__contains__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:170

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:285

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:285

scripts/storage_cleaner.py:137

Method__delitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:318

Method__delitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:318

Method__enter__

Context manager entry point. Creates the memmap file and returns self.

scripts/prepare_memmap_dataset.py:167

Method__enter__

olmo/train.py:1379

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:795

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:215

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:795

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/tasks/hendrycks_math.py:215

Context manager exit point. Closes the memmap file.

scripts/prepare_memmap_dataset.py:186

(self, exc_type, exc_val, exc_tb)

olmo/train.py:1382

Method__getattr__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:726

Method__getattr__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:803

Method__getattr__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:726

Method__getattr__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:803

Method__getattr__

inference/compression/dependencies/AutoGPTQ/auto_gptq/modeling/_base.py:1017

Method__getitem__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/utils.py:22

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:64

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:158

Method__getitem__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:215

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:290

Method__getitem__

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/dependencies/lm_eval/base.py:790

Method__getitem__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/utils.py:22

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:64

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:158

Method__getitem__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:215

Method__getitem__

(self, i: Union[int, slice])

inference/efficiency/dependencies/previous_version/efficiency_benchmark/tango_utils/sequences.py:290

Method__getitem__

inference/efficiency/dependencies/previous_version/efficiency_benchmark/dependencies/lm_eval/base.py:790

Method__getitem__

(self, index: int)

olmo/data/memmap_dataset.py:179

Method__getitem__

olmo/eval/downstream.py:206

(self, pretrained_model_dir, quantized_model_dir)

inference/efficiency/run_efficiency_benchmark.py:17

(self, pretrained_model_dir: str)

inference/efficiency/run_efficiency_benchmark.py:46

(self, *, version_override: Optional[str] = None)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/task.py:96

(self, answer_options: Sequence[str])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/task.py:189

( self, *, cmd: List[str], task: str, scenario: str, max_batch

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/steps.py:25

(self, task: Union[str, Task])

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/steps.py:208

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/steps.py:275

(self, task: Union[str, Task], output_file: Optional[str] = None)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/steps.py:304

(self, fn: Callable, inner_sequence: Sequence)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/utils.py:18

binary_cmd: the command to start the inference binary

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/stdio_wrapper.py:17

( self, interval: float = 0.1, # gpu_ids: Optional[Iterable[int]] = None, **kw

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/efficiency/profiler.py:19

(self, stop_event, *args, **kwargs)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/efficiency/power_monitor.py:17

(self, inner_sequence: Sequence, indices: Optional[Sequence[int]] = None)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:52

(self, inner_sequence: Sequence, s: slice)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:110

(self, *sequences: Sequence)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:149

(self, fn: Callable, inner_sequence: Sequence)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:211

(self, filename: Union[str, PathLike], read_only: bool = False)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/sequences.py:280

(self, buffer: io.BytesIO)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tango_utils/det_hash.py:101

( self, nan_strategy: Union[str, float] = "warn", **kwargs: Dict[str, Any], )

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/metrics/perplexity.py:8

(self, num_classes: int)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/metrics/accuracy.py:31

( self, base: int = 2, # Does anyone ever use anything but 2 here? nan_strategy: Unio

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/metrics/bleu.py:9

( self, base: int = 2, # Does anyone ever use anything but 2 here? nan_strategy: Unio

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/metrics/entropy.py:9

(self, dataset_name: str, *, version_override: Optional[str] = None)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/metaicl.py:12

( self, dataset_name: str, *, version_override: Optional[str] = None, )

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/p3.py:8

( self, eleuther_task: Union[str, Callable[[], EAITask]], *, answer_options: S

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/eleuther.py:148

(self, *, version_override: Optional[str] = None)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/eleuther.py:195

( self, eleuther_task: Union[str, Callable[[], EAITask]], *, version_override:

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/eleuther.py:222

( self, eleuther_task: Union[str, Callable[[], EAITask]], *, answer_options: S

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/eleuther.py:257

( self, dataset_path: str, dataset_name: Optional[str] = None, )

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/efficiency_benchmark.py:148

(self, subset: str)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/efficiency_benchmark.py:170

(self, subset: str, number_of_classes: int = 2)

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/raft.py:40

( self, dataset_path: str, dataset_name: Optional[str] = None, *, version_override: Optional[str] = No

inference/efficiency/dependencies/efficiency-pentathlon/efficiency_benchmark/tasks/huggingface.py:56

← previous next →1,101–1,200 of 3,821, ranked by callers