Downstream tasks with custom word boundaries should override this!

Downstream tasks with custom word boundaries should override this!

Utility function

Return an object to use for deterministic hashing instead of ``self``.

Return an object to use for deterministic hashing instead of ``self``.

Match EAI eval harness returns a list of continuations

Provide string for domain conditional normalization by default its blank string, continuation normalized by prob conditioned on a blank

same number of domain conditionals as context

Match EAI eval harness returns continuation id which corresponds to true label

Match EAI eval harness returns a single context string

Downloads and returns the task dataset. Override this method to download the dataset from a custom API.

Downloads and returns the task dataset. Override this method to download the dataset from a custom API.

A simple version of `torch.repeat_interleave` for duplicating a matrix while interleaving the copy.

Instantiate and evaluate a model on a list of tasks. :param lm: obj Language Model :param task_dict: dict[str, Task] Dictiona

Instantiate and evaluate a model on a list of tasks. :param lm: obj Language Model :param task_dict: dict[str, Task] Dictiona

Construct Q4Matrix, return handle

Matrix multiplication, returns x @ q4

Get the size of a local or remote file in bytes.

Function to find periodic sequences in an array. This function sweeps through the array and checks for sequences of length [min_period, max_p

Function to find the start position of the last consecutive sequence of True in an array.

Search upward in the directory tree to a maximum of three layers to find and return the package root (containing the 'tests' folder)

Search upward in the directory tree to a maximum of three layers to find and return the package root (containing the 'tests' folder)

Make sure old optim state dicts are compatible with new versions.

Pip and setuptools disagree about how URL dependencies should be handled.