MCPcopy Create free account
hub / github.com/algorithmicsuperintelligence/optillm / __init__

Method __init__

optillm/inference.py:745–748  ·  view source on GitHub ↗
(self, max_size: int = 1000)

Source from the content-addressed store, hash-verified

743 """Advanced caching system for frequent prompts and responses"""
744
745 def __init__(self, max_size: int = 1000):
746 self.max_size = max_size
747 self.cache = OrderedDict()
748 self.prompt_stats = defaultdict(lambda: {"count": 0, "success_rate": 0.0})
749
750 @lru_cache(maxsize=128)
751 def _compute_prompt_signature(self, prompt: str) -> str:

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected