MCPcopy Create free account
hub / github.com/ml-explore/mlx-examples / reset_cache

Method reset_cache

llms/speculative_decoding/model.py:304–305  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

302 self.reset_cache()
303
304 def reset_cache(self):
305 self.cache = [None] * len(self.decoder.layers)
306
307 def decode(
308 self,

Callers 4

__init__Method · 0.95
truncate_cacheMethod · 0.95
generateMethod · 0.80
speculative_decodeMethod · 0.80

Calls

no outgoing calls

Tested by

no test coverage detected