MCPcopy Create free account
hub / github.com/algorithmicsuperintelligence/optillm / __init__

Method __init__

optillm/inference.py:593–600  ·  view source on GitHub ↗
(self, cache_manager)

Source from the content-addressed store, hash-verified

591 """Manager for MLX models and operations"""
592
593 def __init__(self, cache_manager):
594 self.cache_manager = cache_manager
595 self.available = MLX_AVAILABLE and is_apple_silicon()
596
597 if self.available:
598 logger.info("MLX manager initialized - Apple Silicon detected")
599 else:
600 logger.debug("MLX manager not available - requires Apple Silicon and mlx-lm")
601
602 def create_pipeline(self, model_id: str, **kwargs) -> MLXInferencePipeline:
603 """Create an MLX inference pipeline"""

Callers 1

__init__Method · 0.45

Calls 1

is_apple_siliconFunction · 0.85

Tested by

no test coverage detected