(self, cache_manager: CacheManager, device_manager: DeviceManager)
| 1001 | |
| 1002 | class ModelManager: |
| 1003 | def __init__(self, cache_manager: CacheManager, device_manager: DeviceManager): |
| 1004 | self.cache_manager = cache_manager |
| 1005 | self.device_manager = device_manager |
| 1006 | |
| 1007 | def quantize_model(self, model): |
| 1008 | """Quantize model to 4-bit precision using bitsandbytes""" |
nothing calls this directly
no outgoing calls
no test coverage detected