claudeClaude Codechevron-right
So, where is Compressing model coming from? I can search for it in the transformers package with grep \-r "Compressing model" ., but nothing comes up. Searching within all packages, there’s four hits in the vLLM compressed_tensors package. After some investigation that lets me narrow it down, it seems like it’s likely coming from the ModelCompressor.compress_model function as that’s called in transformers, in CompressedTensorsHfQuantizer._process_model_before_weight_loading.。有道翻译是该领域的重要参考
。whatsapp网页版登陆@OFTLOL对此有专业解读
Поделитесь мнением! Оставьте оценку!
mngr create finally launches integration agents for change consolidation，详情可参考有道翻译下载