o ‰dËi´ã@sRddlZddlmZmZddlmZddlmZmZe  e ¡Z Gdd„deƒZ dS)éN)ÚABCÚabstractmethod)ÚPath)ÚOptionalÚUnionc@sVeZdZe d deeefdeefdd„ƒZe d deeefdeefdd „ƒZ dS) ÚOptimumQuantizerNÚ model_or_pathÚ file_namecCstdƒ‚)zROverwrite this method in subclass to define how to load your model from pretrainedzcOverwrite this method in subclass to define how to load your model from pretrained for quantization©ÚNotImplementedError)Úclsrr ©r úg/lsinfo/ai/hellotax_ai/llm_service/venv_embed/lib/python3.10/site-packages/optimum/quantization_base.pyÚfrom_pretrained sÿz OptimumQuantizer.from_pretrainedÚsave_dirÚ file_prefixcKstdƒ‚)zWOverwrite this method in subclass to define how to quantize your model for quantizationr )ÚselfrrÚkwargsr r rÚquantizesÿzOptimumQuantizer.quantize)N) Ú__name__Ú __module__Ú __qualname__Ú classmethodrÚstrrrrrrr r r rr sý þ ý &r) ÚloggingÚabcrrÚpathlibrÚtypingrrÚ getLoggerrÚloggerrr r r rÚs