o :/i @sbddlmZddlmZmZddlmZmZddlm Z ddl m Z edZ e GdddZ d S) )Callable)AnyLiteral)Fieldfield_validator)config) safe_hash) autotriton deep_gemmcutlassflashinfer_trtllmflashinfer_cutlassflashinfer_cutedslmarlinaiterc@seZdZUdZeddZeed< dZe ed< e ddde d e d e fd d Z d efd dZe ddde d e ded e fddZdS) KernelConfigz7Configuration for kernel selection and warmup behavior.N)defaultenable_flashinfer_autotuner moe_backendbefore)modevaluereturncCst|tr |ddS|S)N-_) isinstancestrlowerreplace)clsrr!_/lsinfo/ai/hellotax_ai/llm_service/venv_vllm/lib/python3.10/site-packages/vllm/config/kernel.py_normalize_moe_backend-s z#KernelConfig._normalize_moe_backendcCs g}tt|dd}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)rrencode hexdigest)selffactorshash_strr!r!r" compute_hash4szKernelConfig.compute_hashwraphandlercCs|dur|S||S)zFSkip validation if the value is `None` when initialization is delayed.Nr!)r rr,r!r!r"_skip_none_validationFsz"KernelConfig._skip_none_validation)__name__ __module__ __qualname____doc__rrbool__annotations__r MoEBackendr classmethodrr#rr*rr-r!r!r!r"rs    rN)collections.abcrtypingrrpydanticrrvllm.config.utilsrvllm.utils.hashingrr4rr!r!r!r"s