o :/i;@s2dZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z m Z ddlmZmZmZmZddlmZddlmZmZmZmZmZddlZddlmZddlmZdd l m!Z"dd l m#Z#dd l$m%Z%m&Z&ddl'm(Z(dd l)m*Z*e*e+Z,erdd l-m.Z.neZ.e/e.Z0ede.dZ1e%e"fd dGddde/e1dBdedBdede/e1e e/e1ge/e1fBfddZ2de0de3defddZ4de0de3de5fddZ6de1de1fddZ7   dHd e8d!e e3d"edBd#e gefdBd$e5def d%d&Z9de/ede:e3e3ffd'd(Z;e&Gd)d*d*eZd0d1Z?de1d2e@e3de:e3e8ffd3d4ZAd5e:e3e8fde3fd6d7ZBeGd8d9d9ZCde1d:e3d;e3eDe3BdZE dGd?e3dtdd|dur|fdd}|dur|S||S)aDecorator to create a pydantic dataclass with default config. The default config for the dataclass forbids extra fields. All config classes in vLLM should use this decorator. Args: cls: The class to decorate config: The pydantic ConfigDict to use. If provided, it will be merged with the default config. **kwargs: Additional arguments to pass to pydantic.dataclass.forbid)extraNcst|fdiS)Nrrrr merged_config^/lsinfo/ai/hellotax_ai/llm_service/venv_vllm/lib/python3.10/site-packages/vllm/config/utils.py decorator=szconfig..decorator)rupdate)rrrr'r%r#r&r's  namec st|stdztfddt|D}Wnty0}z tdd|jd|d}~ww|j}|j}|j }t |t r\|j durG|j }|jdurYt t gtf|j}t}n|j}|turl|turltd|jt|||d S) zrGet the default factory field of a dataclass by name. Used for getting default factory fields in `EngineArgs`.z#The given class is not a dataclass.c3s|] }|jkr|VqdSNr).0fr+r%r& Mszget_field..zField 'z' not found in .Nz(%s.%s has no default or default factory.)defaultdefault_factoryinit)r TypeErrornextr StopIteration ValueError__name__r1r2r3 isinstancerrrr rlogger warning_oncer)rr) named_fielder1r2r3r%r+r& get_fieldGs.   r>cCs t||jSr*)r>r3)rr)r%r%r& is_init_fieldg r?dataclass_instancec s<t||j}fdd|D}||di|S)zLike [`dataclasses.replace`](https://docs.python.org/3/library/dataclasses.html#dataclasses.replace), but compatible with Pydantic dataclasses which use `pydantic.fields.Field` instead of `dataclasses.field`cs i|] \}}t|r||qSr%)r?r-kvr"r%r& qs zreplace..Nr%)type__dict__itemsr()rArdataclass_dictr%r"r&replaceks  rJFobjectnamesr1r2warncCsbt|D]#\}}t||r'|r |dkr tdt|j||dt||Sq|dur/|S|S)a A helper function that retrieves an attribute from an object which may have multiple possible names. This is useful when fetching attributes from arbitrary `transformers.PretrainedConfig` instances. In the case where the first name in `names` is the preferred name, and any other names are deprecated aliases, setting `warn=True` will log a warning when a deprecated name is used. rzc%s contains a deprecated attribute name '%s'. Please use the preferred attribute name '%s' instead.N) enumeratehasattrr:r;rFr8getattr)rKrLr1r2rMir)r%r%r& getattr_itervs   rRcCsttt|jd}t|tjst di}t |jD]G\}}t|tj tj fr@t|tj r@t|jtjr@t|jjtsAqt|jj}t|tj rQ|jn|jg}|D]}t|tjs`qW|||j<qWq|S)zw Get any docstrings placed after attribute assignments in a class body. https://davidism.com/mit-license/ rzGiven object was not a class.)astparsetextwrapdedentinspect getsourcebodyr9ClassDefr4r Assign AnnAssignExprvalueConstantstrcleandoctargetstargetNameid)rcls_nodeoutabdocrbrcr%r%r& get_attr_docss,      rkc@seZdZdefddZdS) SupportsHashrcCdSr*r%selfr%r%r& compute_hashzSupportsHash.compute_hashN)r8 __module__ __qualname__r`rpr%r%r%r&rlsrlc@s"eZdZdeeeffddZdS)SupportsMetricsInforcCrmr*r%rnr%r%r& metrics_inforqz SupportsMetricsInfo.metrics_infoN)r8rrrsdictr`rur%r%r%r&rtsrt overridesc Csi}|D]F\}}t||sJt|d|dt||}t|rHt|sHt|tsCJdt|d|dt|dt|t||}|||<qt|fi|S)Nz has no field ``z Overrides to r0z must be a dict or z , but got ) rHrOrFrPr r9rv update_configrJ)rrwprocessed_overrides field_namer^ current_valuer%r%r&rys(    rycs dus tttttfrSttjr'jjdjj }|t j fStt rLt dd}t dt dd}ddd||fDpKtStd r]tt d dr]Stretd ttjrotStttfrzSttjrz tWStytYSwtrjjdjj }tfd d t t!d ddD}||fStt"rtt dd #DStt$rtt dd DStt%rttttfstdd DStdrtj&r&Stdt j'd)zReturn a stable, JSON-serializable canonical form for hashing. Order: primitives, special types (Enum, callable, torch.dtype, Path), then generic containers (Mapping/Set/Sequence) with recursion. Nr0rrrsr8cSsg|]}|r|qSr%r%)r-pr%r%r& sz#normalize_value..uuidz:normalize_value: function or callable instance unsupportedc3s&|]}|jtt|jfVqdSr*)r)normalize_valuerPr,xr%r&r/s  z"normalize_value..cSs|jSr*r+)r.r%r%r&sz!normalize_value..)keycss$|] \}}t|t|fVqdSr*)r`rrBr%r%r&r/s"css|] }tt|VqdSr*)reprrr-rDr%r%r&r/scss|]}t|VqdSr*)rrr%r%r&r/sto_json_stringz#normalize_value: unsupported type 'zi'. Ensure config values use supported primitives/containers or add a stable representation for this type.)(r9boolintfloatr`enumEnum __class__rrrsrr^rFrPjoinrrOcallablerr4torchdtypebytes bytearrayhexpathlibPath expanduserresolve Exceptionr tuplesortedrrrHrrrr8)r enum_typemodulequaltype_fqnrHr%rr&rsP          rignored_factorsc Csxi}t|D]3}|j}||vrqt||d}zt|||<Wqty9}ztd|dt|jd|d}~ww|S)zGets the factors used for hashing a config class. - Includes all dataclass fields not in `ignored_factors`. - Errors on non-normalizable values. Nz,get_hash_factors: unsupported type for key 'z' ())rr)rPrr4rFr8)rrfactorsdc_fieldfactorr^r=r%r%r&get_hash_factors0s&  rrHcCsttj|ddS)z=Return a SHA-256 hex digest of the canonical items structure.T) sort_keys)hashlibsha256jsondumpsencode hexdigest)rHr%r%r& hash_factorsErc@s~eZdZUdZeed<eed<defddZdedefdd Zd e defd d Z defd dZ de fddZ de fddZdS)RangezG A range of numbers. Inclusive of start, inclusive of end. startendrcCs |j|jkSr*rrrnr%r%r&is_single_sizeTr@zRange.is_single_sizesizecCs|j|ko |jkSSr*r)rorr%r%r& __contains__WrzRange.__contains__othercCs&t|tsdS|j|jko|j|jkS)NF)r9rrr)rorr%r%r&__eq__[s z Range.__eq__cCst|j|jfSr*)hashrrrnr%r%r&__hash__`szRange.__hash__cCsd|jd|jdS)N(, rrrnr%r%r&__str__csz Range.__str__cCs|Sr*)rrnr%r%r&__repr__fszRange.__repr__N)r8rrrs__doc__r__annotations__rrrrKrrr`rrr%r%r%r&rJs rold_namenew_name_or_namesremoval_versioncCslt||}|dur dSt|tr|g}n|}|d|dd|d}t||D]}t|||q+dS)Nz& is deprecated and will be removed in z. Use r instead.)rPr9r`rr:warningsetattr)rrrrold_val new_namesmsgnew_namer%r%r&handle_deprecatedjs    renv_namer{cCsBt|rtj|}|rd|dnd}td||||SdS)aT Get value from deprecated environment variable with warning. Args: env_name: Name of the deprecated environment variable removal_version: Version when it will be removed field_name: Name of the field to suggest as alternative Returns: The environment variable value if set, None otherwise z Please use rr}zHUsing %s environment variable is deprecated and will be removed in %s.%sN)envsis_setosenvirongetr:r;)rrr{r^alt_msgr%r%r&get_from_deprecated_env_if_sets  rto_boolto_intcCsZ|r|rtdt|||}|dur+|}|r|dv}n|r#t|}t|||dSdS)a Set object field from deprecated environment variable with warning. Args: config: Config object to set the field on env_name: Name of the deprecated environment variable removal_version: Version when the env var will be removed field_name: Name of the field to set to_bool: Whether to convert the environment variable value to boolean to_int: Whether to convert the environment variable value to integer Returns: None z+Cannot convert to both boolean and integer.N)1true)r7rlowerrr)rrrr{rr env_value field_valuer%r%r&set_from_deprecated_env_if_sets rr*)NNF)FF)HrrSrrrWrrrrUcollections.abcrrrr dataclassesrrrr itertoolsr typingr r r rrrpydanticrpydantic.dataclassesrpydantic.fieldsr PydanticFieldrtyping_extensionsrr vllm.envsr vllm.loggerrr8r: _typeshedrrF ConfigTyperrr`r>rr?rJrKrRrvrkrlrtryrsetrrrlistrrrr%r%r%r&s             )"V   "