uj",ddlZddlmZddlmZddlmZddlZddlZddl m Z m Z m Z m Z ddlmZmZddlmZmZddlmZmZmZmZmZmZdd lmZdd lmZeZGd d e Z!Gd de Z"Gdde Z#Gdde Z$Gdde Z%dZ&e Gdde Z'e Gdde Z(e GddeZ)e Gdde)Z*e Gdde)Z+e Gd d!e Z,Gd"d#eZ-e Gd$d%e-Z.e Gd&d'e-Z/e Gd(d)e-Z0Gd*d+e Z1dS),N)ABC) HTTPStatus)Optional)asdictdefinefield validators)HubApiModelScopeConfig)API_RESPONSE_FIELD_DATAAPI_RESPONSE_FIELD_MESSAGE)NotLoginExceptionNotSupportError RequestErrorhandle_http_responseis_okraise_for_http_status) get_endpoint) get_loggerceZdZdZdZdS) AcceleratorcpugpuN)__name__ __module__ __qualname__CPUGPUe/lsinfo/ai/hellotax_ai/data_center/backend/venv/lib/python3.11/site-packages/modelscope/hub/deploy.pyrrs C CCCr rceZdZdZdS)VendoreasN)rrrEASrr r!r#r#s CCCr r#ceZdZdZdZdS) EASRegionz cn-beijingz cn-hangzhouN)rrrbeijinghangzhourr r!r'r'!sGHHHr r'c"eZdZdZdZdZdZdZdS)EASCpuInstanceTypezTEAS Cpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.c6.2xlargezecs.c6.4xlargezecs.c6.6xlargezecs.c6.8xlargeNrrr__doc__tinysmallmediumlargerr r!r+r+&s, D E F EEEr r+c"eZdZdZdZdZdZdZdS)EASGpuInstanceTypezTEAS Gpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.gn5-c28g1.7xlargezecs.gn5-c8g1.4xlargezecs.gn6i-c24g1.12xlargezecs.gn6e-c12g1.3xlargeNr,rr r!r3r3/s, "D "E &F $EEEr r3cR||jkrtd|d|jddS)Nz'min_replica' value: z- has to be smaller than 'max_replica' value: !) max_replica ValueError)instance attributevalues r!min_smaller_than_maxr;8sC x###juuh*** ,-- -$#r ceZdZUdZedejdZee d<edejde gZ ee d<dS)ServiceScalingConfigzResource scaling config Currently we ignore max_replica Args: max_replica: maximum replica min_replica: minimum replica default validatorr6 min_replicaN) rrrr-rr ger6int__annotations__r;rBrr r!r=r=?s uQ-*-2B2BCCCKCCCumjmA..0DEGGGKGGGGGr r=ceZdZUdZeed<eed<eej e j ej ej gZ eed<dS)ServiceResourceConfigzEas Resource request. Args: accelerator: the accelerator(cpu|gpu) instance_type: the instance type. scaling: The instance scaling config. instance_typescalingr? acceleratorN)rrrr-strrEr=rrrr in_rrJrr r!rGrGLs !!!!u *.+/;?!CDDFFFKFFFFFr rGceZdZdS)ServiceProviderParametersN)rrrrr r!rNrN\sDr rNceZdZUdZeed<eed<eed<dZeeed<ee j e j e j gZ eed<dS) EASDeployParametersaAParameters for EAS Deployment. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' region access_key_idaccess_key_secretNresource_groupr?vendor)rrrr-rKrErTrrr#r%r rLrUrr r!rPrPas KKK$(NHSM(((% njnfj\&B&BDDDFCDDDDDr rPceZdZUdZeed<eed<dZeed<dZeed<ee j e j e j gZ eed<dS) EASListParametersa@EAS instance list parameters. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' rRrSNrQrTr?rU)rrrr-rKrErQrTrr#r%r rLrUrr r!rWrWtsFCNC% njnfj\&B&BDDDFCDDDDDr rWcFeZdZUdZeed<eed<eed<eed<eed<dS)DeployServiceParametersa Deploy service parameters Args: instance_name: the name of the service. model_id: the modelscope model_id revision: the modelscope model revision resource: the resource requirement. provider: the cloud service provider. instance_namemodel_idrevisionresourceproviderN)rrrr-rKrErGrNrr r!rYrYsTMMMMMM####''''''r rYceZdZdZdZdS)AttrsToQueryStringz7Convert the attrs class to json string. Args: ct|jd}tj|}t |t j|}t |d|z}|S)Nc |duS)Nr)attrr:s r!z1AttrsToQueryString.to_query_str..s e46Gr )filterz provider=%s)rr^jsondumpsprinturllibparse quote_plus)self self_dictjson_strsafe_str query_params r! to_query_strzAttrsToQueryString.to_query_strsn M"G"GIII :i(( h<**844 h#h. r N)rrrr-rqrr r!r`r`s- r r`c6eZdZUeed<dZeed<dZeed<dS)ListServiceParametersr^rskipdlimitN)rrrrNrErtrDrvrr r!rsrss;''''D#MMME3r rsceZdZUeed<dS)GetServiceParametersr^NrrrrNrErr r!rxrx''''''r rxceZdZUeed<dS)DeleteServiceParametersr^Nryrr r!r|r|rzr r|c eZdZdZddeefdZdedededed ef d Z ded efd Z ded efd Z dd edee dee fdZ dS)ServiceDeployerzEFacilitate model deployment on to supported service provider(s). Ntokenc||n t|_dtji|_t |d|_dS)Nz user-agentT) access_tokencookies_required)rendpointr get_user_agentheadersr get_cookiescookies)rlrrs r!__init__zServiceDeployer.__init__sU$,$8lnn $&6&E&G&GH xx++,77 r r[r\rZr]r^c|jtjkrtd|jzt |||||}|jd}t |}tj|||j |j } t| t|j d| j tjkr| j tjkrnt#| r!| t&} | St)| t*t-| dS)aDeploy model to cloud, current we only support PAI EAS, this is an async API , and the deployment could take a while to finish remotely. Please check deploy instance status separately via checking the status. Args: model_id (str): The deployed model id revision (str): The model revision instance_name (str): The deployed model instance name. resource (ServiceResourceConfig): The service resource information. provider (ServiceProviderParameters): The service provider parameter Raises: NotSupportError: Not supported platform. RequestError: The server return error. Returns: ServiceInstanceInfo: The information of the deployed service instance. z1Not support vendor: %s ,only support EAS current.)rZr[r\r]r^z/api/v1/deployer/endpoint)rfrrcreate_serviceN)rUr#r%rrYrrrequestspostrrrlogger status_coderOKMULTIPLE_CHOICESrrfr rr r) rlr[r\rZr]r^ create_paramspathbodyrdatas r!createzServiceDeployer.creates/* ?fj ( (!C"## #0'  -:::m$$ M tT\4< I I IQ 6FGGG =JM ) )amj>Y.Y.YQVVXX Ivvxx 78 "16688,F#GHHH !! $ $ $tr ct|}|jd|d|}tj||j|j}t|t|jd|j tj krnt| r!| t}|St| t t#|dS)aQuery the specified instance information. Args: instance_name (str): The deployed instance name. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed from server. Returns: Dict: The information of the requested service instance. r^/api/v1/deployer/endpoint/?rr get_serviceN)rxrrqrgetrrrrrrrrrfr rr rrlrZr^paramsrrrs r!rzServiceDeployer.gets&x888 MMM===&*=*=*?*?*?A Lt|T\ J J JQ mDDD =JM ) )QVVXX Ivvxx 78 "16688,F#GHHH !! $ $ $tr ct|}|jd|d|}tj||j|j}t|t|jd|j tj krnt| r!| t}|St| t t#|dS)a Delete deployed model, this api send delete command and return, it will take some to delete, please check through the cloud console. Args: instance_name (str): The instance name you want to delete. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed. Returns: Dict: The deleted instance information. rrrrdelete_serviceN)r|rrqrdeleterrrrrrrrrfr rr rrs r!rzServiceDeployer.deletes)(;;; MMM===&*=*=*?*?*?A OD$, M M MQ 6FGGG =JM ) )QVVXX Ivvxx 78 "16688,F#GHHH !! $ $ $tr rrurtrvct|||}|jd|}tj||j|j}t|t|jd|j tj krnt| r!| t}|St| t t#|dS)aList deployed model instances. Args: provider (ServiceProviderParameters): The cloud service provider parameter, for eas, need access_key_id and access_key_secret. skip (int, optional): start of the list, current not support. limit (int, optional): maximum number of instances return, current not support Raises: RequestError: The request is failed from server. Returns: List: List of instance information )r^rtrvz/api/v1/deployer/endpoint?rlist_service_instancesN)rsrrqrrrrrrrrrrrfr rr r)rlr^rtrvrrrrs r!listzServiceDeployer.list/s&'D77737===393F3F3H3H3HJ Lt|T\ J J JQ 6NOOO =JM ) )QVVXX Ivvxx 78 "16688,F#GHHH !! $ $ $tr )NN)rru)rrrr-rrKrrGrNrrrrDrrr r!r~r~s77Xc]7777,s,c,#,.,2,,,,\0I:C3L@$%$'!!0!C=!SM!!!!!!r r~)2riabcrhttprtypingrrfrattrsrrrr modelscope.hub.apir r modelscope.hub.constantsr r modelscope.hub.errorsrrrrrrmodelscope.hub.utils.utilsrmodelscope.utils.loggerrrobjectrr#r'r+r3r;r=rGrNrPrWrYr`rsrxr|r~rr r!rs  33333333333377777777BBBBBBBB::::::::::::::::433333...... & V %%%%%%%%--- G G G G G6 G G G F F F F FF F F F        DDDDD3DDD$DDDDD1DDD$(((((f((("". (((((-((((((((0(((UUUUUfUUUUUr