~j{[ddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZddlmZddlmZmZdd lmZdd lmZmZmZmZmZmZmZdd lm Z m!Z!m"Z"dd l#m$Z$m%Z%dd l&m'Z'ddl(m)Z)dZ*dZ+dZ,dZ-dZ.dZ/dS)N)Path)create_pipeline)MODEL_FILE_PREFIX)get_model_paths)load_pipeline_config)get_all_supported_repo_namessetup)logging)get_dep_versionget_genai_dep_specsget_genai_fastdeploy_specget_paddle2onnx_dep_specsget_serving_dep_specsis_dep_availableis_paddle2onnx_plugin_available)get_gpu_compute_capabilityget_paddle_cuda_versionis_cuda_available)install_packagesuninstall_packages)interactive_get_pipeline)PIPELINE_ARGUMENTSc Dd}tjd}|d}|d}|d}|d}|ddd d |d d d|dtddgdd|dddd d|dd dd|dtdd d!"|d#td$%|d&td d'(|d)td d*(|d+td d,(|d-td d.(|d/d d0|d1t jd2%|d3td d4(|d5d d6|d7td8d9(|d:td;d<(|d=d d>|d?td@%|dAtdB%|dCtdDdE(|\}}|j }g} |j 5|j s-|j s%|"tj|rt!|dF} n|} | t"vrUdGt#j} t)jdH| dI| dJt-jdKt"| } | g} || dL} | D]O} | | dM| dNt2ur|n| dN| dOdP| dQ%P|| fS)Rzparse cli argumentsc*|dvrdS|dvrdS|dvrdS|S)zuconvert str type value to None type if it is "None", to bool type if it means True or False. )NonenoneNONEN)TRUETruetrueTtT)FALSEFalsefalseFfF)ss c/lsinfo/ai/hellotax_ai/data_center/backend/venv/lib/python3.11/site-packages/paddlex/paddlex_cli.py parse_strzargs_cfg..parse_str4s< ( ( (4 4 4 44 7 7 75zCommand-line interface for PaddleX. Use the options below to install plugins, run pipeline predictions, or start the serving application.zInstall PaddleX OptionszPipeline Predict OptionszServing OptionszPaddle2ONNX Optionsz --install*PLUGINz"Install specified PaddleX plugins.)nargsmetavarhelpz --no_deps store_truez>Install custom development plugins without their dependencies.)actionr2z --platformz github.comz gitee.comz7Platform to use for installation (default: github.com).)typechoicesdefaultr2z-yz--yes update_reposz6Automatically confirm prompts and update repositories.)destr4r2z--use_local_reposFz%Use local repositories if they exist.)r4r7r2z--deps_to_replace+Nz=Replace dependency version when installing from repositories.)r5r0r7r2z --pipelinez/Name of the pipeline to execute for prediction.)r5r2z--inputzJInput data or path for the pipeline, supports specific file and directory.)r5r7r2z --save_pathz$Path to save the prediction results.z--enginezInference engine.z--devicez5Device to run the pipeline on (e.g., 'cpu', 'gpu:0').z --use_hpipz&Use high-performance inference plugin.z --hpi_configz)High-performance inference configuration.z--get_pipeline_configz4Retrieve the configuration for a specified pipeline.z--servez1Start the serving application to handle requests.z--hostz0.0.0.0z,Host address to serve on (default: 0.0.0.0).z--portiz(Port number to serve on (default: 8080).z --paddle2onnxz*Convert PaddlePaddle model to ONNX format.z--paddle_model_dirz,Directory containing the PaddlePaddle model.z--onnx_model_dirz$Output directory for the ONNX model.--opset_versionz!Version of the ONNX opset to use. pipeline_namez, zUnsupported pipeline: z-, CLI predict only supports these pipelines:  rz Pipeline Optionsnamer5r2z Argument for z pipeline.)argparseArgumentParseradd_argument_group add_argumentstrast literal_evalintparse_known_argspipelineinstallserve paddle2onnxospathisfilerrjoinkeysr errorsysexit capitalizeboolget)r,parser install_grouppipeline_group serving_grouppaddle2onnx_groupargsremaining_argsrI pipeline_argsr=support_pipelinespipeline_specific_groupargs r+args_cfgrc1s    $ TF--.GHHM../IJJN--.?@@M112GHH 1   M  {+ F    E  4    L 3%V   Y     3         D    5     8    C   @   ;    7 "" 9# ""  ;# ""  3# ""Q5X# "2244D.}HM\ % %t7G %  7>>( # # %0::?KMM$M  2 2 2 $ *<*A*C*C D D  Mzzzevzzz    HQKKK*=9  M"(";";'')) < < <# # !  C # 0 0F "%f+"5"5YY3v;WWV%N]%N%N%NOO 1     =  r-cd}d}d}d}dtjd<dtjd<|jd d }d |vrK|d |r(t jd t jd |d Sd |vrK|d |r(t jdt jd |d Sttd|}|r|D]}|||r(t jdt jd t|dks,t|d dd kr(t jdt jd |d dd}||d Sttd|} | r]| D]}|||r(t jdt jd d| D} || d St} g} |D]}|| vr| || r)t jd| t jd |r|} nt|dkr| } t| |j|j|j|j|jd S)zinstall paddlexc ttn:#t$r-tjddt jdYnwxYwtjddS)NInstallation failedTexc_inforz)Successfully installed the serving plugin)rr Exceptionr rRrSrTinfor)r-r+_install_serving_depsz&install.._install_serving_depssz  244 5 5 5 5    M/$ ? ? ? ? HQKKKKK   @AAAAA4AAc ttn:#t$r-tjddt jdYnwxYwtjddS)NrfTrgrz-Successfully installed the Paddle2ONNX plugin)rrrir rRrSrTrjr)r-r+_install_paddle2onnx_depsz*install.._install_paddle2onnx_depssz  688 9 9 9 9    M/$ ? ? ? ? HQKKKKK   DEEEEErlc 6gd}||vr*tjd||tjdd}|dkrSt }|stjd|ddkrd }n |dd krtjd d d dd}||}t ||hz }|D]}t|}|mtjd|d|d|d|d  t|gF#t$r-tjddtjdY|wxYwtj d|5} t|} |"t|gdt| gnvt!dt#|d} | dvr2t|gt|gdt| gn ddddSn:#t$r-tjddtjdYnwxYwdddn #1swxYwYtjdt'stjd dSdS)!N)cpugpunpuzgFailed to install the high-performance plugin. Supported device types: %s. Your input device type: %s. zhpip_links.htmlrqzZNo CUDA version found. Please make sure you have installed PaddlePaddle with CUDA enabled.r zhpip_links_cu12.html zcCurrently, only CUDA versions 11.x and 12.x are supported by the high-performance inference plugin.zultra-infer-pythonzultra-infer-gpu-pythonzultra-infer-npu-pythonz'The high-performance inference plugin 'z' is mutually exclusive with 'z ' (version z installed). Uninstalling 'z'...zFailed to uninstall packagesTrgrpaddlexz --find-linkspip_install_optszDThe high-performance inference plugin is already installed (version z&). Do you want to reinstall it? (y/n):)yyesrfz._install_hpi_depss!6!6!6 4 4 4 ML&     HQKKK+ %  244L pA"$$"8aB&&y (++   "+._335566'B+ M%m44G" wgwwerww@Gwwdqwww & 7777    M"@4PPPPHQKKKKK # % %i A A Q%g..G ?$ ^SVV4L %U_cdk_l_lUUU  H ~~''<77*G9555($I . #A.+        ,    3dCCCC  -               4  STTT.00  LS       sI8D  4E?E$I5B HI4IIIIIIcg}g}|D]1}d|vr||||2|rtdstjdt }|dvrd}n.|dvrd}n'tjd|d d |d d  t t d gd|gn:#t$r-tj ddtjd YnwxYwg}|D]Q} t|}n9#t$r,tj d|tjdYnwxYw||z }R t |dn:#t$r-tj ddtjd YnwxYw|D]}d|vsd|vrt dgdtr t dgdt }|J|dkrt dgdnt dgdn:#t$r-tj ddtjd YnwxYwntj dt|d krdnd zdS)!N fastdeploy paddlepaddlez"Please install PaddlePaddle first.))r) rzEhttps://www.paddlepaddle.org.cn/packages/stable/fastdeploy-gpu-80_90/))r)rrzEhttps://www.paddlepaddle.org.cn/packages/stable/fastdeploy-gpu-86_89/z%The compute capability of the GPU is r.rzX, which is not supported. The supported compute capabilities are 8.0, 8.6, 8.9, and 9.0.rqz--extra-index-urlrwrfTrgz%Invalid generative AI plugin type: %srsrequired) constraintsvllmsglangxformerswheel)rtrzflash-attn == 2.8.3zflash-attn == 2.8.2z/Successfully installed the generative AI pluginr*)appendrrSrTrrrrir rRr ValueErrorrrjlen) plugin_typesfd_plugin_typesnot_fd_plugin_types plugin_typecap index_urlreqsrs r+_install_genai_depsz$install.._install_genai_depsLs ' 8 8K{**&&{3333#**;7777  #N33 ?=>>>,..C&&&c (((c fCFffSVfff  .u556&99%E    3dCCCC  .  K ' 44    E{SSS   AIDD  Tz : : : : :    M/$ ? ? ? ? HQKKKKK (  K$$K(?(? *:FFFF$&&$(' KKKK8::"'>>,!6 7Z-!6 7Z%$$$ &;dKKKK $E =,''!++ss 5     sI"!C4C;:C;D3E  E E''4FFAH4IIr PADDLE_PDX_DEBUGr%PADDLE_PDX_EAGER_INITNservingz5`serving` cannot be used together with other plugins.rsrLz9`paddle2onnx` cannot be used together with other plugins.c,|dS)Nzhpi- startswithr?s r+zinstall..s4??6+B+Br-z5`hpi-xxx` cannot be used together with other plugins.rr-zInvalid HPI plugin installation format detected. Correct format: paddlex --install hpi- Example: paddlex --install hpi-gpu)rc,|dS)Ngenai-rrs r+rzinstall..sT__X-F-Fr-z7`genai-xxx` cannot be used together with other plugins.c<g|]}|tddS)rN)r).0ps r+ zinstall..s'HHHQaH 0HHHr-zUnknown plugins: %s) repo_namesno_depsplatformr8use_local_reposdeps_to_replace)rMenvironrJremover rRrSrTlistfilterrsplitr rr rrr8rr)r]rkrnrrplugins hpi_pluginsrr genai_pluginsgenai_plugin_typesall_repo_namesunknown_pluginsrs r+rJrJsBBBFFFKKKZD D D N&,BJ!"*1BJ&'l111oGGy!!!   MQ R R R HQKKK}%%%   MU V V V HQKKK!!###vBBGLLMMK  A NN1       MQ R R R HQKKK {  a  3{1~';';C'@'@#A#AQ#F#F M5    HQKKK!!n**3//2 k2222 F FPPQQM  A NN1       MS T T T HQKKKHH-HHH.///133NO && N " "  " "1 % % % +_===  $ W  #   &,,  Fr-c t|||||}|j|fi|}|D].} | |r| |/dS)zpipeline predict)rIenginedeviceuse_hpip hpi_config) save_pathN)rpredictprintsave_all) rIrrrrrrr_resultress r+pipeline_predictrs HX e 5 5} 5 5F..  . LL9L - - -..r-c ddlm}m}n:#t$r-t jddt jdYnwxYwt|} t| ||||}n:#t$r-t jddt jdYnwxYw||| } || ||dS) Nr)create_pipeline_app run_serverz!Failed to load the serving moduleTrg)configrrrrzFailed to create the pipeline)hostport) inference.serving.basic_servingrr RuntimeErrorr rRrSrTrrri) rIrrrrrrrrpipeline_configapps r+rKrKsTTTTTTTTT  9DIIII  +844O ""!      5EEEE    h 8 8CJsD))))))s! 4AAA**4B! B!cf tstjdtd td dg fd}d} fd} fd}fd }|stjd t |}|s|}t |}t jd |t jd |||||||||r||s||||||t jd dS)Nz,Please install the Paddle2ONNX plugin first.z.onnxz.ymlz scaler.pklc|tjd|stj|d|stj|dt |}d|vrtjd|z }|stj|ddSdS)Nz!Input directory must be specifiedz does not existz is not a directorypaddlez!PaddlePaddle model does not exist)rSrTexistsis_dirr) input_dir model_paths config_pathCONFIG_FILENAMEs r+_check_input_dirz(paddle_to_onnx.._check_input_dirs   H8 9 9 9!! 4 H 222 3 3 3!! 8 H 666 7 7 7%i00 ; & & H8 9 9 9/1 !!## 6 H 444 5 5 5 5 5 6 6r-cZtjdtjddSdS)NrLz>Paddle2ONNX is not available. Please install the plugin first.)shutilwhichrSrTr)r-r+_check_paddle2onnxz*paddle_to_onnx.._check_paddle2onnx$s1 < & & . HU V V V V V / .r-c t|}tjdddt|ddjdt|ddjdt|ddjd t|z d t|g } t j|n8#t j$r&}tj d |j Yd}~nd}~wwxYwtjd dS) Nz"Paddle2ONNX conversion starting...rLz --model_dirrrz--model_filenamez--params_filenamerz --save_filer;z-Paddle2ONNX conversion failed with exit code z Paddle2ONNX conversion succeeded) rr rjrDparentr? subprocess check_callCalledProcessErrorrSrT returncode)r output_dir opset_versionrcmdeONNX_MODEL_FILENAMEs r+_run_paddle2onnxz(paddle_to_onnx.._run_paddle2onnx(s!%i00  9:::    H%a(/ 0 0   H%a(- . .   H%a(- . .   00 1 1       U  !# & & & &, U U U HSQ\SS T T T T T T T T U 788888s*B??C4C//C4cz|z }|z }tj||tjd|d|dSNzCopied z to )rcopyr rj)rrsrc_pathdst_pathrs r+_copy_config_filez)paddle_to_onnx.._copy_config_file?sP./ Hh''' 7x77X7788888r-cD]P}||z }|s||z }tj||tjd|d|QdSr)rrrr rj)rrfilenamerrADDITIONAL_FILENAMESs r+_copy_additional_filesz.paddle_to_onnx.._copy_additional_filesEs{, = =H 8+H??$$ !H,H K( + + + L;8;;;; < < < <  = =r-z.PaddlePaddle model directory must be specifiedz Input dir: z Output dir: Done) rrSrTrrr rjrsamefile) paddle_model_dironnx_model_dirrrrrrrrrrs @@@r+paddle_to_onnxrs * , ,A ?@@@.555*000O(> 6 6 6 6 6WWW99999.99999 ===== C ABBB,-- *).))N L1/11222 L000111%&&&%~}EEE  ! ! # #A(?(?@P(Q(QA*N;;;/@@@ Lr-c t\}}|}ttjdkr$r.t j d d tjdYdSwxYw)zAPI for command linerz3No arguments provided. Displaying help information:rsN)rrrrrr)rr?rz Argument z is missing in args)rrzPipeline prediction failedTrg)!rc parse_argsrrSargvr warning print_helprTrJrKrIrrrrrrrLrrrrget_pipeline_configrrlstriphasattrgetattrrrrirR)rXr_r]pipeline_args_dictrbarg_names r+mainrasQ$JJFM     D 38}}MNNN   | ) M;;]*d          !  ,       # / $T%=t~ N N N N N!# $ O Ov;--c224**O3:43J3J&x00O$M$M$M$MNNNN  MJKKN  "]2d#  )         :TJJJJ  s9G4G:9G:)0r@rEimportlib.resourcesr}rMrrrSpathlibrrr constantsr"inference.models.utils.model_pathsrinference.pipelinesr repo_managerr r utilsr utils.depsr r rrrrr utils.envrrr utils.installrrutils.interactive_get_pipelinerutils.pipeline_argumentsrrcrJrrKrrr)r-r+rs    ((((((??????555555======== @???????DDDDDD888888x!x!x!vn n n b...2***0OOOf55555r-