ujddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z e ej ZdZGd d eZdS) N)ArgumentParser)model_file_download) CLICommand)HubApi) get_logger) log_levelc t|S)z> Function which will be called for a specific sub parser. ) LlamafileCMD)argss h/lsinfo/ai/hellotax_ai/data_center/backend/venv/lib/python3.11/site-packages/modelscope/cli/llamafile.pysubparser_funcr s   cFeZdZdZdZedefdZdZdZ dZ dS) r llamafilec||_|jj|_|j|jddkrt d|jd|jjLd|j_|jjdst dt|_ dS)N/zInvalid model id []. .llamafilez*file argument must ends with ".llamafile".) r modelmodel_idcount ValueErrorfileaccuracylowerendswithrapi)selfr s r __init__zLlamafileCMD.__init__s   = DM$7$7$<$<$A$AC$-CCCDD D 9> %!%DI 9>''))22<@@ O !MNNN88rparsersc|tj}|dtdd|}|dtddd |d tdd |d td d|dtddd |td S)z. define args for clear-cache command. z--modelTzCThe id of the model, whose repo must contain at least one llamafile)typerequiredhelpz --accuracyFq4_k_mzRSelected accuracy of GGUF files in the repo. Ignored when "file" is also provided.)r#r$defaultr%z--filez[The name of a specified llamafile in the model repo. This takes precedence over "accuracy".z --local_dirNzCDirectory where the selected llamafile would will be downloaded to.)r#r'r%z--launchTruezGWhether to launch model with the downloaded llamafile, default to True.)func) add_parserr name add_argumentstradd_mutually_exclusive_group set_defaultsr )r!parsergroups r define_argszLlamafileCMD.define_args$s%##L$566  Q    3355   `       i       Q       U     00000rc|jjr d|j_|j|jd}g}|D]^}|d}|rR|dr+d|vr||_|std|jdt d|jd |d|d }d }|D]h}|jjr||jjkr|}d}nE|jjr8|jj|vr|}d}ni|rtd |d ntd|dtjt!|jj||jj}t&jdr||}|jjdkr*td|d||dStd|ddS)NT) recursivePathrz-of-z(Cannot locate a valid llamafile in repo .zlist of llamafiles in repo z: rFz$llamafile matching criteria found: [rzKNo matched llamafile found in repo, choosing the first llamafile in repo: []) local_dirwintruez Launching model with llamafile [z]:z-No Launching. Llamafile model downloaded to [z!], you may execute it separately.)r rrrget_model_filesrrrappendrloggerinfoprintospathabspathrrr8sysplatform startswith_rename_extensionlaunch_execute_llamafile) r all_files llamafilesr> file_path selected_filefoundfdownloaded_files r executezLlamafileCMD.executeUs 9> &!%DI H,,T]d,KK   - -DV I -Y__..77 "" -&,IOO4E4E&E&E!!),,, MK4=KKKMM M I$- I IJ I I I K K K#1   Ay~ !ty~"5"5 ! y! di&8&>&>&@&@AGGII&M&M !    JJJJ K K K K n^knnn   '//  $):M O O OPP < " "5 ) ) F"44_EEO 9  ! ! # #v - - H_HHH I I I  # #O 4 4 4 4 4 rrrr     rc&tj|j}|dz}tj|||}d} ddl}|j}n#t$rYnwxYw|rtd|d}tj |dS)NIFrz;GPU detected, launching model with llamafile GPU option >>>z -ngl 999) r@statst_modechmodtorchcuda is_availableModuleNotFoundErrorr?system)rrK current_modenew_mode execute_cmdhas_gpurVs r rHzLlamafileCMD._execute_llamafileswy))1 %' H%%%   LLLj--//GG"    D   4 M O O O(333K +sA A$#A$ctj|\}}tj|\}}tj||d}tj|||S)Nz.exe)r@rAsplitsplitextjoinrename)roriginal_file_name directoryfilename base_name_ new_filenames r rFzLlamafileCMD._rename_extensionsk gmm,>?? 8w''11 1w||I)/A/A/ABB  $l333rN) __name__ __module__ __qualname__r+r staticmethodrr2rPrHrFrr r r s~ D   .1^.1.1.1\.1`///b&rr )loggingr@rCargparser modelscopermodelscope.cli.basermodelscope.hub.apirmodelscope.utils.loggerrWARNINGr=r r rnrr rvs ######************%%%%%%...... go . . . IIIII:IIIIIr