vj%ddlZddlZddlmZmZddlmZmZmZddl m Z ddl m Z ddl mZddlmZddlmZmZd d lmZGd d eZejd GddeZdS)N)ABCabstractmethod)CallableDictOptional)check_local_model_is_latest)snapshot_download)TRAINERS)Config)Invoke ThirdParty) LogBufferceZdZdZd dedeefdZ d dZe dZ e ded e ee ffd Z dS) BaseTrainerz Base class for trainer which can not be instantiated. BaseTrainer defines necessary interface and provide default implementation for basic initialization such as parsing config file and parsing commandline args. Ncfg_file arg_parse_fnc,tj||_|r |j||_nd|_t |_t |_tj dtj |_ dS)z Trainer basic init, should be called in derived class Args: cfg_file: Path to configuration file. arg_parse_fn: Same as ``parse_fn`` in :obj:`Config.to_args`. Nz %Y%m%d_%H%M%S) r from_filecfgto_argsargsr log_buffervisualization_buffertimestrftime localtime timestamp)selfrrs h/lsinfo/ai/hellotax_ai/data_center/backend/venv/lib/python3.11/site-packages/modelscope/trainers/base.py__init__zBaseTrainer.__init__st#H--  ((66DIIDI#++$-KK!8H8HIIctj|rttj|r|ntj|}t |t jt jtj|in4t||t jt j tj|i}|S)aH Get local model directory or download model if necessary. Args: model (str): model id or path to local model directory. model_revision (str, optional): model version number. third_party (str, optional): in which third party library this function is called. ) user_agent)revisionr$) ospathexistsisdirdirnamerr KEY LOCAL_TRAINERr r TRAINER)rmodelmodel_revision third_partymodel_cache_dirs r get_or_download_model_dirz%BaseTrainer.get_or_download_model_dir(s 7>>%  ')w}}((3eeGOOE22  'J 4NK     0'JNKOr"cdS) Train (and evaluate) process Train process should be implemented for specific task or model, related parameters have been initialized in ``BaseTrainer.__init__`` and should be used in this function N)rrkwargss r trainzBaseTrainer.trainGs  r"checkpoint_pathreturncdS) Evaluation process Evaluation process should be implemented for specific task or model, related parameters have been initialized in ``BaseTrainer.__init__`` and should be used in this function Nr5)rr8rr6s r evaluatezBaseTrainer.evaluateQs  r"N)NN)__name__ __module__ __qualname____doc__strrrr!r2rr7rfloatr<r5r"r rrsJJJHX4FJJJJ$26.2>  ^   "3:.   ^   r"rdummy) module_namecNeZdZdeffd ZdZ ddedeeeffdZxZ S) DummyTrainerrcJt|dS)zY Dummy Trainer. Args: cfg_file: Path to configuration file. N)superr!)rrrr6 __class__s r r!zDummyTrainer.__init__`s# """""r"cB|jj}td|dS)r4z train cfg N)rr7print)rrr6rs r r7zDummyTrainer.trainhs*hn  3  !!!!!r"Nr8r9cf|jj}td|td|dS)r;z eval cfg zcheckpoint_path N)r evaluationrL)rr8rr6rs r r<zDummyTrainer.evaluatersBh! #    22233333r"r=) r>r?r@rBr!r7rrCr< __classcell__)rJs@r rGrG]s#######""")- 4 4"% 4#3:. 4 4 4 4 4 4 4 4r"rG)r&rabcrrtypingrrrmodelscope.hub.check_modelr modelscope.hub.snapshot_downloadr modelscope.trainers.builderr modelscope.utils.configr modelscope.utils.constantr r utils.log_bufferrrregister_modulerGr5r"r rYsE ########++++++++++BBBBBB>>>>>>000000******88888888''''''J J J J J #J J J Zg... 4 4 4 4 4; 4 4/. 4 4 4r"