o :/i}+ @sUdZddlZddlZddlZddlZddlZddlmZmZddl m Z ddl m Z m Z ddlmZddlmZddlmZdd lmZdd lmZmZmZddlmZdd lmZmZejd Zd Zde fddZ!deeddeedddde!rdndej"ej#diddgej"ddidddZ$e%e&e%e&efeBfe'd<e dede&d eddfd!d"Z(e dede&d eddfd#d$Z)e dede&d eddfd%d&Z*ed'Z+d(e+de fd)d*Z,Gd+d,d,eZ-e-j.e-j/e-j0d-Z1dAd.d/Z2d0e&de-fd1d2Z3e ej4fd3e5dededffd4d5Z6deded6fd7d8Z7e2ej"d9kr,e8d:9ej:e3e;Ze&dBfd?d@Z>dS)CzLogging configuration for vLLM.N) GeneratorHashable)contextmanager) lru_cachepartial)Logger) dictConfig)path) MethodType)AnyLiteralcast)ColoredFormatterNewLineFormatterz?%(levelname)s %(asctime)s [%(fileinfo)s:%(lineno)d] %(message)sz%m-%d %H:%M:%SreturncCsftjstjdkr dStjdkrdStjdkr!ttjdo tjStjdkr1ttjdo0tjSdS)N0F1Tzext://sys.stdoutisattyzext://sys.stderr) envsNO_COLORVLLM_LOGGING_COLORVLLM_LOGGING_STREAMhasattrsysstdoutrstderrrrX/lsinfo/ai/hellotax_ai/llm_service/venv_vllm/lib/python3.10/site-packages/vllm/logger.py _use_colors   r#vllm.logging_utils.NewLineFormatter)classdatefmtformatz#vllm.logging_utils.ColoredFormatter)vllm vllm_colorr#zlogging.StreamHandlerr$)r formatterlevelstreamF)handlersr& propagate) formattersr(loggersversiondisable_existing_loggersDEFAULT_LOGGING_CONFIGloggermsgargscG|j|g|RddidSN stacklevel)debugr0r1r2rrr_print_debug_onceKr9cGr3r4)infor8rrr_print_info_onceQr:r<cGr3r4)warningr8rrr_print_warning_onceWr:r>)processgloballocalscopecCs8|dkr ddlm}|S|dkrddlm}|SdS)z$Decide whether to log based on scoper@r)is_global_first_rankrA)is_local_first_rankT)vllm.distributed.parallel_staterCrD)rBrCrDrrr_should_log_with_scope`s  rFc @speZdZdZdddedededdfd d Zdddedededdfd d Zdddedededdfd dZ dS) _VllmLoggera  Note: This class is just to provide type information. We actually patch the methods directly on the [`logging.Logger`][] instance to avoid conflicting with other libraries such as `intel_extension_for_pytorch.utils._logger`. r?)rBr1r2rBrNcG"t|sdSt||g|RdS)z~ As [`debug`][logging.Logger.debug], but subsequent calls with the same message are silently dropped. N)rFr9selfr1rBr2rrr debug_oncewz_VllmLogger.debug_oncecGrH)z| As [`info`][logging.Logger.info], but subsequent calls with the same message are silently dropped. N)rFr<rIrrr info_oncesz_VllmLogger.info_oncecGrH)z As [`warning`][logging.Logger.warning], but subsequent calls with the same message are silently dropped. N)rFr>rIrrr warning_oncerLz_VllmLogger.warning_once) __name__ __module__ __qualname____doc__strrLogScoperKrMrNrrrrrGns.   rG)rKrMrNcCs"i}tjs tjr tdtjr5t}|dd}tj|d<tj|d<tr&dnd|d<|dd}tj|d<tjrqt tjsDtd tjt tjd d }t | }Wdn1s]wYt|tsotd t|j|}|d iD] }|ddkrd|d<qy|rt|dSdS)NzVLLM_CONFIGURE_LOGGING evaluated to false, but VLLM_LOGGING_CONFIG_PATH was given. VLLM_LOGGING_CONFIG_PATH implies VLLM_CONFIGURE_LOGGING. Please enable VLLM_CONFIGURE_LOGGING or unset VLLM_LOGGING_CONFIG_PATH.r(r#r&r'r$r%r,z6Could not load logging config. File does not exist: %szutf-8)encodingz.Invalid logging config. Expected dict, got %s.r+r zvllm.logging.NewLineFormatterr)rVLLM_CONFIGURE_LOGGINGVLLM_LOGGING_CONFIG_PATH RuntimeErrorr/VLLM_LOGGING_LEVELrrr existsopenjsonloadsread isinstancedict ValueErrortyperOgetvaluesr)logging_config vllm_handler vllm_loggersfile custom_configr%rrr_configure_vllm_root_loggersF         rjnamecCs8t|}tD] \}}t||t||q tt|S)zThe main purpose of this function is to ensure that loggers are retrieved in such a way that we can be sure the root vllm logger has already been configured.)logging getLogger_METHODS_TO_PATCHitemssetattrr r rG)rkr0 method_namemethodrrr init_loggers  rsr&ccs*tjjj}t|dVt|dSN)rlrootmanagerdisable)r& current_levelrrrsuppress_loggings   ry)colornewlineNcCsj|}|dur3|jr,t|jdkr,|jdjdkr,|jdj}t|tr%dSt|tr,dS|j}|dusdS)Nr*rr#rzr{)r(lenrkr%r_rrparent)r0lgrr%rrrcurrent_formatter_types$   rINFOhttpxcCs.|dvr|jj}|j}|jj}||sdSzq|j}|dur*|jj} |j} |jj} nd} d} d} t|dI} tj d} |dkr]| | d|d|d |d | d| d | d n| | d |d|d |d | d| d | d Wdn1swYWn t yYnwt t ||S)N)callrraz%Y-%m-%d %H:%M:%S.%frz Call to z in :z from  z Return from z to )f_code co_filenamef_linenoco_name startswithf_backr[datetimenowstrftimewrite NameErrorr _trace_calls)log_pathroot_dirframeeventargfilenamelineno func_name last_frame last_filename last_linenolast_func_nameftsrrrrsn     r log_file_pathrcCsHtdtd||durtjtjt}tt t ||dS)a Enable tracing of every function call in code under `root_dir`. This is useful for debugging hangs or crashes. `log_file_path` is the path to the log file. `root_dir` is the root directory of the code to trace. If None, it is the vllm root directory. Note that this call is thread-level, any threads calling this function will have the trace enabled. Other threads will not be affected. zVLLM_TRACE_FUNCTION is enabled. It will record every function executed by Python. This will slow down the code. It is suggested to be used for debugging hang or crashes only.zTrace frame log is saved to %sN) r0r=r;osr dirname__file__rsettracerr)rrrrrenable_trace_function_call)s  r)rNrt)?rRrr\rlrrcollections.abcrr contextlibr functoolsrrrlogging.configrr typesr typingr r r vllm.envsrvllm.logging_utilsrrVLLM_LOGGING_PREFIX_FORMAT _DATE_FORMATboolrrYrr/r`rS__annotations__r9r<r>rTrFrGrKrMrNrnrjrsrintryrrmsetLevelWARNINGrOr0rrrrrrs          ""+ 0 $  +