o Ղi>@sdZddlZddlmZmZddlmZmZmZm Z ddl m Z ddl m Z ddlmZmZddlmZeeZeZd efd d ZGd d d e Zded dfddZded dfddZejdddedddfdedefddZdedeed dfd d!ZdS)"z Internal endpoint: POST /internal/switch_mode Switches the LLM service between inference and training modes. Requires the X-Internal-Token header. N)LiteralOptional) APIRouterHeader HTTPExceptionstatus) BaseModel)settings)get_status_manager ServiceMode) get_loggerreturncCstjS)N)r SWITCH_MODE_SCRIPTrrD/lsinfo/ai/hellotax_ai/base_platform/app/api/internal/switch_mode.py_get_script_pathsrc@s*eZdZUeded<dZeeed<dS)SwitchModeRequest) inferencetrainingmedia_processingmodeN training_info)__name__ __module__ __qualname__r__annotations__rrdictrrrrrs rtokencCs8ttdd}|sttjdd||krttjdddS)zMRaise 403 if the provided token does not match the configured internal token.INTERNAL_API_TOKENNz4INTERNAL_API_TOKEN is not configured on this server.) status_codedetailzInvalid internal token.)getattrr rrHTTP_500_INTERNAL_SERVER_ERRORHTTP_403_FORBIDDEN)rexpectedrrr_verify_internal_tokens r%rc st}zJtjd||tjjtjjdIdH}|IdH\}}|r'|jddnd}|jdkr=t d|jd |WdSt d |d |dd WdSt yi}zt d |WYd}~dSd}~ww) zHRun switch_mode.sh in the background without blocking the HTTP response.bash)stdoutstderrNreplace)errorsrzswitch_mode.sh exited z: z"switch_mode.sh completed for mode=zFailed to run switch_mode.sh: ) rasynciocreate_subprocess_exec subprocessPIPESTDOUT communicatedecode returncodeloggererrorinfo Exception)r script_pathprocr'_outputerrr_run_switch_script+s"  $r>z /switch_modez"Switch LLM service mode (internal))summary.zX-Internal-Token)aliasbodyx_internal_tokencst|t}t|j}|tjtd|j|tjkr9|j r9ddl m }ddl }|j |||j tt|||j d|jd|jddS) aO Switch the LLM service to **inference** or **training** mode. - Immediately marks Redis status as ``switching``. - Fires ``switch_mode.sh `` in the background. - On script start the Redis key is set to the requested mode. Requires: ``X-Internal-Token`` header matching ``settings.INTERNAL_API_TOKEN``. zMode switch initiated: target=r)REDIS_KEY_TRAINING_INFON switchingzMode switch to 'z?' initiated. Service will be in switching state until complete.)r target_modemessage)r%r r rset_mode SWITCHINGr5r7TRAININGr'app.services.llm.service_status_managerrCjson_redissetdumpsr- create_task_background_switch)rArBmanagerrErCrKrrr switch_mode>s    rRrErc stzt|jIdH|j||dtd|jdWdSty9}ztd|d|tjd}~ww)z9Run the shell script then update Redis to the final mode.N)rzMode switch complete: now in z modezBackground switch failed: z. Reverting to inference mode.) r>valuerGr5r7r8r6r INFERENCE)rQrErr=rrrrPes rP)__doc__r-typingrrfastapirrrrpydanticr app.configr rJr r app.core.loggingr rr5routerstrrrr%r>postrRrrPrrrrs8      &