o :/i7 @sNddlZddlZddlmZmZddlmZddlZddlmZm Z ddl m Z ddl m Z ddlmZmZddlmZmZmZmZdd lmZeeZd ed ed efd dZd ed ed efddZdeded efddZdede d eeeffddZ ded e!fddZ"deded efddZ#de eBd eee$eefdBffd d!Z%de eBd e$fd"d#Z&d$e'e eBd e$fd%d&Z(d$e'e eBd e$fd'd(Z)d)ee BeBd$e'eeBdBd ee$BdBfd*d+Z*Gd,d-d-e+Z,dd.d/d0Z-d1ej.d efd2d3Z/d4ej0d efd5d6Z1d7ed eeefdBfd8d9Z2d:ed;edd?Z3dS)@N)JSONDecodeError JSONDecoder)Any) FunctionToolToolChoiceFunction)Tool)Allow)"ChatCompletionNamedToolChoiceParamChatCompletionToolsParam)DeltaFunctionCall DeltaToolCall FunctionCallToolCall) init_loggers1s2returncCsLd}tt|t|}td|D]}||||kr!|||7}q|S|S)a Finds a common prefix that is shared between two strings, if there is one. Order of arguments is NOT important. This function is provided as a UTILITY for extracting information from JSON generated by partial_json_parser, to help in ensuring that the right tokens are returned in streaming, so that close-quotes, close-brackets and close-braces are not returned prematurely. e.g. find_common_prefix('{"fruit": "ap"}', '{"fruit": "apple"}') -> '{"fruit": "ap' r)minlenrange)rrprefix min_lengthird/lsinfo/ai/hellotax_ai/llm_service/venv_vllm/lib/python3.10/site-packages/vllm/tool_parsers/utils.pyfind_common_prefix s rcCsdd}tt|t|}td|dD]}|| || kr-|| s-|| |}q|S|S)a Finds a common suffix shared between two strings, if there is one. Order of arguments is NOT important. Stops when the suffix ends OR it hits an alphanumeric character e.g. find_common_suffix('{"fruit": "ap"}', '{"fruit": "apple"}') -> '"}' r)rrrisalnum)rrsuffixrrrrrfind_common_suffix7s"r curroldcCst||}|ddd|dddddddd}t||}|}t|r<|ddd|dddddddd}t|rG||dd}|S)a Given two strings, extract the difference in the middle between two strings that are known to have a common prefix and/or suffix. This function is provided as a UTILITY for extracting information from JSON generated by partial_json_parser, to help in ensuring that the right tokens are returned in streaming, so that close-quotes, close-brackets and close-braces are not returned prematurely. The order of arguments IS important - the new version of the partially-parsed JSON must be the first argument, and the secnod argument must be from the previous generation. What it returns, is tokens that should be streamed to the client. e.g. extract_intermediate_diff('{"fruit": "apple"}', '{"fruit": "ap"}') -> 'ple' Nrr)r replacerr)r!r"rrdiffrrrextract_intermediate_diffIs , ,r& input_strflagsc CsXz t||t|fWSty+}zd|jvr&t}||WYd}~Sd}~ww)Nz Extra data)partial_json_parserloadsrrmsgr raw_decode)r'r(edecrrrpartial_json_loadsls r/cCs&zt|WdStyYdSw)NTF)jsonr*r)r'rrris_complete_jsonvs   r1rscCs<|t|kr||r|d7}|t|kr||s |S)Nr)risspace)rr2rrr consume_space~sr4toolcCsBt|tr |j|jfSt|tr|jj|jjfStdt|)NzUnsupported tool type: ) isinstancername parametersr function TypeErrortype)r5rrr_extract_tool_infos   r<cCs:t|\}}|r |ndid}d|gd|dddgdS) Nobject)r; propertiesstring)r;enum)r7r8r7r8)r>required)r<)r5r7paramsrrr_get_tool_schema_from_tools  rCtoolscCsri}|D]2}t|\}}|durq|di}|D]\}}||vr1|||kr1td|d|||<qq|S)N$defszTool definition 'z/' has multiple schemas, which is not supported.)r<popitems ValueError)rDall_defsr5_rBdefsdef_name def_schemarrr_get_tool_schema_defss    rNcCs4ddddd|Ddd}t|}|r||d<|S) Narrayrr=cSg|]}t|qSr)rC.0r5rrr z/_get_json_schema_from_tools..)r;anyOf)r;minItemsrGrE)rN)rD json_schemajson_schema_defsrrr_get_json_schema_from_toolss rY tool_choicecCs|dvs|dur dSt|ts/t|tr/|j}dd|D}||vr*td|d||jSt|tsVt|trV|jj}dd|D}||vrPtd|d||jjS|dkr^t|SdS)N)noneNcSsi|] }t|tr|j|qSr)r6rr7rQrrr sz.get_json_schema_from_tools..zTool 'z!' has not been passed in `tools`.cSs i|] }t|tr|jj|qSr)r6r r9r7rQrrrr\s rA) r6strrr7rHr8r r9rY)rZrD tool_nametool_maprrrget_json_schema_from_toolss.    r`c@seZdZdZdS)UnexpectedAstErrorzXRaised when the AST structure does not match the expected pythonic tool call format.N)__name__ __module__ __qualname____doc__rrrrrasraTF)nulltruefalsevalcCst|tjr |jSt|tjr2tdd|jDs&tdt |t dddt |j|j DSt|tj r@dd|jDSt|tjrP|jtvrPt|jStd t |t d ) aBExtract a Python literal value from an AST expression node. Handles constants, dicts, lists, and JSON-style name literals (null, true, false) that some models produce instead of Python literals (None, True, False). Raises: UnexpectedAstError: If the AST node is not a supported literal type. css|] }t|tjVqdS)N)r6astConstant)rRkrrr sz&get_parameter_value..z+Dict argument keys are not all literals: %sz/Dict tool call arguments must have literal keyscSsi|] \}}|jt|qSr)valueget_parameter_value)rRrlvrrrr\ s z'get_parameter_value..cSrPr)ro)rRrprrrrSrTz'get_parameter_value..z4Unsupported AST node type in tool call arguments: %sz$Tool call arguments must be literals)r6rjrkrnDictallkeysloggerwarningdumprazipvaluesListeltsNameid_JSON_NAME_LITERALS)rirrrros*     rocallcCspt|jtjstdt|jtd|jj}i}|j D] }t |j ||j <qt dt|tj|ddddS)zConvert a single AST function call node into a ToolCall object. Raises: UnexpectedAstError: If the call node does not have a simple function name (e.g. it's an attribute access or subscript). z*Tool call has non-simple function name: %szInvalid tool call namer9F) ensure_asciir7 arguments)r;r9)r6funcrjr{rtrurvrar|keywordsrornargrr r0dumps)r~ function_namerkeywordrrrhandle_single_tools"   rtextc Csg}t|D]m\}}|dvr||q|dkr%|r |dkr$tdq|dkr6|r1|dkr5tdq|dkrG|rB|d krFtd q|d vrs|re|d |kre|d kr`||ddkr`q|q|rn|d d vrnq||q|}|ds|drdS|r|d d kr|d|d }|d}|d}||krdS|r|d dkr|d|d}|d}|d} || krdS|dr|dd }|r|d dkr|ds|dsdSdddddd} d} t|D]}| | |7} q|| | fS)aAttempt to close all open brackets/quotes to make partial Python valid. Used during streaming to parse incomplete tool call expressions by appending the necessary closing characters. Returns: A tuple of (completed_text, added_suffix) if the text can be made valid, or None if the text is too incomplete to complete meaningfully (e.g. mid-parameter-name or mid-dict-key). Raises: UnexpectedAstError: If mismatched brackets or parentheses are detected. >{([]rzMismatched square brackets)rzMismatched parentheses}rzMismatched curly braces>"'r#rr\=:N,rr)rrrrrr) enumerateappendrFrarstripendswithrfindcountreversed) r bracket_stackindexchartrailing_dict_textnum_keys num_valuestrailing_params_textnum_full_param_namesnum_full_param_values_CLOSING added_textrrrmake_valid_python4sn            rpreviously_sent_argsnew_callrwithheld_suffixcCs|jj}|r&||sd|d|d}t|t||dt| }|s7t|jd|t |jj |ddS|t|d}|rKtd|t |dd SdS) aCompute the incremental delta between previously streamed arguments and the current tool call state. Returns: A DeltaToolCall with only the new argument characters, or None if there is no difference from what was previously sent. zTool call arguments 'z,' do not end with expected withheld suffix 'rNr9r)r|r;rr9)r)r|rr9) r9rrrterrorrHrr r|r r7)rrrr new_call_argsr+arg_diffrrrcompute_tool_delta|s<    r)4rjr0rrtypingrr)openai.types.responsesrropenai.types.responses.toolr partial_json_parser.core.optionsr0vllm.entrypoints.openai.chat_completion.protocolr r 'vllm.entrypoints.openai.engine.protocolr r r r vllm.loggerrrbrtr]rr r&tupleintr/boolr1r4dictr<rClistrNrYr` Exceptionrar}exprroCallrrrrrrrsx    #          *#H