o 3iLS@s(ddlZddlZddlmZmZmZmZddlmZzddl Z Wn e y+e dwddl m Z mZmZmZddlmZmZmZmZddlmZmZddlmZdd lmZGd d d e jZGd d d ZGdddZ GdddZ!GdddZ"GdddZ#GdddZ$GdddZ%dS)N)AnyDictListOptional) TokenUsagezGPlease install the OpenAI SDK to use this feature: 'pip install openai')call_llm_and_track_usageextract_available_tool_callsmerge_usage_statswith_privacy_mode)extract_openai_usage_from_chunk!extract_openai_content_from_chunk$extract_openai_tool_calls_from_chunkaccumulate_openai_tool_calls)sanitize_openaisanitize_openai_response)Client)setupcs6eZdZUdZeed<ddeeffdd ZZS)OpenAIz_ A wrapper around the OpenAI SDK that automatically sends LLM usage events to PostHog. _ph_clientNposthog_clientc stjdi||p t|_t|dd|_t|dd|_t|dd|_t|dd|_|jdur7t ||j|_ |jdurCt ||j|_ |jdurOt ||j|_|jdur]t||j|_dSdS)a Args: api_key: OpenAI API key. posthog_client: If provided, events will be captured via this client instead of the global `posthog`. **openai_config: Any additional keyword args to set on openai (e.g. organization="xxx"). chatN embeddingsbeta responses)super__init__rrgetattr_original_chat_original_embeddings_original_beta_original_responses WrappedChatrWrappedEmbeddingsr WrappedBetarWrappedResponsesr)selfrkwargs __class__rf/lsinfo/ai/hellotax_ai/llm_service/venv_embed/lib/python3.10/site-packages/posthog/ai/openai/openai.pyr&s     zOpenAI.__init__N) __name__ __module__ __qualname____doc__ PostHogClient__annotations__rr __classcell__rrr(r*rs  rc@s|eZdZdZdefddZddZ     dd eed eed ee ee fd e d ee ee fde f ddZ d eed eed ee ee fd e d ee ee fde f ddZ  dd eed eed ee ee fd e d ee ee fde ee fdedede deee ee fdeefddZ     dd eed eed ee ee fd e d ee ee fde f ddZdS)r%z:Wrapper for OpenAI responses that tracks usage in PostHog.clientcC||_||_dSr+_client _original)r&r3original_responsesrrr*rH zWrappedResponses.__init__cC t|j|S)zQFallback to original responses object for any methods we don't explicitly handle.rr7r&namerrr* __getattr__L zWrappedResponses.__getattr__NFposthog_distinct_idposthog_trace_idposthog_propertiesposthog_privacy_modeposthog_groupsr'c Kf|dur tt}|ddr|j|||||fi|St||jjd|||||jj|j j f i|SNstreamFopenai struuiduuid4get_create_streamingrr6rbase_urlr7creater&r@rArBrCrDr'rrr*rPP2    zWrappedResponses.createc sPt t gd jjdi f dd}|S)Nc3szTD]5}t|dr|jrdurt|jdr|jjt|d}|r(t |t|d}|dur6||VqWt}| }}  ||d dSt}| }}  ||d w)Nresponsemodelr) hasattrrSrTr r r appendtime_capture_streaming_event)chunk chunk_usagecontentend_timelatencyoutput final_contentr'model_from_responser@rDrCrBrArSr& start_time usage_statsrr* generators`     z5WrappedResponses._create_streaming..generatorrrWrr7rPr&r@rArBrCrDr'rdrr_r*rNss ".z"WrappedResponses._create_streamingrcr]r^available_tool_callsrac Csddlm} ddlm} m}ddlm}| |d}t|}|dp%| p%d}| d|t |j j |||| d|||||||d }||j j |dS) NrStreamingEventDataformat_openai_streaming_inputformat_openai_streaming_outputcapture_streaming_eventrrTunknownrH providerrTrOr'formatted_inputformatted_outputrcr] distinct_idtrace_id properties privacy_modegroups) posthog.ai.typesri"posthog.ai.openai.openai_converterrkrlposthog.ai.utilsrnrrMrJr6rOr)r&r@rArBrCrDr'rcr]r^rgrarirkrlrnrrsanitized_inputrT event_datarrr*rXs,    z)WrappedResponses._capture_streaming_eventc K,t||jjd|||||jj|jjf i|S)a Parse structured output using OpenAI's 'responses.parse' method, but also track usage in PostHog. Args: posthog_distinct_id: Optional ID to associate with the usage event. posthog_trace_id: Optional trace UUID for linking events. posthog_properties: Optional dictionary of extra properties to include in the event. posthog_privacy_mode: Whether to anonymize the input and output. posthog_groups: Optional dictionary of groups to associate with the event. **kwargs: Any additional parameters for the OpenAI Responses Parse API. Returns: The response from OpenAI's responses.parse call. rHrr6rrOr7parserQrrr*rs zWrappedResponses.parseNNNFN)NN)r,r-r.r/rrr>rrJrrboolrPrNrfloatrrXrrrrr*r%Es # J     1r%c@2eZdZdZdefddZddZeddZd S) r"z5Wrapper for OpenAI chat that tracks usage in PostHog.r3cCr4r+r5)r&r3 original_chatrrr*r r9zWrappedChat.__init__cCr:)zLFallback to original chat object for any methods we don't explicitly handle.r;r<rrr*r> r?zWrappedChat.__getattr__cCt|j|jjSr+)WrappedCompletionsr6r7 completionsr&rrr*rzWrappedChat.completionsN r,r-r.r/rrr>propertyrrrrr*r" r"c@sDeZdZdZdefddZddZ     dd eed eed ee ee fd e d ee ee fde f ddZ d eed eed ee ee fd e d ee ee fde f ddZ   dd eed eed ee ee fd e d ee ee fde ee fdedede deee ee fdeee ee fdeefddZdS)rzAWrapper for OpenAI chat completions that tracks usage in PostHog.r3cCr4r+r5)r&r3original_completionsrrr*rr9zWrappedCompletions.__init__cCr:)zSFallback to original completions object for any methods we don't explicitly handle.r;r<rrr*r>r?zWrappedCompletions.__getattr__NFr@rArBrCrDr'c KrErFrIrQrrr*rP!rRzWrappedCompletions.createc srt t giddvrid<ddd< jjdi  f dd}|S)Nstream_optionsT include_usagec3sza D]6}durt|dr|jt|d}|rt |t|d}|dur,|t|}|r7t||VqWt}| }rLt  nd}  ||t d dSt}| }rst  nd}  ||t d w)NrTrrH) rUrTr r r rVr rrWlistvaluesrXr)rYrZr[chunk_tool_callsr\r]tool_calls_list accumulated_contentaccumulated_tool_callsr'rar@rDrCrBrArSr&rbrcrr*rdWst    z7WrappedCompletions._create_streaming..generatorrrerfrrr*rNDs  $;z$WrappedCompletions._create_streamingrcr]r^ tool_callsrgrac Csddlm} ddlm}m}ddlm}||d}t|}|dp%| p%d}| d|t |j j |||| d| |||||||d }||j j |dS) NrrhrjrmrrTrorHrp) ryrirzrkrlr{rnrrMrJr6rOr)r&r@rArBrCrDr'rcr]r^rrgrarirkrlrnrrr|rTr}rrr*rXs,     z+WrappedCompletions._capture_streaming_eventr)NNN)r,r-r.r/rrr>rrJrrrrPrNrrrrXrrrr*rs~ # [      rc@teZdZdZdefddZddZ     dd eed eed ee ee fd e d ee ee fde f ddZ dS)r#z;Wrapper for OpenAI embeddings that tracks usage in PostHog.r3cCr4r+r5)r&r3original_embeddingsrrr*rr9zWrappedEmbeddings.__init__cCr:)zRFallback to original embeddings object for any methods we don't explicitly handle.r;r<rrr*r>r?zWrappedEmbeddings.__getattr__NFr@rArBrCrDr'c Ks|dur tt}t}|jjdi|}t} i} t|dr4|jr4t|jddt|jddd} | |} d| dt |j j |t | d d | dd| |t|j jd |p[i} |dured | d <t|j j dry|j j j|ps|d| |d|S)a Create an embedding using OpenAI's 'embeddings.create' method, but also track usage in PostHog. Args: posthog_distinct_id: Optional ID to associate with the usage event. posthog_trace_id: Optional trace UUID for linking events. posthog_properties: Optional dictionary of extra properties to include in the event. posthog_privacy_mode: Whether to anonymize the input and output. posthog_groups: Optional dictionary of groups to associate with the event. **kwargs: Any additional parameters for the OpenAI Embeddings API. Returns: The response from OpenAI's embeddings.create call. Nusage prompt_tokensr total_tokens)rrrHrTinput)z $ai_providerz $ai_modelz $ai_inputz$ai_http_statusz$ai_input_tokensz $ai_latencyz $ai_trace_idz $ai_base_urlFz$process_person_profilecapturez $ai_embedding)rteventrvrxr)rJrKrLrWr7rPrUrrrMr r6rrrOr) r&r@rArBrCrDr'rbrSr\rcr]event_propertiesrrr*rPsH       zWrappedEmbeddings.creater) r,r-r.r/rrr>rrJrrrrPrrrr*r#,r#c@r) r$z>Wrapper for OpenAI beta features that tracks usage in PostHog.r3cCr4r+r5)r&r3 original_betarrr*rr9zWrappedBeta.__init__cCr:)zLFallback to original beta object for any methods we don't explicitly handle.r;r<rrr*r> r?zWrappedBeta.__getattr__cCrr+)WrappedBetaChatr6r7rrrrr*r$rzWrappedBeta.chatN) r,r-r.r/rrr>rrrrrr*r$rr$c@r) rz:Wrapper for OpenAI beta chat that tracks usage in PostHog.r3cCr4r+r5)r&r3original_beta_chatrrr*r,r9zWrappedBetaChat.__init__cCr:)zQFallback to original beta chat object for any methods we don't explicitly handle.r;r<rrr*r>0r?zWrappedBetaChat.__getattr__cCrr+)WrappedBetaCompletionsr6r7rrrrr*r4rzWrappedBetaChat.completionsNrrrrr*r)rrc@r)rzFWrapper for OpenAI beta chat completions that tracks usage in PostHog.r3cCr4r+r5)r&r3original_beta_completionsrrr*r<r9zWrappedBetaCompletions.__init__cCr:)zXFallback to original beta completions object for any methods we don't explicitly handle.r;r<rrr*r>@r?z"WrappedBetaCompletions.__getattr__NFr@rArBrCrDr'c Kr~)NrHrrQrrr*rDs  zWrappedBetaCompletions.parser) r,r-r.r/rrr>rrJrrrrrrrr*r9rr)&rWrKtypingrrrrryrrH ImportErrorModuleNotFoundErrorr{rrr r rzr r r rposthog.ai.sanitizationrrposthog.clientrr0posthogrrr%r"rr#r$rrrrrr*s4     &B0T