Xjx+ ddlmZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZeeZGd d ZGd d Zdde dedzdefdZ dde dedzdedzdedzdedef dZdS))Any)StrOutputParser)ChatPromptTemplate)RunnablePassthrough) ChatOpenAI)Session)get_embedding_factory)get_vector_store) get_loggercfeZdZddededzfdZ dded ed ed ed edzd ee ee ff dZ ded ed ed edzd ee ee ff dZ ded ed ee ee ffdZ ded ed ed edzdeded ee ee ffdZ dded ed ed ed edzd e ee ff dZdS)RetrievalServiceNdbknowledge_base_idcr||_||_t|||_t |_dSN)rrr vector_storer embedding_factory)selfrrs L/lsinfo/ai/hellotax_ai/base_platform/app/services/rag/langchain_retrieval.py__init__zRetrievalService.__init__s8!2,R1BCC!6!8!8semanticffffff?querymodek thresholdmodel_idreturnc  |dkr|||||S|dkr|||S|dkrF|dd}|dd}|||||||St d|#t $r#} t d | d} ~ wwxYw) Nrkeywordhybridkeyword_weightg333333?semantic_weightrzUnsupported retrieval mode: zRetrieval failed: )_semantic_search_keyword_searchget_hybrid_search ValueError Exceptionloggererror) rrrrrrkwargsr$r%es rretrievezRetrievalService.retrieves z!!,,UAy(KKK""++E1555!!!',"D"D**1i>?!!F!F!FGGG    LL1a11 2 2 2  s(BBA BB C$CCc N|j||j|}|std|j|||}g}|D]O\}} ||d|d|d|d|d| |d |d d d P|S) Ntextrr"Failed to generate query embedding)query_embeddingrrid document_idtitler3 chunk_index category_id model_namer:r;r6r7r8r3r9scoremetadata)rgenerate_embeddingrr*rsimilarity_searchappend) rrrrrr5resultsformatted_resultsdocr>s rr&z!RetrievalService._semantic_search5s0CC47XD   CABB B#55+qI6  !  JC  $ $d)#&}#5 \K#&}#5"'*='9&),&7!!      ! rc ddlm}dg}||d}|j|d|j|d<|dd|d }|j||}g}|D]W} || j| j| j | j | j t| j | j| jd d X|S) Nr)r3z(setweight(to_tsvector('simple', COALESCE(kd.title, '')), 'A') || setweight(to_tsvector('simple', COALESCE(dv.chunk_text, '')), 'B')) @@ plainto_tsquery('simple', :query))rrz)dv.knowledge_base_id = :knowledge_base_idras SELECT dv.id, dv.document_id, dv.chunk_index, dv.chunk_text, dv.model_name, kd.title, kd.category_id, ts_rank( setweight(to_tsvector('simple', COALESCE(kd.title, '')), 'A') || setweight(to_tsvector('simple', COALESCE(dv.chunk_text, '')), 'B'), plainto_tsquery('simple', :query) ) as score FROM document_vectors dv JOIN knowledge_documents kd ON dv.document_id = kd.id WHERE z AND z> ORDER BY score DESC LIMIT :k r<r=) sqlalchemyr3rrBjoinrexecuter6r7r8 chunk_textr9floatr>r:r;) rrrr3 where_clausesparams keyword_queryresultrDrows rr'z RetrievalService._keyword_searchRs?###### z !q))  ! -  !L M M M*.*@F& ' q S Z S _ S _ ` m S n S n q q q   77  C  $ $&#&? YN#&?"39--03s~ ^ ^    ! rr$r%c T|j||j|}|std|j||||||}g} |D]O\} } | | d| d| d| d| d| | d | d d d P| S) Nr2r4)rr5rrr$r%r6r7r8r3r9r:r;r<r=)rr@rr*r hybrid_searchrB) rrrrrr$r%r5rCrDrEr>s rr)zRetrievalService._hybrid_searchos0CC47XD   CABB B#11+)+ 2  !  JC  $ $d)#&}#5 \K#&}#5"'*='9&),&7!!      ! rc  ddl}|}|jd|||||d|} |} | |z } d| D} | rt| t| z nd} | rt | nd}| rt | nd}|||||d|| t| | ||| ddS#t $r#}td|d}~wwxYw) Nrrrrrrcg|] }|d S)r>).0rs r z0RetrievalService.recall_test..s222Qaj222r)rrr) total_results avg_score max_score min_score elapsed_time)rrrMrC statisticszRecall test failed: rV) timer0sumlenmaxminr+r,r-)rrrrrrr.r` start_timerCend_timer^scoresr[r\r]r/s r recall_testzRetrievalService.recall_testsL  KKKJ#dm$!y8W]Gyy{{H#j0L22'222F5;BF c&kk11I'-4F 1I'-4F 1I ! xZZSYZ"%(\\!*!*!*$0        LL333 4 4 4  sB9B<< C)C$$C)r)rrrN)__name__ __module__ __qualname__rintrstrrKlistdictrr0r&r'r)rhrVrrr r s 9979sTz9999#      *  d38n 4!! !-2!>ADj! d38n !!!!:!S!S!T$sCx.5I!!!!:&!&! &! &! * &!  &!&! d38n &!&!&!&!V# &&&&  &  & * & c3h&&&&&&rr ceZdZ ddededzdedzdedzdef dZ dd ed ededededzdedzdeee ffdZ dS) RAGServiceN gpt-3.5-turborr llm_api_key llm_base_url llm_modelc||_||_t|||_|rt |||d|_dSd|_dS)Nr)api_keybase_urlmodel temperature)rrr retrieval_servicerllm)rrrrsrtrus rrzRAGService.__init__s_!2!1"6G!H!H  !#l)Y\DHHHDHHHrrrrquestionrrrr system_promptr c |jstd|j|||||}|sdggdSddt |D d}t jd|p|fd g} fd td | z|jztz} | |} | d |D|dS#t$r#} t d | d} ~ wwxYw)Nz*LLM not configured, cannot generate answerrTzCSorry, I could not find relevant information in the knowledge base.)answersourcesretrieved_docsz c Hg|]\}}d|dzd|dd|d S)z Document z (Source: r8z): r3rV)rWirEs rrYz.RAGService.answer_question..sQ3QAPPWPP3v;PPraYou are a professional knowledge base assistant. Please answer the user's question based on the provided document content. Requirements: 1. Only use the provided document content to answer questions 2. If there is no relevant information in the documents, clearly inform the user 3. Answers should be accurate, concise, and professional 4. If possible, cite specific document sourcessystem)humanz9Reference documents: {context} User question: {question}cSrrV)xcontexts rz,RAGService.answer_question..sgr)rr}cbg|],}|d|d|ddddz|dd-S)r7r8r3Nz...r>)r7r8r3r>rV)rWrEs rrYz.RAGService.answer_question..s\ (+='9!$W #F DSD 1E 9!$W rzRAG Q&A failed: )r|r*r{r0rH enumerater from_messagesrrinvoker+r,r-)rr}rrrrr~rdefault_system_promptprompt rag_chainrr/rs @ranswer_questionzRAGService.answer_questions/ 8 O !MNNN!3<<TQ)h=N" c!&( kk"+N";";G %m !'5}E0EF]F.---;N;P;PQQ("##$  %%h//F  .#1       LL/A// 0 0 0  srs999999555555888888''''''""""""UUUUUUFFFFFF%%%%%% H   jjjjjjjjZLLLLLLLL^33g3#*3P`3333 %)"#$ SSSTzStS* S  S  SSSSSSr