XjW$nddlZddlZddlmZddlmZeeZGddZda defdZ dS)N)FileProcessingError) get_loggerc eZdZeddededefdZeddededefdZeddededefd Zeddededefd Z eddededefd Z eddededefdZ e ddedededefdZ dS)FileParserServicefile.txtcontentfilenamereturnc^ dD])} ||cS#t$rY&wxYwtdt |d#t$rt $r@}td|t |t |dd}~wwxYw)N)utf-8gbkgb2312latin-1z5Unable to decode TXT file with any supported encodingu-无法使用任何支持的编码解码文件zFailed to parse TXT file: decodeUnicodeDecodeErrorloggererrorr Exceptionstrrr encodinges J/lsinfo/ai/hellotax_ai/base_platform/app/services/knowledge/file_parser.py parse_txtzFileParserService.parse_txts BA  ">>(33333)H LLP Q Q Q%h0_`` `"     B B B LL9a99 : : :%hA77T A B2AA +A+-AB,,;B''B,file.pdfc( ddlm}tjdd5}|||j}dddn #1swxYwY ||}|}d|D}d|}t dt|d t|d |tj |rtj|SS#tj |rtj|wwxYw#t$rt $r@} td | t|t%| dd} ~ wwxYw) Nr) PyPDFLoaderFz.pdfdeletesuffixcNg|]"}|j|j#S page_contentstrip.0docs r z/FileParserService.parse_pdf..*/```3sGWG]G]G_G_`c.``` zSuccessfully parsed PDF, z pages, extracted characterszFailed to parse PDF file: )$langchain_community.document_loadersrtempfileNamedTemporaryFilewritenameloadjoinrinfolenospathexistsunlinkrrrr) rr rtmp_file tmp_file_pathloader documents text_partsresultrs r parse_pdfzFileParserService.parse_pdfs B H H H H H H,E&III .Xw''' (  . . . . . . . . . . . . . . . -$]33"KKMM ``)``` Z00 jIjjRUV\R]R]jjj7>>-00-Im,,,,-27>>-00-Im,,,,-"     B B B LL9a99 : : :%hA77T A BsRD=A D=A  D=A D=AH||z} d| } | s-t d|t|d| d s d | dd vr-td |t|d tdt#| d| S#t$rt$$r@} td| t|t'| dd} ~ wwxYw)Nr)BytesIOcNg|]"}|j|j#Sr$textr')r)paras rr+z0FileParserService.parse_docx..As+TTT$)//BSBST$)TTTr-z | c3zK|]6}|j|jV7dSNrH)r)cells r z/FileParserService.parse_docx..EsS**.249??CTCT* ))******r-r.zExtracted empty content from u文档内容为空u ÐÏࡱádzExtracted binary content from u<提取的内容包含二进制数据，文件可能已损坏z.Successfully parsed .docx document, extracted r/z Failed to parse .docx document: )iorFdocxDocument paragraphstablesrowsr6cellsappendr'rwarningr startswithrr7r8rr) rr rFrRr*rT tables_texttablerowrow_textall_textrBrs r parse_docxzFileParserService.parse_docx9s B " " " " " " KKK-- 0 011CTTTTTJK 5 5 :55C$zz**69i***  H 5#**8444 5 "K/H[[**F<<>> JIxIIJJJ)(4HIII  00 tFfTcTl4J4J HhHHIII)(4rsss KKaVaaa b b bM"     B B B LL?A?? @ @ @%hA77T A BsEE""F66;F11F6file.docc ddl}tjdd5}|||j}dddn #1swxYwY |d|gddd}|jdkr|jrz|j}t d t|d |tj |rtj|SStd |jn4#t$$r'}td |Yd}~nd}~wwxYw dd lm}t d||} | } d| D} d| }|rat dt|d |tj |rtj|SSn4#t$$r'} td| Yd} ~ nd} ~ wwxYw t ddD]} || }|rt|dkrft d| dt|d |ctj |rtj|SS#t0t2f$rYwxYwn4#t$$r'}td|Yd}~nd}~wwxYwtdt7|d#tj |rtj|wwxYw)NrFz.docr antiwordT)capture_outputrItimeoutz2antiword successfully parsed .doc file, extracted r/zantiword parsing failed: zantiword execution failed: )Docx2txtLoaderz#Attempting to use Docx2txtLoader...cNg|]"}|j|j#Sr$r%r(s rr+z/FileParserService.parse_doc..vr,r-r.z3Docx2txtLoader successfully parsed file, extracted zDocx2txtLoader also failed: z#Attempting to read as plain text...)r r rrcp1252 zSuccessfully read file with z encoding, extracted z Plain text reading also failed: zAll .doc parsing methods failed. Suggestions: 1) Verify file is standard Word format; 2) Try saving file as .docx format; 3) Open and re-save with another text editoruJ所有解析方法均失败，请验证文件格式或转换为.docx格式) subprocessr1r2r3r4run returncodestdoutr'rr7r8r9r:r;r<rYstderrrr0rgr5r6rrAttributeErrorrr)rr rkr=r>rBrIrrgr?r@rA docx_errorr text_errors r parse_doczFileParserService.parse_docZs  (f E E E * NN7 # # #$MM * * * * * * * * * * * * * * *4 ) B#/4Y[($))fm.A.A.C.C)!=..00DKKcSQUYYccc Rw~~m,, ) -(((( )ONN#Nv}#N#NOOOO B B B@Q@@AAAAAAAA B LOOOOOO ABBB' 66"KKMM ``)``` Z00"KKfcRXkkfff"0w~~m,, ) -(((( )9"  L L LJjJJKKKKKKKK L P ABBB O ! !H!&~~h77(C $5$5$:$:"KK tx t t^abf^g^g t t t$(KKw~~m,, ) -(((( )/?!!! ! ! P P PN*NNOOOOOOOO P LLy   &f w~~m,, ) -(((( )sAA ABD- "D-,N- E7ENEN"BH&%N& I0I NINL5:A+L%L5L5L1.L50L11L54N5 M&?M!N!M&&-N6O  file.pptxc ddlm}tjdd5}|||j}dddn #1swxYwY ||}|}d|D}d|}t dt|d |tj |rtj|SS#tj |rtj|wwxYw#t$rt $r@} td | t|t%| dd} ~ wwxYw) Nr)UnstructuredPowerPointLoaderFz.pptxr cNg|]"}|j|j#Sr$r%r(s rr+z0FileParserService.parse_pptx..r,r-r.z#Successfully parsed PPT, extracted r/zFailed to parse PPT document: )r0rvr1r2r3r4r5r6rr7r8r9r:r;r<rrrr) rr rvr=r>r?r@rArBrs r parse_pptxzFileParserService.parse_pptxs B Y Y Y Y Y Y,E'JJJ .hw''' (  . . . . . . . . . . . . . . . -55mDD"KKMM ``)``` Z00 Z#f++ZZZ[[[7>>-00-Im,,,,-27>>-00-Im,,,,-"     B B B LL=!== > > >%hA77T A BsRD-A D-A  D-A D-A,C4?3D-46D**D--F;E<<Ffile.mdc^ dD])} ||cS#t$rY&wxYwtdt |d#t$rt $r@}td|t |t |dd}~wwxYw)N)r r rzUnable to decode Markdown fileu5无法使用任何支持的编码解码Markdown文件zFailed to parse Markdown file: rrs rparse_mdzFileParserService.parse_mds B6  ">>(33333)H LL9 : : :%h0ghh h"     B B B LL>1>> ? ? ?%hA77T A Brfile file_typec |d}|j|j|j|j|j|j|j|j|jd }||}|r"|||}| ddSt d|t|d|)N.) txtrIpdfr*rRpptpptxmdmarkdownrOzUnsupported file type: u不支持的文件类型: ) lowerr'rrCrsr`rxr{getreplacerrYr)clsrr}r parsersparserrIs r parse_filezFileParserService.parse_filesOO%%++C00 =M==N>N,    Y''  Z6'8,,D<<++ + NN@Y@@ A A A%h0XY0X0XYY Yr-N)r)r)rD)ra)rt)ry)r|)__name__ __module__ __qualname__ staticmethodbytesrrrCr`rsrxr{ classmethodrr$r-rrr s B B5 BC B B B B\ BBB5BCBBBB\B2BBEBSB3BBB\B@:):)5:)C:):):):)\:)xBBEBSB3BBB\B0 B B% B3 Bs B B B\ BZZZ3Z#ZSVZZZ[ZZZr-rr c:ttatSrL)_file_parser_servicerr$r-rget_file_parser_servicers#022 r-) r9r1app.core.exceptionsrcommon_loggingrrrrrrr$r-rrs 333333%%%%%% H   GZGZGZGZGZGZGZGZT !2      r-