jhvdZddlZddlmZddlmZmZmZm Z m Z GddeZ d de e efde d ee fd Zy) zDocument loader helpers.N)Path)List NamedTupleOptionalUnioncastc@eZdZUdZeeed< eed< eeed<y) FileEncodingz File encoding as the NamedTuple.encoding confidencelanguageN)__name__ __module__ __qualname____doc__rstr__annotations__floatv/var/www/html/Fitness-lenito-AI-main/venv/lib/python3.12/site-packages/langchain_community/document_loaders/helpers.pyr r s(*sm#)sm#rr file_pathtimeoutreturncddlt|}dtdttffd }tj j 5}|j||} |j|} dddtdDrtd ||Dcgc]}|d  td i|c}S#tj j$rtd|wxYw#1swYwxYwcc}w) aTry to detect the file encoding. Returns a list of `FileEncoding` tuples with the detected encodings ordered by confidence. Args: file_path: The path to the file to detect the encoding for. timeout: The timeout in seconds for the encoding detection. rNrrct|d5}|j}dddtttj S#1swY/xYw)Nrb)openreadrrdict detect_all)rfrawdatachardets rread_and_detectz.detect_file_encodings..read_and_detect#sD )T "affhG#DJ 2 27 ;<<# "s A  A)rz-Timeout reached while detecting encoding for c3*K|] }|ddu yw)r Nr).0r s r z(detect_file_encodings..1s B H8J 4 ' szCould not detect encoding for r r) r$rrr concurrentfuturesThreadPoolExecutorsubmitresult TimeoutErrorall RuntimeErrorr )rrr%executorfuture encodingsencr$s @rdetect_file_encodingsr5sII=3=4:=    . . 0H)<  g 6I 1 B BB;I;GHH+4 T9CJ8SL 3 9 TT!!.. ? {K   1 0 Us*C%B6 C1& C16,C""C%%C.))rconcurrent.futuresr)pathlibrtypingrrrrrr rintr5rrrr;sT::$:$12 US$Y U*- U , Ur