dhM%SrSSKJr SSKrSSKrSSKJrJr SSKJ r SSK J r J r J r JrJrJrJrJr SSKJr SSKJr SS KJr SS KJr \ rS \S '\R:"\5rSS jr SSjr!"SS\\5r"\"SSSS9"SS\"55r#S S!Sjjr$\"SSSS9"SS\"55r%\"SSSS9"SS\"55r&\"SSSS9"SS\"55r'g)"z,Loader that uses unstructured to load files.) annotationsN)ABCabstractmethod)Path)IOAnyCallableIteratorListOptionalSequenceUnion) deprecated)Document) TypeAlias) BaseLoaderrElementcSSKJn [URS5Vs/sHn[ U5PM sn5nURS5Sn[URS5Vs/sHn[ U5PM sn5nXS:$s snfs snf)zfCheck if the installed `Unstructured` version exceeds the minimum version for the feature in question.r) __version__.-)unstructured.__version__rtuplesplitint) min_version__unstructured_version__xmin_version_tuple_unstructured_versionunstructured_version_tuples i/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/document_loaders/unstructured.py"satisfies_min_unstructured_versionr#sQ{/@/@/EF/E!s1v/EFG5::3?B!&.44S9:9AQ9:" & ::G ;s B&B cB[U5(d[SUS35eg)zSRaise an error if the `Unstructured` version does not exceed the specified minimum.zunstructured>=z is required in this loader.N)r# ValueErrormin_unstructured_versions r"validate_unstructured_versionr('s2 ..F G G566R S   Hc\rSrSrSrS S Sjjr\S Sj5r\SSj5rSSjr SSjr SS jr S r g)UnstructuredBaseLoader0z%Base Loader that uses `Unstructured`.Nc SSKn1SknX;a[SUSUS35e[S5(dS U;aUR S 5 UR X5 XlX0lU=(d /Ulg![a [S5ef=f) Initialize with file path.rNzQunstructured package not found, please install it with `pip install unstructured`>pagedsingleelementszGot z# for `mode`, but should be one of ``z0.5.4strategy) unstructured ImportErrorr%r#pop5_check_if_both_mode_and_chunking_strategy_are_by_pagemodeunstructured_kwargspost_processors)selfr8r:r9r4 _valid_modess r"__init__UnstructuredBaseLoader.__init__3s  7  #tf? ~QO 2'::00#'' 3 BB   #6 .4"1 -  s A66B cg)z Get elements.Nr;s r" _get_elements$UnstructuredBaseLoader._get_elementsVr)cg)z$Get file_path metadata if available.Nr@rAs r" _get_metadata$UnstructuredBaseLoader._get_metadataZrDr)c`UH'nURHnURU5 M M) U$zApply post processing functions to extracted unstructured elements. Post processing functions are str -> str callables passed in using the post_processors kwarg when the loader is instantiated. r:applyr;r1elementpost_processors r"_post_process_elements-UnstructuredBaseLoader._post_process_elements^1  G"&"6"6 n-#7 r)c## UR5nURU5 URS:XaUHnUR5n[ US5(a)UR UR R55 [ US5(aURUS'UR5RS5(a"UR5RS5US'[[U5US9v M gURS:Xa[RS5 0n0nUHnUR5n[ US5(a)UR UR R55 URSS 5nXd;a[U5S -XF'X5U'MzXF==[U5S -- ss'XVR U5 M UR5Hn[XGXWS9v M gURS :XaFUR5nS RUVs/sHn[U5PM sn5n [XS9v g[!S URS 35es snf7f)z Load file.r1metadatacategory element_id) page_contentrSr/z`mode='paged'` is deprecated in favor of the 'by_page' chunking strategy. Learn more about chunking here: https://docs.unstructured.io/open-source/core-functionality/chunking page_numberz r0zmode of z not supported.N)rBrOr8rFhasattrupdaterSto_dictrTgetrstrloggerwarningkeysjoinr%) r;r1rMrS text_dict meta_dictrWkeyeltexts r" lazy_load UnstructuredBaseLoader.lazy_loadis%%' ##H- 99 "#--/7J//OOG$4$4$<$<$>?7J//+2+;+;HZ(??$((66-4__->-B-B<-PH\*CL8LL$YY' ! NNX  )+I35I#--/7J//OOG$4$4$<$<$>?&ll=!< /-0\F-BI*-5k**c'lV.CC**11(;$"!~~'INY^TT( YY( "))+H;;(;(BB(;!5 # !5F33 1Df  .<   r)r+z0.2.8z1.0z)langchain_unstructured.UnstructuredLoader)sinceremovalalternative_importcV^\rSrSrSrSS.S U4SjjjrS SjrS SjrSrU=r $) UnstructuredFileLoaderaLoad files using `Unstructured`. The file loader uses the unstructured partition function and will automatically detect the file type. You can run the loader in different modes: "single", "elements", and "paged". The default "single" mode will return a single langchain Document object. If you use "elements" mode, the unstructured library will split the document into elements such as Title and NarrativeText and return those as individual langchain Document objects. In addition to these post-processing modes (which are specific to the LangChain Loaders), Unstructured has its own "chunking" parameters for post-processing elements into more useful chunks for uses cases such as Retrieval Augmented Generation (RAG). You can pass in additional unstructured kwargs to configure different unstructured settings. Examples -------- from langchain_community.document_loaders import UnstructuredFileLoader loader = UnstructuredFileLoader( "example.pdf", mode="elements", strategy="fast", ) docs = loader.load() References ---------- https://docs.unstructured.io/open-source/core-functionality/partitioning https://docs.unstructured.io/open-source/core-functionality/chunking r0r8c 6>Xl[TU]"SSU0UD6 gr.r8Nr@) file_pathsuperr=)r;rr8r9 __class__s r"r=UnstructuredFileLoader.__init__s # :d:&9:r)cSSKJn [UR[5(aZ/nURHFn[U[ 5(a [ U5nURU"SSU0URD65 MH U$[UR[ 5(a[ UR5UlU"SSUR0URD6$)Nr partitionfilenamer@) unstructured.partition.autor isinstancerlistrr]extendr9)r;rr1files r"rB$UnstructuredFileLoader._get_elementss9 dnnd + +&(HdD))t9D T4 T4;S;S TU'O$..$//!$T^^!4QdnnQ8P8PQ Qr)cSUR0$NsourcerrAs r"rF$UnstructuredFileLoader._get_metadata$..))r)r)rz'Union[str, List[str], Path, List[Path]]r8r]r9rrmrp) rtrurvrwrxr=rBrFry __classcell__rs@r"r~r~sD @ ;: ; ; # ; ; R**r)r~c J[U[5=n(aUVs/sHn[U5PM nn[U[5(dU(a1SSKJn U"SUUUUS.UD6n/n UHn U R U 5 M U $SSKJn U "SUb [U5OSUUUS.UD6$s snf)z8Retrieve a list of elements from the `Unstructured API`.r)partition_multiple_via_api) filenamesfilesapi_keyapi_url)partition_via_apiN)rrrrr@)rrr]r unstructured.partition.apirrr) rrrrr9is_listpathr _doc_elementsr1 _elementsrs r"get_elements_from_apirsY--w-+4594SY9 5$!!WI2   "  &I OOI &'@  '0'[SS9 XlX0l[R"S5=(d UUl[ TU]"SSU0UD6 g)r.z0.10.15r&UNSTRUCTURED_API_KEYr8Nr@)r(rrosgetenvrrr=)r;rr8rrr9rs r"r="UnstructuredAPIFileLoader.__init__7sC &yI"yy!78CG  :d:&9:r)cSUR0$rrrAs r"rF'UnstructuredAPIFileLoader._get_metadataIrr)cp[SURURURS.URD6$)N)rrrr@)rrrrr9rAs r"rB'UnstructuredAPIFileLoader._get_elementsLs9$ nnLLHH &&   r)c`UH'nURHnURU5 M M) U$rIrJrLs r"rO0UnstructuredAPIFileLoader._post_process_elementsTrQr))rrr) rzUnion[str, List[str]]r8r]rr]rr]r9rrprmrr) rtrurvrwrxr=rFrBrOryrrs@r"rrsb !NF ;(; ;  ;  ; #;;$*   r)rc`^\rSrSrSrSS.S U4SjjjrS SjrS SjrS SjrS r U=r $)UnstructuredFileIOLoaderi`aLoad file-like objects opened in read mode using `Unstructured`. The file loader uses the unstructured partition function and will automatically detect the file type. You can run the loader in different modes: "single", "elements", and "paged". The default "single" mode will return a single langchain Document object. If you use "elements" mode, the unstructured library will split the document into elements such as Title and NarrativeText and return those as individual langchain Document objects. In addition to these post-processing modes (which are specific to the LangChain Loaders), Unstructured has its own "chunking" parameters for post-processing elements into more useful chunks for uses cases such as Retrieval Augmented Generation (RAG). You can pass in additional unstructured kwargs to configure different unstructured settings. Examples -------- from langchain_community.document_loaders import UnstructuredFileIOLoader with open("example.pdf", "rb") as f: loader = UnstructuredFileIOLoader( f, mode="elements", strategy="fast", ) docs = loader.load() References ---------- https://docs.unstructured.io/open-source/core-functionality/partitioning https://docs.unstructured.io/open-source/core-functionality/chunking r0rc 6>Xl[TU]"SSU0UD6 gr)rrr=)r;rr8r9rs r"r=!UnstructuredFileIOLoader.__init__s   :d:&9:r)cJSSKJn U"SSUR0URD6$)Nrrrr@)rrrr9)r;rs r"rB&UnstructuredFileIOLoader._get_elementss"9DdiiD4+C+CDDr)c0$Nr@rAs r"rF&UnstructuredFileIOLoader._get_metadata r)c`UH'nURHnURU5 M M) U$rIrJrLs r"rO/UnstructuredFileIOLoader._post_process_elementsrQr))r)rz IO[bytes]r8r]r9rrmrprr rtrurvrwrxr=rBrFrOryrrs@r"rr`sI D ; ; ; # ; ;E   r)rcl^\rSrSrSrSSSS.S U4SjjjrS SjrSS jrSS jrS r U=r $)UnstructuredAPIFileIOLoaderiaySend file-like objects with `unstructured-client` sdk to the Unstructured API. By default, the loader makes a call to the hosted Unstructured API. If you are running the unstructured API locally, you can change the API rule by passing in the url parameter when you initialize the loader. The hosted Unstructured API requires an API key. See the links below to learn more about our API offerings and get an API key. You can run the loader in different modes: "single", "elements", and "paged". The default "single" mode will return a single langchain Document object. If you use "elements" mode, the unstructured library will split the document into elements such as Title and NarrativeText and return those as individual langchain Document objects. In addition to these post-processing modes (which are specific to the LangChain Loaders), Unstructured has its own "chunking" parameters for post-processing elements into more useful chunks for uses cases such as Retrieval Augmented Generation (RAG). You can pass in additional unstructured kwargs to configure different unstructured settings. Examples -------- from langchain_community.document_loaders import UnstructuredAPIFileLoader with open("example.pdf", "rb") as f: loader = UnstructuredAPIFileIOLoader( f, mode="elements", strategy="fast", api_key="MY_API_KEY", ) docs = loader.load() References ---------- https://docs.unstructured.io/api-reference/api-services/sdk https://docs.unstructured.io/api-reference/api-services/overview https://docs.unstructured.io/open-source/core-functionality/partitioning https://docs.unstructured.io/open-source/core-functionality/chunking r0rrrc >[U[5(a [SS9 [SS9 XlX0l[ R "S5=(d UUl[TU]$"SSU0UD6 g)r.z0.6.3r&z0.6.2rr8Nr@) rr r(rrrrrrr=)r;rr8rrr9rs r"r=$UnstructuredAPIFileIOLoader.__init__sX dH % % )7 K%wG yy!78CG  :d:&9:r)cURRS5(aQ[SURURR S5UR UR S.URD6$[S5e)Nmetadata_filename)rrrrzLIf partitioning a file via api, metadata_filename must be specified as well.r@)r9r\rrr6rrr%rAs r"rB)UnstructuredAPIFileIOLoader._get_elementss{  # # ' '(; < <(YY22667JK   **  @ r)c0$rr@rAs r"rF)UnstructuredAPIFileIOLoader._get_metadatarr)c`UH'nURHnURU5 M M) U$rIrJrLs r"rO2UnstructuredAPIFileIOLoader._post_process_elementsrQr))rrr) rz%Union[IO[bytes], Sequence[IO[bytes]]]r8r]rr]rr]r9rrmrprrrrs@r"rrsb "PF ;3; ;  ;  ; #;;*   r)r)rr]rnbool)r'r]rnrs)NNrr) rz-Union[str, List[str], Path, List[Path], None]rz+Union[IO[bytes], Sequence[IO[bytes]], None]rr]rr]r9rrnro)(rx __future__rloggingrabcrrpathlibrtypingrrr r r r r rlangchain_core._api.deprecationrlangchain_core.documentsrtyping_extensionsr)langchain_community.document_loaders.baserr__annotations__ getLogger__file__r^r#r(r+r~rrrrr@r)r"rs`2" #OOO6-'@   8 $;" vZvr  B 9*39*  9*z@D8<F ! <! 5! !  !  !  ! H  B J 6J  JZ  B ;5;  ;|  B U"8U  Ur)