dh SSKJr SSKrSSKJr SSKJrJrJ r J r J r SSK J r SSKJr SSKJrJr SSKJr SS KJr \ \\4r\S r"S S \5rg) ) annotationsN)Path)IteratorLiteralOptionalSequenceUnion)Document)BaseBlobParser) BlobLoaderFileSystemBlobLoader) GenericLoader) get_parserdefaultc ^\rSrSrSrSSU4SjjjrSSjr\SSSS S SSS .SS jj5rS r U=r $)ConcurrentLoaderz%Load and pars Documents concurrently.c0>[TU]X5 X0lg)N)super__init__ num_workers)self blob_loader blob_parserr __class__s g/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/document_loaders/concurrent.pyrConcurrentLoader.__init__s 2&c## [RRURS9nURR 5Vs1sH)nUR URRU5iM+ nn[RRU5HnUR5ShvN M SSS5 gs snfN!,(df  g=f7f)z.Load documents lazily with concurrent parsing.) max_workersN) concurrentfuturesThreadPoolExecutorrr yield_blobssubmitr lazy_parse as_completedresult)rexecutorblobr#futures r lazy_loadConcurrentLoader.lazy_load"s   2 2((3 !,,88::D 0 0 ; ;TB: %,,99'B!==?**C   +  s:(CC/B?67C-C.C6 C?C CCz**/[!.]*NFr)globexcludesuffixes show_progressparserr parser_kwargsc[UUUUUS9n [U[5(aLUS:Xa:UR[R:waUR"S0U=(d 0D6n O[U5n OUn U"XUS9$)aCreate a concurrent generic document loader using a filesystem blob loader. Args: path: The path to the directory to load documents from. glob: The glob pattern to use to find documents. suffixes: The suffixes to use to filter documents. If None, all files matching the glob will be loaded. exclude: A list of patterns to exclude from the loader. show_progress: Whether to show a progress bar or not (requires tqdm). Proxies to the file system loader. parser: A blob parser which knows how to parse blobs into documents num_workers: Max number of concurrent workers to use. parser_kwargs: Keyword arguments to pass to the parser. )r0r1r2r3rrr/)r isinstancestrrr) clspathr0r1r2r3r4rr5rrs rfrom_filesystem ConcurrentLoader.from_filesystem0sw6+ '   fc " ""s~~9Q9Q'Q!nnE 0CE (0  K;EErr7)r)rr rr rintreturnNone)r?zIterator[Document])r; _PathLiker0r9r1z Sequence[str]r2zOptional[Sequence[str]]r3boolr4zUnion[DEFAULT, BaseBlobParser]rr>r5zOptional[dict]r?r) __name__ __module__ __qualname____firstlineno____doc__rr- classmethodr<__static_attributes__ __classcell__)rs@rrrs/  ''$' '  '' +  + !#,0#1:(,)F)F )F  )F * )F)F/)F)F&)F )F)Frr) __future__rconcurrent.futuresr"pathlibrtypingrrrrr langchain_core.documentsr )langchain_community.document_loaders.baser 1langchain_community.document_loaders.blob_loadersr r ,langchain_community.document_loaders.genericr5langchain_community.document_loaders.parsers.registryrr9rADEFAULTrr/rrrUsP"??-DGL #t)  ) DF}DFr