tj ddlmZmZmZmZddlmZddlmZddl m Z m Z ddl m Z eddd Gd d e e Zd S) )AnyCallableDictList) deprecated)Document) BaseModelmodel_validator) BaseLoaderz0.3.18zThis class is deprecated and will be removed in a future version. You can swap to using the `ApifyDatasetLoader` implementation in `langchain_apify` package. See z"langchain_apify.ApifyDatasetLoader)sincemessagealternative_importceZdZUdZeed< eed< eege fed< dedeege fffd Z e de ded efd Z d ee fd ZxZS) ApifyDatasetLoaderaLoad datasets from `Apify` web scraping, crawling, and data extraction platform. For details, see https://docs.apify.com/platform/integrations/langchain Example: .. code-block:: python from langchain_community.document_loaders import ApifyDatasetLoader from langchain_core.documents import Document loader = ApifyDatasetLoader( dataset_id="YOUR-DATASET-ID", dataset_mapping_function=lambda dataset_item: Document( page_content=dataset_item["text"], metadata={"source": dataset_item["url"]} ), ) documents = loader.load() apify_client dataset_iddataset_mapping_functioncNt||dS)arInitialize the loader with an Apify dataset ID and a mapping function. Args: dataset_id (str): The ID of the dataset on the Apify platform. dataset_mapping_function (Callable): A function that takes a single dictionary (an Apify dataset item) and converts it to an instance of the Document class. )rrN)super__init__)selfrr __class__s p/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_community/document_loaders/apify_dataset.pyrzApifyDatasetLoader.__init__0s6 !JJJ| K$\2226JJ222%+F> " "   E    s AAAc|j|jdj}t t |j|S)zLoad documents.T)clean)rdatasetr list_itemsitemslistmapr)r dataset_itemss rloadzApifyDatasetLoader.loadXsP   % %do 6 6 A A A M M S C5}EEFFFr)__name__ __module__ __qualname____doc__r__annotations__strrrrrr classmethodr(rr1 __classcell__)rs@rrr s &TOOO6&vx'78888>    9A4&(BR9S       _(###$3[$#.Gd8nGGGGGGGGrrN)typingrrrrlangchain_core._apirlangchain_core.documentsrpydanticr r )langchain_community.document_loaders.baser rrrr@s,,,,,,,,,,,,******------////////@@@@@@   9 <   IGIGIGIGIGYIGIG  IGIGIGr