dhSSKrSSKJrJrJrJrJrJr SSKJ r SSK J r J r \R"\5r"SS\ 5rg)N)AnyCallableDictIteratorListOptional)Document) BaseModelmodel_validatorc\rSrSr%SrSr\\S'Sr\\S'Sr \ \S'S r \ \ \/\4\S '\\S '\"S S 9\S\S\4Sj55rS\\4SjrS\\4SjrSrg )TensorflowDatasets aAccess to the TensorFlow Datasets. The Current implementation can work only with datasets that fit in a memory. `TensorFlow Datasets` is a collection of datasets ready to use, with TensorFlow or other Python ML frameworks, such as Jax. All datasets are exposed as `tf.data.Datasets`. To get started see the Guide: https://www.tensorflow.org/datasets/overview and the list of datasets: https://www.tensorflow.org/datasets/catalog/ overview#all_datasets You have to provide the sample_to_document_function: a function that a sample from the dataset-specific format to the Document. Attributes: dataset_name: the name of the dataset to load split_name: the name of the split to load. Defaults to "train". load_max_docs: a limit to the number of loaded documents. Defaults to 100. sample_to_document_function: a function that converts a dataset sample to a Document Example: .. code-block:: python from langchain_community.utilities import TensorflowDatasets def mlqaen_example_to_document(example: dict) -> Document: return Document( page_content=decode_to_str(example["context"]), metadata={ "id": decode_to_str(example["id"]), "title": decode_to_str(example["title"]), "question": decode_to_str(example["question"]), "answer": decode_to_str(example["answers"]["text"][0]), }, ) tsds_client = TensorflowDatasets( dataset_name="mlqa/en", split_name="train", load_max_docs=MAX_DOCS, sample_to_document_function=mlqaen_example_to_document, ) dataset_nametrain split_named load_max_docsNsample_to_document_functiondatasetbefore)modevaluesreturncSSKnSSKnUSc [S5eUR USUSS 9US 'U$![a [S5ef=f![a [S5ef=f) z7Validate that the python package exists in environment.rNz\Could not import tensorflow python package. Please install it with `pip install tensorflow`.znCould not import tensorflow_datasets python package. Please install it with `pip install tensorflow-datasets`.rzmsample_to_document_function is None. Please provide a function that converts a dataset sample to a Document.rr)splitr) tensorflow ImportErrortensorflow_datasets ValueErrorload)clsrrrs i/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/utilities/tensorflow_datasets.pyvalidate_environment'TensorflowDatasets.validate_environment?s     & / 0 8   044 > "&*>5 y - C   L  s7AA A&cb^U4SjTRRTR55$)zIDownload a selected dataset lazily. Returns: an iterator of Documents. c3b># UH%nTRcMTRU5v M' g7f)N)r).0sselfs r# /TensorflowDatasets.lazy_load..cs1 :// 0D , ,Q / /:s//)rtakerr*s`r# lazy_loadTensorflowDatasets.lazy_load]s*  \\&&t'9'9:  c4[UR55$)z=Download a selected dataset. Returns: a list of Documents. )listr/r.s r#r!TensorflowDatasets.loadis DNN$%%r1)__name__ __module__ __qualname____firstlineno____doc__rstr__annotations__rrintrrrrr rr classmethodr$rr/rr!__static_attributes__r5r1r#r r s,\L#JM3HL(D683C*D!EL L(#$3$8  8H-  &d8n&r1r )loggingtypingrrrrrrlangchain_core.documentsr pydanticr r getLoggerr6loggerr r5r1r#rFs2@@-/   8 $e&e&r1