dhj"rSSKrSSKJr SSKJr SSKJrJrJrJ r J r J r SSK J r SSKJr "SS\5rg) N)PathLike)Path)AnyCallableDictIteratorOptionalUnion)Document) BaseLoaderc\rSrSrSrSS\\\4S\S\\S\\ S\\ \ \ /\ 4S \ S \ 4S jjr S \ \4S jrS\S\S \ \4SjrS\S \4SjrS\ \\4S\S \ \\44SjrS\S S4SjrSrg) JSONLoader a Load a `JSON` file using a `jq` schema. Setup: .. code-block:: bash pip install -U jq Instantiate: .. code-block:: python from langchain_community.document_loaders import JSONLoader import json from pathlib import Path file_path='./sample_quiz.json' data = json.loads(Path(file_path).read_text()) loader = JSONLoader( file_path=file_path, jq_schema='.quiz', text_content=False) Load: .. code-block:: python docs = loader.load() print(docs[0].page_content[:100]) print(docs[0].metadata) .. code-block:: python {"sport": {"q1": {"question": "Which one is correct team name in NBA?", "options": ["New York Bulls" {'source': '/sample_quiz .json', 'seq_num': 1} Async load: .. code-block:: python docs = await loader.aload() print(docs[0].page_content[:100]) print(docs[0].metadata) .. code-block:: python {"sport": {"q1": {"question": "Which one is correct team name in NBA?", "options": ["New York Bulls" {'source': '/sample_quizg .json', 'seq_num': 1} Lazy load: .. code-block:: python docs = [] docs_lazy = loader.lazy_load() # async variant: # docs_lazy = await loader.alazy_load() for doc in docs_lazy: docs.append(doc) print(docs[0].page_content[:100]) print(docs[0].metadata) .. code-block:: python {"sport": {"q1": {"question": "Which one is correct team name in NBA?", "options": ["New York Bulls" {'source': '/sample_quiz .json', 'seq_num': 1} N file_path jq_schema content_keyis_content_key_jq_parsable metadata_func text_content json_linescSSKnXl[U5R5UlUR U5UlX@lX0lXPl X`l Xpl g![a [S5ef=f)aInitialize the JSONLoader. Args: file_path (Union[str, PathLike]): The path to the JSON or JSON Lines file. jq_schema (str): The jq schema to use to extract the data or text from the JSON. content_key (str): The key to use to extract the content from the JSON if the jq_schema results to a list of objects (dict). If is_content_key_jq_parsable is True, this has to be a jq compatible schema. If is_content_key_jq_parsable is False, this should be a simple string key. is_content_key_jq_parsable (bool): A flag to determine if content_key is parsable by jq or not. If True, content_key is treated as a jq schema and compiled accordingly. If False or if content_key is None, content_key is used as a simple string. Default is False. metadata_func (Callable[Dict, Dict]): A function that takes in the JSON object extracted by the jq_schema and the default metadata and returns a dict of the updated metadata. text_content (bool): Boolean flag to indicate whether the content is in string format, default to True. json_lines (bool): Boolean flag to indicate whether the input is in JSON Lines format. rNz=jq package not found, please install it with `pip install jq`) jq ImportErrorrresolvercompile _jq_schema_is_content_key_jq_parsable _content_key_metadata_func _text_content _json_lines) selfrrrrrrrrs h/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/document_loaders/json_loader.py__init__JSONLoader.__init__TsuD  G i002**Y/+E('+)% O  s AA5returnc## SnUR(afURRSS9nUH=nUR5nU(dMUR X15H nUv US- nM M? SSS5 gUR URR SS9U5H nUv US- nM g!,(df  g=f7f)z-Load and return documents from the JSON file.rz utf-8-sig)encodingN)r!ropenstrip_parse read_text)r"indexflinedocs r# lazy_loadJSONLoader.lazy_loads   $$k$:aD::   ;:s#-CB6%B63AC6 CCcontentr.c#P# URR[R"U55nURbUR U5 [ X2S-5HCupEURUS9nURU[UR5US9n[XgS9v ME g7f)z#Convert given content to documents.Nr))sample)r6sourceseq_num) page_contentmetadata) rinputjsonloadsr_validate_content_key enumerate _get_text _get_metadatastrrr )r"r4r.datair6textr:s r#r,JSONLoader._parses$$TZZ%89    (  & &t ,"43IA>>>0D))c$..&91*H@ @ 4sB$B&r6c.URbeUR(aEURRUR5nUR U5R 5nOXRnOUnUR (a0[U[5(dUb[S[U5S35e[U[5(aU$[U[[45(aU(a[R"U5$S$Ub [U5$S$)zConvert sample to string formatz%Expected page_content is string, got z instead. Set `text_content=False` if the desired input for `page_content` is not a string)rrrrr;firstr isinstancerB ValueErrortypedictlistr<dumps)r"r6compiled_content_keyr4s r#r@JSONLoader._get_texts    (//'+wwt7H7H'I$.44V<BBD !2!23G   j#&>&>7CV7W G34  % %N $ . .*14::g& 9r 9#*#63w< >B >additional_fieldsc URb@URX5n[U[5(d[S[ U5S35eU$U$)z Return a metadata dictionary base on the existence of metadata_func :param sample: single data payload :param additional_fields: key-word arguments to be added as metadata values :return: zUExpected the metadata_func to return a dict but got ``)rrJrMrKrL)r"r6rSresults r#rAJSONLoader._get_metadatas\    *((CFfd++ ""&v,q2M$ $rRrCcUR5n[U[5(d[S[ U5S35eUR (d5UR UR5c[SURS35eUR (a]URRUR5RU5R5c[SURS35egg)zCheck if a content key is validztExpected the jq schema to result in a list of objects (dict), so sample must be a dict but got `rUNz_Expected the jq schema to result in a list of objects (dict) with the key `z ` which should be parsable by jq) rIrJrMrKrLrgetrrrr;rE)r"rCr6s r#r> JSONLoader._validate_content_keys&$''77;F|nAG  00 4,,-5##'#4#4"5Q8   , , 1 1288@EEGO##'#4#4"55UW P -rR)rrrr!rr rr)NFNTF)__name__ __module__ __qualname____firstlineno____doc__r rBrr boolrrr$rr r2intr,rr@rAr>__static_attributes__rRr#rr sFX&*5:@D! 1&h'1&1&c] 1& %-TN 1&  $t); <= 1&1&1&f8H-$AcA#A(82DA"???4%38n%;>% c3h%(#$rRr)r<osrpathlibrtypingrrrrr r langchain_core.documentsr )langchain_community.document_loaders.baser rrcrRr#ris( AA-@ffrR