}tjUdZddlZddlZddlZddlZddlmZddlmZddl m Z ej e Z dZiZeedfed<ejZed Gd d Zd eeefdefdZdededefdZdedefdZdededeeefdzfdZdedeeefdzfdZdeded eeefddfdZdS)a5On-disk cache for repository tree listings. A tree listing is the set of files (with their download metadata) contained in a repo at a given commit. Because a commit hash is immutable, its tree listing never changes and can be cached forever without any invalidation logic. The listing is stored as a human-readable JSON file under `/trees/.json`. The folder depends on the download target: the per-repo `storage_folder` for `cache_dir` downloads, or `local_dir/.cache/huggingface/` for `local_dir` downloads (see `tree_cache_folder_for_local_dir`). ```json { "format_version": 1, "files": { "config.json": {"size": 519, "blob_id": ""}, "model.safetensors": {"size": 1234, "blob_id": "...", "lfs_sha256": "", "lfs_size": 1234, "xet_hash": "..."} } } ``` N) dataclass)logging)is_valid_xet_hashzdict[str, TreeCacheEntry]_IN_MEMORY_TREE_CACHET)frozenceZdZUdZeed<eed<dZedzed<dZedzed<dZ edzed<de fd Z e d e ddfd Z dS) TreeCacheEntryz^Raw metadata of a single file in a cached tree listing, mirroring the `/tree` endpoint fields.sizeblob_idN lfs_sha256lfs_sizexet_hashreturnc||j|jd}|j|j|d<|j|d<|j |j|d<|S)N)r r r rrr r r rr)selfinfos Y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/huggingface_hub/_tree_cache.pyto_jsonzTreeCacheEntry.to_json?sL"iDLAA ? &!%D #}D  = $#}D  rc ||d|d|d|d|dS)Nr r r rrr)get)clsrs r from_jsonzTreeCacheEntry.from_jsonHsVsfOxx --XXj))XXj))     r)__name__ __module__ __qualname____doc__int__annotations__strr rrdictr classmethodrrrr r 5shh III LLL!Jd !!!HcDjHcDj T &6   [   rr entriesrcXtd|DS)zz(is_valid_tree_entries..Us9iiuu~%J):5>)J)Jiiiiiir)allvalues)r&s ris_valid_tree_entriesr.Ss, iiX_XfXfXhXhiii i iirtree_cache_folder commit_hashcJtj|d|dS)Ntreesz.jsonospathjoin)r/r0s r_tree_cache_pathr7Xs$ 7<<)7{4I4I4I J JJr local_dircDtj|ddS)zGFolder under which the `trees/` cache lives for a `local_dir` download.z.cache huggingfacer3)r8s rtree_cache_folder_for_local_dirr;\s 7<< 8] ; ;;rcft||}t5|tvr,t|}t|r|ndcdddS dddn #1swxYwYt |}|t|sdSt5|t|<dddn #1swxYwY|S)zbReturn the cached tree listing for a commit hash, or `None` if not cached, invalid, or unreadable.N)r7_IN_MEMORY_TREE_CACHE_LOCKrr._read_tree_cache_from_disk)r/r0r5cached_entriesr&s rread_tree_cacher@asm -{ ; ;D #UU ( ( (248N%:>%J%JT>>PTUUUUUUUU (UUUUUUUUUUUUUUU)..G3G<<t #..&-d#............... Ns#)AA"A B&&B*-B*r5c t|d5}tj|}dddn #1swxYwY|dtkrdSd|dDS#t $rYdSttttf$r+}t d|d|Yd}~dSd}~wwxYw)Nutf-8encodingformat_versioncJi|] \}}|t|!Sr%)r r)r) file_pathrs r z._read_tree_cache_from_disk..ws,gggoi >33D99gggrfilesz#Ignoring corrupted tree cache file : ) openjsonloadrTREE_CACHE_FORMAT_VERSIONitemsFileNotFoundErrorOSError ValueErrorKeyError TypeErrorloggerwarning)r5fdataes rr>r>ps/  $ ) ) ) Q9Q<B4 B8B8!B#B CC, CCctsdSt||}tfdtDd} t jtj|dtj tj|d\}}t j |dd 5}tj ||d dddn #1swxYwYt j ||n8#t$r+}td |d|Yd}~dSd}~wwxYwt"5t%t&|<ddddS#1swxYwYdS)zTWrite a valid tree listing to the cache (ignoring invalid entries and any failures).NcFi|]}||Sr%)r)r)rGr&s rrHz$write_tree_cache..s,[[[i)WY/7799[[[r)rErIT)exist_okz.tmp)dirsuffixwrBrCr)indentz,Ignored error while writing tree cache file rJ)r.r7rNsortedr4makedirsr5dirnametempfilemkstempfdopenrLdumpreplacerQrUrVr=r#r) r/r0r&r5rXtmp_fdtmp_pathrWrYs ` rwrite_tree_cacherks  ) ) -{ ; ;D3[[[[6RY??[[[  D BGOOD))D9999#+0E0EfUUU YvsW 5 5 5 ) IdAa ( ( ( ( ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) 8T"""" QdQQaQQRRR $44&*7mmd#444444444444444444sOBD C+ D +C//D 2C/3D E D<<E E00E47E4)rrLr4rd threading dataclassesrutilsr utils._xetr get_loggerrrUrNrr#r"r!Lockr=r boolr.r7r;r@r>rkr%rrrss3( !!!!!!))))))  H % %ACtC!<<=BBB+Y^-- $        :j4^(;#<jjjjj KK#K#KKKKFYAZ]aAa     S T#~2E-F-M    44#4SR`M`Ha4fj444444r