tjPdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlmZddlmZddlmZddlmZmZddlmZdd lmZmZmZmZmZdd lm Z m!Z!ej"e#Z$d e%d e%fd Z&e j'Z(dZ)d e%ej*zd dfdZ+de%ej*zd e,e%fdZ-de%ej*zd e,e%fdZ.de%ej*zd e,e%fdZ/de%ej*zd e,e%fdZ0ddde%de%ej*zde1d e2fdZ3de%ej*zde%ej*zd e%fdZ4 d4de%ej*zde%de%ej*zdzd e1d!e5e%e%fdzd"e1e%zdzd#e%dzd$e1d%e%dzd&e%dzd e%fd'Z6 d4d(e%de%ej*zde%ej*zdzd e1d!e5e%e%fdzd"e1e%zdzd#e%dzd$e1d%e%dzd)e%dzd e2fd*Z7d5d+ed,e%ej*zd-e5dzd e,e%fd.Z8d/Z9d0Z: d6d1Z;d7d3Z>""   Hx H Hd H H H     " " $ $  Hx H Hd H H H    OcVttjvrdStjtt jtdt tdz }|s)|tj dSdS)z_ Creates the cache directory for modules with an init, and adds it to the Python path. NTexist_ok __init__.py) r syspathappendosmakedirsrexiststouch importlibinvalidate_caches) init_paths r!init_hf_modulesr2Us 38##HOO$%%%K 40000%&&6I     &#%%%%%&&r#c~ttt|z }|jst |jtj|d|dz }|s)| tj dSdS)z Creates a dynamic module in the cache directory for modules. Args: name (`str` or `os.PathLike`): The name of the dynamic module to create. Tr%r'N) r2rr resolveparentr-create_dynamic_moduler+r,r.r/r0)rdynamic_module_pathr1s r!r6r6es 011D8AACC  % , , . .:18999K#d3333#m3I     & #%%%%% &&r# module_filec>t|d5}|}dddn #1swxYwYtjd|tj}|tjd|tjz }t t |S)z Get the list of modules that are relatively imported in a module file. Args: module_file (`str` or `os.PathLike`): The module file to inspect. Returns: `list[str]`: The list of relative imports in the module. utf-8encodingNz^\s*import\s+\.(\S+)\s*$)flagsz^\s*from\s+\.(\S+)\s+import)openreadrefindall MULTILINElistset)r8fcontentrelative_importss r!get_relative_importsrH{s kG , , ,&&((z"=wbl[[[ #A7RTR^____ $%% & &&s 377c"d}|g}g|sg}|D]$}|t|%t|jfd|D}fd|D}t |dk}||S)a Get the list of all files that are needed for a given module. Note that this function recurses through the relative imports (if a imports b and b imports c, it will return module files for b and c). Args: module_file (`str` or `os.PathLike`): The module file to inspect. Returns: `list[str]`: The list of all relative imports a given module needs (recursively), which will give us the list of module files a given module needs. Fc:g|]}t|z dS).py)str).0m module_paths r! z-get_relative_import_files..s.NNNQs;?33888NNNr#cg|]}|v| SrR)rMrEall_relative_importss r!rPz-get_relative_import_files..s$WWWBV9V9V!9V9V9Vr#r)extendrHrr5len)r8 no_changefiles_to_check new_importsrEnew_import_filesrSrOs @@r!get_relative_import_filesrZsI!]N 4  8 8A   3A66 7 7 7 7;''. NNNN+NNNWWWW%5WWW''1, ##N333 4 r#filenamect|d5}|}dddn #1swxYwYtddlfdt j|}|t S)a Extracts all the libraries (not relative imports this time) that are imported in a file. Args: filename (`str` or `os.PathLike`): The module file to inspect. Returns: `list[str]`: The list of all packages required to use the input module. r:r;Nrcbt|tjrdSt|tjr|j}tj|D]y}t|tjr]t|jdd}| dr| dst j j |rdSznt|tjrB|jD]9}|jdd}|r|:nct|tjrI|jdkr>|jr7|jdd}|r|tj|D] }|dS)Nid available is_flash_attnrr) isinstanceastTryIftestwalkCallgetattrfuncendswith startswithhasattrutils import_utilsImportnamesrsplitadd ImportFromlevelmoduleiter_child_nodes) noderfcondition_nodecheck_functionalias top_modulechildimported_modulesrecursive_look_for_imports transformerss r!rz/get_imports..recursive_look_for_importss dCG $ $ 5 F cf % % 59D"%(4..  nch77 %,^-@$%K%KN&// <<*55oFF#<#5#BNSS cj ) ) 5 5 5"Z--c2215 5$((444 5cn - - 5zQ4;![..s33A6 5$((444)$// . .E & &u - - - - . .r#)r>r?rDtransformers.utilsrcparsesorted)r[rErFtreer~rrs @@@r! get_importsrs h ) ) )Q&&((uu.......B 9W  Dt$$$ " # ##s 6::ct|}g}|D]v} tj|#t$rR}td|d|dt |vr||nYd}~od}~wwxYwt|dkrz&get_class_in_module..*s62c2cQR588allnn3L2c2c2c2c2c2cr#__transformers_module_hash__r_)r+r)normpath removesuffixrseprr _HF_REMOTE_CODE_LOCKr(modulespopr/r0getutilspec_from_file_locationrmaprZhashlibsha256r hexdigestmodule_from_specriloader exec_moduler) rrOrrr8 cached_module module_spec module_files module_hashrvs r!get_class_in_moduler s& 7  K ( (D   U # #D << S ) )D-..#((2c2cVb2c2c2c*c*cddnnpp   ^44[AAF &CK  "F 692 > >+ M M   * *6 2 2 22=F /vz**-++++++++++++++++++s8E$G))G-0G-pretrained_model_name_or_pathresolved_module_filecV t| t|}dtdtf fd }|||fg}t|D]1}t|}||||f2t j}t|dD]T\}}|| d|| U| ddS) zn Computes a stable hash from the bytes of the local source file and its relative-import source files. source_file_pathrc|j|jz } |S#t $r|cYSwxYwr)r5r4r relative_toas_posix ValueError)rcanonical_path model_paths r!_resolve_relative_source_pathzG_compute_local_source_files_hash.._resolve_relative_source_pathDsx)088::=M=RR -!--j99BBDD D - - -!**,, , , , -s&A A,+A,c|dS)NrrR)entrys r!z2_compute_local_source_files_hash..Ss ERSHr#)keyr:N) rr4rLrZr*rrrupdateencoderr) rrr files_to_hash source_filersource_files_hash relative_path file_pathrs @r! _compute_local_source_files_hashr:s_344<<>>J 455-------- ' &'; < <>RSM11EFFbb  ,,;;T>T$U$U$U99 y  !5!5g!>!>???  !5!5!7!78888  & & ( (" --r# cache_dirforce_downloadproxiestokenrevisionlocal_files_only repo_type _commit_hashc tr|stdd}t|}tj|} d} | s^tjjtt| d} t|||| |} g} t||||||||||  }| s| |kr||n0#t$r#td|d|d wxYwt!|}| rttjtj|}t'||}|r'tjj||g} n|} t(tjjz| z}t+|t-t.|z }| rM||z r%t3j|t||z sJ||z jdd t;j|||z t?j tC|D]} t-|"|}||z }n#tF$rY7wxYw|r"t3j|t|sD|jdd t;j||t?j ntI|| }||z }|tjjz|z}tj||}t+t-|j||z s+t;j|||z t?j |D]l}||z j|d z sHtK|t-|j|z d ||||||| ||d mtM|d krR|Pdd|D}|dn|d}d||}t'd|d|dtj||S)a Prepares Downloads a module from a local folder or a distant repo and returns its path inside the cached Transformers module. Args: pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. module_file (`str`): The name of the module file containing the class to look for. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `hf auth login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). Passing `token=True` is required when you want to use a private model. Returns: `str`: The path to the module inside the cache. z+Offline mode: forcing local_files_only=TrueTN/)rrr)rrrrrrrrzCould not locate the z inside r)parentsr&rK)rrrrrrrr cg|]}d|S)z- rRrs r!rPz*get_cached_module_file..s;;;AxAxx;;;r#r_zs/zhttps://huggingface.co/z9A new version of the following files was downloaded from z: z . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.)(rrinforLr+r)isdirrrrr"rrrr r*OSErrorrbasenamerrr r6rr r-filecmpcmpr5mkdirshutilcopyfiler/r0rZrrr get_cached_module_filerUr)rr8rrrrrrrrdeprecated_kwargsis_localr submodule new_filesrmodules_neededlocal_model_namelocal_source_files_hashfull_submodulesubmodule_pathr module_needed target_path commit_hashfull_submodule_module_file_path repo_type_strurls r!rrZst !1  ABBB%((E$F$F!w}}:;;HM  GK$$S)>@]@c@cdg@h@h%i%ijj . );)Vbnw   I* ) )-%  *M-AAA   [ ) ) )  aKaaA^aaabbb  ##788N001A1A"'BRBRSpBqBq1r1rss"BC`bv"w"w  0 ((*:[ \ \ ,}<     %%'' .w{;KHXHX/Y/Y ."(((EEE [999+--- .**> MM (+5'"'+5 C*,',,~{*S*S'd#BCCJKKK,4466 * O0.;2N O O O  ' ) ) )+ 8 8M#k19} Calling this function will execute the code in the module file found locally or downloaded from the Hub. It should therefore only be called on trusted repos. Args: class_reference (`str`): The full name of the class to load, including its module and optionally its repo. pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. This is used when `class_reference` does not specify another repo. module_file (`str`): The name of the module file containing the class to look for. class_name (`str`): The name of the class to import in the module. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or `bool`, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `hf auth login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). code_revision (`str`, *optional*, defaults to `"main"`): The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. Passing `token=True` is required when you want to use a private model. Returns: `typing.Type`: The class, dynamically imported from the module. Examples: ```python # Download module `modeling.py` from huggingface.co and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("modeling.MyBertModel", "sgugger/my-bert-model") # Download module `modeling.py` from a given repo and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("sgugger/my-bert-model--modeling.MyBertModel", "sgugger/another-bert-model") ```z--rNrK)rrrrrrrr)rrrr)rrrrrrrrrrkwargsrepo_idr8r final_modules r!get_class_from_dynamic_modulersn #2#8#8#>#> /-33C88K!>'!I!I )e%)   L zt d}|j}|dd}|d|j}n|d jj}||f}t |tr'|di} || j <| |d<dSt |dd||j j <dS j |i|_ dS)Nr TokenizerFastslow_tokenizer_classauto_map) __class__ __module__rr__name__rkrirbdictr _auto_classr) _config module_name last_module full_namerfast_tokenizer_classslow_tokenizerslow_tok_module_namelast_slow_tok_modulerrs r!_set_auto_map_in_configz3custom_object_save.._set_auto_map_in_configsm. !'',,R0 "==S]%;== ) # ##' #' }%..v66 Q*5'P'P 8N'P'P$3 6==I%,S2H%I%IN+9+D(+?+E+Ec+J+J2+N(.B+^+^^E\+^+^(+6'P'P 8N'P'P$-/CDI gt $ $ <{{:r22H(1HS_ %"*GJ    Wj$ / / ;09G S_ - - - #;G   r#)rrrrbrCtupler(r__file__rrrrr*rZ) rrrrcfgresult object_file dest_file needed_files ` r!custom_object_saverrsw ~## s        <<<<<@&4-((( ) )C # #C ( ( ( ( )  ''' F+cn-6KV [ 1 1 67I OK+++ MM)1==!! LLD$5$5$:;  Y/// i    Mr#c td)NzLoading this model requires you to execute custom code contained in the model repository on your local machine. Please set the option `trust_remote_code=True` to permit loading of this model.)r)signumframes r!_raise_timeout_errorrs  c  r#c|^| d|d|d|d}nOtj|r'd|dtj|d}n d|d|d}|[|rd}nU|r@td kr4d} t jt jt}t jt|Ht|d |d }| d vrd }n| dvrd}|Ht jd n##t$rt|d |dwxYw |3t jt j|t jd nM#|4t jt j|t jd wwxYw|rtdd|r|s|st|d |d|S)a Resolves the `trust_remote_code` argument. If there is remote code to be loaded, the user must opt-in to loading it. Args: trust_remote_code (`bool` or `None`): User-defined `trust_remote_code` value. model_name (`str`): The name of the model repository in huggingface.co. has_local_code (`bool`): Whether the model has local code. has_remote_code (`bool`): Whether the model has remote code. error_message (`str`, *optional*): Custom error message to display if there is remote code to load and the user didn't opt-in. If unset, the error message will be regarding loading a model with custom code. Returns: The resolved `trust_remote_code` value. NzThe repository z% references custom code contained in zm which must be executed to correctly load the model. You can inspect the repository content at https://hf.co/z . zt contains custom code which must be executed to correctly load the model. You can inspect the repository content at z contains custom code which must be executed to correctly load the model. You can inspect the repository content at https://hf.co/Frz9 You can inspect the repository content at https://hf.co/z. You can avoid this prompt in future by passing the argument `trust_remote_code=True`. Do you wish to run the custom code? [y/N] )yesy1T)non0r_zS. Please pass the argument `trust_remote_code=True` to allow custom code to be run.) r+r)rabspathTIME_OUT_REMOTE_CODEsignalSIGALRMralarminputlower Exceptionr)trust_remote_code model_namehas_local_codehas_remote_code error_message upstream_repoprev_sig_handleranswers r!resolve_trust_remote_coder4s.  $@*@@S`@@,9@@@ M W]]: & & @*@@ gooj99@@@ M=*==,6===    - %    -!5!9!9#  $#)=AU#V#V  1222'/"(FFcmFFFF ||~~):::,0))+???,1)(/ Q    $ii_iiii  $/M&.2BCCCLOOO$/M&.2BCCCLOOOO0 - t , , , ~ 6G  a aWa a a a   s readlinesstriprlrrr/metadatarPackageNotFoundErrorr*r from_stringvaluerrrr) r7requirements_filerfailed requirementsrE requirement package_name delimiterversion_numberlocal_package_version is_satisfieds r!check_python_requirementsrKsvF" "i?M^iibhii , $ $ );;==L ) ) ) ) ) ) ) ) ) ) ) ) ) ) )( U UK%++--K +"8"8"="=  7:OP[:\:\7 i 7 7 7* ,6) >>> 7 (1(:(B(B<(P(P%%%:    @@@AAA $)C0E?)NFNNNFNNrr:)r5)=__doc__rcrrr/importlib.metadataimportlib.utilrr+r@rr&r( threadingpathlibrtypesrtypingrhuggingface_hubrr packagingrrnr r r r rutils.import_utilsrr get_loggerrrrLr"Lockrr2PathLiker6rCrHrZrrbooltyperrrrrrrr%r4rKrRr#r!r[s:9  CCCCCCCCIHHHHHHH  H % %B&y~'' & & & &bk 1&d&&&&,'cBK&7'DI''''* 3+< c    @4$# +4$S 4$4$4$4$n *C"+- *$s) * * * *N -+-+-+-+r{"-+ -+  -+-+-+-+`.#&#4. +. ....F+/ %)#" #g5g5#&#4g5g5R[ 4'g5 g5 #s(^d " g5 #:  g5Djg5g5Tzg5*g5 g5g5g5g5Z+/ %)#" $kVkVkV#&#4kVR[ 4'kV kV #s(^d " kV #:  kVDjkVkVTzkV:kV kVkVkVkV\IICIr{):ID4KI[_`c[dIIIIXgkRRRRj5 5 5 5 5 5 r#