ChHDSSKJr SSKrSSKrSSKJr SSKJrJrJ r SSK J r J r SSKJ r SSKrSSKJrJrJrJrJrJr SSKJr SS KJr SS KJr \R<"\5r \(a\"5(aSS K!J"r" SS jr#"S S\5r$g!\a SSKJ r Npf=f)) annotationsN)Path) TYPE_CHECKINGAnyCallable)load_onnx_modelload_openvino_model)Self) AutoConfig AutoModel AutoTokenizer MT5ConfigPretrainedConfigT5Config)is_peft_available)find_adapter_config_file) InputModule PeftConfigc^^SUU4SjjnU$)Ncp>[R"[U5T- SS9 T"[U5T- 40UD6$)NT)exist_ok)osmakedirsr)save_directorykwargs_save_pretrained_fn subfolders `/var/www/html/shao/venv/lib/python3.13/site-packages/sentence_transformers/models/Transformer.pywrapper)_save_pretrained_wrapper..wrappers5 D(94tD"4#7)#CNvNN)rz str | PathreturnNone)rrr s`` r_save_pretrained_wrapperr&sOO Nr"c0^\rSrSr%SrSrS\S'SS/rS\S 'S rS \S 'SSU4S jjjr SSjr SSjr SSjr SSjr S SjrS!SjrS"SjrS#S$SjjrS#S%Sjjr\S&S'Sjj5r\S&S(Sjj5r\S)S*U4Sjjj5rSrU=r$)+ Transformer$aHugging Face AutoModel to generate token embeddings. Loads the correct class, e.g. BERT / RoBERTa etc. Args: model_name_or_path: Hugging Face models name (https://huggingface.co/models) max_seq_length: Truncate any inputs longer than max_seq_length model_args: Keyword arguments passed to the Hugging Face Transformers model tokenizer_args: Keyword arguments passed to the Hugging Face Transformers tokenizer config_args: Keyword arguments passed to the Hugging Face Transformers config cache_dir: Cache dir for Hugging Face Transformers to store/load models do_lower_case: If true, lowercases the input (independent if the model is cased or not) tokenizer_name_or_path: Name or path of the tokenizer. When None, then model_name_or_path is used backend: Backend used for model inference. Can be `torch`, `onnx`, or `openvino`. Default is `torch`. sentence_bert_config.jsonstrconfig_file_namemax_seq_length do_lower_casez list[str] config_keysTbool save_in_rootc >[T U]5 XplXlUc0nUc0nUc0nUR XX5upUR "XXiU 40UD6 Ub SU;aX$S'[ R"UbUOU4SU0UD6UlUc[URS5(a~[URRS5(aY[URS5(a>[URRRURR5nX lUb:URR R"URRlgg)Nmodel_max_length cache_dirconfigmax_position_embeddings)super__init__r.backend _load_config _load_modelr from_pretrained tokenizerhasattr auto_modelr5minr6r3r- __class____name__tokenizer_class) selfmodel_name_or_pathr- model_argstokenizer_args config_argsr4r.tokenizer_name_or_pathr9r5 is_peft_modelrAs rr8Transformer.__init__@sR *  J  !N  K $ 1 12DQX f +YeZde  %*??!$T__%;%;%S%SUYUcUcUtUt!u, ! -59^^5M5M5V5VDOO " " 2 .r"c J[UUURS5URS5URSS5S9bJ[5(d [S5eUS:wa [ S5eS S KJn UR"U40UDS U0D6S 4$[R"U40UDS U0D6S4$) ahLoads the transformers or PEFT configuration Args: model_name_or_path (str): The model name on Hugging Face (e.g. 'sentence-transformers/all-MiniLM-L6-v2') or the path to a local model directory. cache_dir (str | None): The cache directory to store the model configuration. backend (str): The backend used for model inference. Can be `torch`, `onnx`, or `openvino`. config_args (dict[str, Any]): Keyword arguments passed to the Hugging Face Transformers config. Returns: tuple[PretrainedConfig, bool]: The model configuration and a boolean indicating whether the model is a PEFT model. tokenrevisionlocal_files_onlyF)r4rMrNrOzgLoading a PEFT model requires installing the `peft` package. You can install it via `pip install peft`.torchaPEFT models can currently only be loaded with the `torch` backend. To use other backends, load the model with `backend="torch"`, call `model.transformers_model.merge_and_unload()`, save that model with `model.save_pretrained()` and then load the model with the desired backend.rrr4T) rgetr Exception ValueErrorpeftrr<r )rDrEr4r9rHrs rr:Transformer._load_configos %"#!oog.$4!,1CU!K   %&&}'! w (--.@eKe[degkk k))*<a aW`achhhr"c US:XaU(aSHnURUS5 M [U[5(aUR"XU40UD6 g[U[5(aUR "XU40UD6 g[ R"U4X#S.UD6UlgUS:Xa[S UUSS.UD6UlgUS:Xa[S UUSS.UD6Ulg[S US 35e) aLoads the transformers or PEFT model into the `auto_model` attribute Args: model_name_or_path (str): The model name on Hugging Face (e.g. 'sentence-transformers/all-MiniLM-L6-v2') or the path to a local model directory. config ("PeftConfig" | PretrainedConfig): The model configuration. cache_dir (str | None): The cache directory to store the model configuration. backend (str): The backend used for model inference. Can be `torch`, `onnx`, or `openvino`. is_peft_model (bool): Whether the model is a PEFT model. model_args (dict[str, Any]): Keyword arguments passed to the Hugging Face Transformers model. rP)rNNr5r4onnxzfeature-extraction)rEr5 task_nameopenvinozUnsupported backend 'z6'. `backend` should be `torch`, `onnx`, or `openvino`.r%) pop isinstancer_load_t5_modelr_load_mt5_modelr r<r?rr rS)rDrEr5r4r9rJrFadapter_only_kwargs rr;Transformer._load_models ( g *6&NN#5t<+7&(++##$6 XZXFI..$$%7YjY"+";";&#/5#NX# -#5. DO  "1#5. DO4WI=stu ur"c TSSKJn S/UlUR"U4X#S.UD6Ulg)Loads the encoder model from T5r)T5EncoderModel decoder.*rWN) transformersrc"_keys_to_ignore_on_load_unexpectedr<r?)rDrEr5r4rFrcs rr]Transformer._load_t5_models4/=HM9(88  '- FP r"c TSSKJn S/UlUR"U4X#S.UD6Ulg)rbr)MT5EncoderModelrdrWN)rerirfr<r?)rDrEr5r4rFris rr^Transformer._load_mt5_models40>I]:)99  '- FP r"cvS[UR5URRRS9S3$)Nz Transformer() architecture))dictget_config_dictr?rArBrDs r__repr__Transformer.__repr__s3d4#7#7#9HaHaHjHjkllmnnr"c UR5VVs0sHup4US;dM X4_M nnnUR"S 0UDUDSS0D6nUSnXqS'[5(aSSKJn [ URU5(aURR R(alURS5n USn [R"XRR RU RS9n [R"X4S S 9US'URRR(aS U;aUS US 'U$s snnf)z#Returns token_embeddings, cls_token) input_idsattention_masktoken_type_ids inputs_embeds return_dictTrtoken_embeddings)PeftModelForFeatureExtractionru)device)dim hidden_statesall_layer_embeddingsr%)itemsr?rrTrzr\active_peft_configis_prompt_learningsizerPonesnum_virtual_tokensr{catr5output_hidden_states) rDfeaturesrkeyvaluetrans_featuresoutputsryrz batch_sizeruprefix_attention_masks rforwardTransformer.forwards6'nn. . XX CJ.  //ONOfO$O"1:'7#$    :4??,IJJOO66II-2215 !)*:!;(-  B B U U^l^s^s)%.3YY8M7^de-f)* ?? ! ! 6 6?g;U/6/GH+ ,; s EEcBURRR$)N)r?r5 hidden_sizerps rget_word_embedding_dimension(Transformer.get_word_embedding_dimensions%%111r"c 0n[US[5(aU/nO[US[5(a]/n/US'UHLn[[ UR 555upgUR U5 USR U5 MN U/nO7//pUH+n UR U S5 U R U S5 M- X/nUV V s/sH+oV s/sHn [U 5R5PM sn PM- nn n UR(a/UV V s/sH!oV s/sHoR5PM sn PM# nn n URUR"UUSSURS.65 U$s sn fs sn n fs sn fs sn n f)z-Tokenizes a text and maps tokens to token-idsr text_keysr| longest_firstpt)padding truncationreturn_tensors max_length) r\r+rnnextiterrappendstripr.lowerupdater=r-) rDtextsroutput to_tokenizelookuptext_keytextbatch1batch2 text_tuplecolss rtokenizeTransformer.tokenizesn eAh $ $ 'K a$ ' 'K"$F; !%d6<<>&:!;""4({#**84 '-KF#  jm, jm,$"*KALL 41A 4 L   ?JK{s3s!GGIs3{KK NN*#..    5L4Ks0E9"E4 :E9F"E? :F4E9?Fc URRXS9 URRU5 URU5 g)N)safe_serialization)r?save_pretrainedr= save_config)rD output_pathrrs rsaveTransformer.save.s7 '' '[ &&{3 %r"c  HURUUUUUUUUU U U S9 n U"SSU0U D6$)N) rErrM cache_folderrNrOtrust_remote_code model_kwargstokenizer_kwargs config_kwargsr9rEr%)_load_init_kwargs)clsrErrMrrNrOrrrrr9r init_kwargss rloadTransformer.load3sP$++1%-/%-',  H&8HKHHr"c URUUUUUUS9n UUUUUS.nSU ;a0U S'SU ;a0U S'SU ;a0U S'U SRU5 U SRU5 U SRU5 U(aU SRU5 U (aU SRU 5 U (aU SRU 5 0U EXKS.E$)N)rErrMrrNrO)rrMrNrOrrFrGrH)r4r9) load_configr)rrErrMrrNrOrrrrr9rr5 hub_kwargss rrTransformer._load_init_kwargsTs $1%- ! # 0!2   v %#%F< 6 )')F# $  &$&F= ! |##J/ '' 3}$$Z0  < ' ' 5  # $ + +,< =  = ! ( ( 7H&H|HHr"c @>U(aU/O/SQnUHn[T U]UUUUUUUS9n U (dM O SW ;aSU S;aU SRS5 SU ;aSU S;aU SRS5 SU ;aSU S;aU SRS5 U $)N)r*zsentence_roberta_config.jsonzsentence_distilbert_config.jsonzsentence_camembert_config.jsonzsentence_albert_config.jsonz sentence_xlm-roberta_config.jsonzsentence_xlnet_config.json)rErconfig_filenamerMrrNrOrFrrGrH)r7rr[) rrErrrMrrNrOconfig_filenamesr5rAs rrTransformer.load_configs   0OW(#5# /)!!1)Fv 0 6 !&9VL=Q&Q < $ $%8 9 v %*=HXAY*Y # $ ( ()< = F "':f]>S'S = ! % %&9 : r")r?r9r.r-r=)NNNNNFNrP)rEr+r-z int | NonerFdict[str, Any] | NonerGrrHrr4 str | Noner.r0rIrr9r+r#r$) rEr+r4rr9r+rHdict[str, Any]r#z*tuple[PeftConfig | PretrainedConfig, bool]) rEr+r5zPeftConfig | PretrainedConfigr4r+r9r+rJr0r#r$)rEr+r5rr4r+r#r$)r#r+)rdict[str, torch.Tensor]r#r)r#int)T)rz.list[str] | list[dict] | list[tuple[str, str]]rz str | boolr#r)rr+rr0r#r$) NNNFFNNNrP)rEr+rr+rMbool | str | NonerrrNrrOr0rr0rrrrrrr9r+r#r )rEr+rr+rMrrrrNrrOr0rr0rrrrrrr9r+r#r)rNNNNF)rEr+rr+rrrMrrrrNrrOr0r#r)rB __module__ __qualname____firstlineno____doc__r,__annotations__r/r1r8r:r;r]r^rqrrrr classmethodrrr__static_attributes__ __classcell__)rAs@rr(r($si.8c7.@K@L$ &*,004-1 $#-1-W-W#-W* -W . -W + -W-W-W!+-W-W -W-W^(i"%(i2<(iGJ(iYg(i 3(iT2v2v.2v 2v  2v  2v 2vh  oB2\`&C&NX& &P&  #'#'#!&"'.226/3II I ! I ! III I,I0I-II !II@ #'#'#!&"'.226/37I7I 7I ! 7I ! 7I7I7I 7I,7I07I-7I7I !7I7Ir&*#'#'#!&+++$ + ! + ! +++ ++r"r()rrrr+r#zCallable[..., None])% __future__rloggingrpathlibrtypingrrrsentence_transformers.backendrr r ImportErrortyping_extensionsrPrer r r rrrtransformers.utils.import_utilsrtransformers.utils.peft_utilsr(sentence_transformers.models.InputModuler getLoggerrBloggerrTrr&r(r%r"rrs|" //N' dd=B@   8 $&((V+V1'&'sB BB