dhc8SSKrSSKrSSKJr SSKJrJrJrJrJ r J r J r SSK r SSK r SSKJrJr SSKJr SSKJrJr SSKJr SSKJrJrJr SS KJr SS KJr "S S \ 5r "S S\5r!g)N)ThreadPoolExecutor)AnyDictListMappingOptionalSequence TypedDict)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)BaseLLM) Generation LLMResultget_from_dict_or_env) ConfigDictFieldmodel_validator)Self)enforce_stop_tokensc$\rSrSr%Sr\\S'Srg) TrainResultz Train result.lossN)__name__ __module__ __qualname____firstlineno____doc__float__annotations____static_attributes__r\/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/gradient_ai.pyrrs  Kr$rc \rSrSr%Sr\"SSS9r\\S'Sr \ \\S'Sr \ \\S 'Sr \ \ \S 'S r\\S 'Sr\ \R"\S '\"SSS9r\"SS9\S\S\4Sj55r\"SS9S\4Sj5r\S\\\44Sj5r\S\4Sj5rS\\S\\\4S\\\44Sjr S\S\\\4S\\\44Sjr!S)S\S\ \"\S \ \#S\S\4 S!jjr$S)S\S\ \"\S \ \%S\S\4 S"jjr&S)S#\"\S\ \"\S \ \#S\S\'4 S$jjr(S)S#\"\S\ \"\S \ \%S\S\'4 S%jjr)S\\S\S\*4S&jr+S\\S\S\*4S'jr,S(r-g)* GradientLLMaKGradient.ai LLM Endpoints. GradientLLM is a class to interact with LLMs on gradient.ai To use, set the environment variable ``GRADIENT_ACCESS_TOKEN`` with your API token and ``GRADIENT_WORKSPACE_ID`` for your gradient workspace, or alternatively provide them as keywords to the constructor of this class. Example: .. code-block:: python from langchain_community.llms import GradientLLM GradientLLM( model="99148c6d-c2a0-4fbe-a4a7-e7c05bdb8a09_base_ml_model", model_kwargs={ "max_generated_token_count": 128, "temperature": 0.75, "top_p": 0.95, "top_k": 20, "stop": [], }, gradient_workspace_id="12345614fc0_workspace", gradient_access_token="gradientai-access_token", ) model)alias min_lengthmodel_idNgradient_workspace_idgradient_access_token model_kwargszhttps://api.gradient.ai/apigradient_api_url aiosessionTforbid)populate_by_nameextrabefore)modevaluesreturncf[USS5US'[USS5US'[USS5US'U$)z?Validate that api key and python package exists in environment.r/GRADIENT_ACCESS_TOKENr.GRADIENT_WORKSPACE_IDr1GRADIENT_API_URLr)clsr8s r%validate_environment GradientLLM.validate_environmentRsZ +? +-D+ &'+? +-D+ &'&: &(:& !" r$aftercSSKnUR b[ UR 5S:a [S5eURb[ UR 5S:a [S5eUR(aURnSURSS 5s=::aS ::d O [S 5eSURS S 5s=::aS ::d O [S 5eSURSS 5:a [S5eSURSS 5:a [S5eU$![a [R"S5 GN:[a GNFf=f)zPost init validation.rNzdDeprecationWarning: `GradientLLM` will use `pip install gradientai` in future releases of langchain. z0env variable `GRADIENT_ACCESS_TOKEN` must be setz0env variable `GRADIENT_WORKSPACE_ID` must be set temperatureg?z-`temperature` must be in the range [0.0, 1.0]top_pz'`top_p` must be in the range [0.0, 1.0]top_kz`top_k` must be positivemax_generated_token_countz,`max_generated_token_count` must be positive) gradientai ImportErrorloggingwarning Exceptionr/len ValueErrorr.r0get)selfrJkws r% post_initGradientLLM.post_initcs2    % % -T5O5O1PSU1UOP P  % % -T5O5O1PST1TOP P   ""B}c27a7 !PQQw,11 !JKKBFF7C(( !;<<BFF6:: !OPP ;  OOL    sD E  E  E cTUR=(d 0n0SUR0ESU0E$)zGet the identifying parameters.r1r0)r0r1)rR _model_kwargss r%_identifying_paramsGradientLLM._identifying_paramss>))/R  !4#8#89 }-  r$cg)zReturn type of llm.gradientr)rRs r% _llm_typeGradientLLM._llm_typesr$inputskwargsc JUR=(d 0n0UEUEnURSS5n[URSURS3SUR 3UR SSS.[Uc[SU55O[S [X555S 9S 9$) Build the kwargs for the Post request, used by sync Args: prompt (str): prompt used in query kwargs (dict): model kwargs in payload Returns: Dict[str, Union[str,dict]]: _description_ multipliersN/models/z /fine-tuneBearer application/json authorizationzx-gradient-workspace-idacceptz content-typec3(# UH nSU0v M g7f)r^Nr).0inputs r% =GradientLLM._kwargs_post_fine_tune_request..s"&,E%e&,sc32# UHupUSU0S.v M g7f) multiplier)r^fineTuningParametersNr)rjrkros r%rlrms/2J-E ', ,j5 2Js)samplesurlheadersjson) r0rQdictr1r-r/r.tuplezip)rRr^r_rW_paramsrbs r%_kwargs_post_fine_tune_request*GradientLLM._kwargs_post_fine_tune_requests))/R -]-f-kk-6 (()$-- K#*4+E+E*F!G.2.H.H-I, 2  #* &, 25V1I  r$promptcRUR=(d 0n0UEUEn[URSURS3SUR3UR SSS.[UUR SS5UR SS5UR S S5UR S S5S 9S 9$) rarcz /completerdrerfrINrErHrG)querymaxGeneratedTokenCountrEtopKtopPrr)r0rvr1r-r/r.rQ)rRr|r_rWrys r%_kwargs_post_request GradientLLM._kwargs_post_requests))/R -]-f-(()$-- J#*4+E+E*F!G.2.H.H-I, 2  '.{{3NPT'U#KK t<[[$/[[$/   r$stop run_managerc h[R"S0URX5D6nURS:wa%[ SURSUR 35eUR5SnUb [Xr5nU$![R Ran[ SU35eSnAff=f)zCall to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. 5Gradient returned an unexpected response with status : 2RequestException while calling Gradient Endpoint: NgeneratedOutputr) requestspostr status_coderNtext exceptionsRequestExceptionrur)rRr|rrr_responseers r%_callGradientLLM._calls  V}}Qt'@'@'PQH##s*K++,Bx}}o?+}}01  &t2D ""33 VPQRPSTU U VsABB1B,,B1c # UR(d[R"5IShvN nUR"S0UR XS9D6IShvN nUR S:wa%[ SUR SUR35eUR5IShvN SnSSS5IShvN SSS5IShvN OURR"S0UR XS9D6IShvN nUR S:wa%[ SUR SUR35eUR5IShvN SnSSS5IShvN Ub [WU5nW$GNAGNNN!,IShvN (df  N=fN!,IShvN (df  NN=fNNjNY!,IShvN (df  Nn=f7f)zAsync Call to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. N)r|r_rrrrr) r2aiohttp ClientSessionrrstatusrNrrur)rRr|rrr_sessionrrs r%_acallGradientLLM._acalls ,,..'"<<//v/M#-'S'/r(--B#+--/13DED/..++++6+I??c)#O#??+2hmm_>'mmo-/@A  &tT2D 3/2/....s+GE.G$FE1FA E8"E4#E8* F5E66F: GF2G8F.9GF? F FGF+F  F+'G0F42G4G :F= ; G Gpromptsc D^^^^S[S[[4UUUU4Sjjn[U5S::a[ [ XQ55nOA[ [S[U555n[ UR XQ55nSSS5 [WS9$!,(df  N=f)*Run the LLM on the given prompt and input.r|r9c @>[TR"SUTTS.TD6S9/$)N)r|rrrr)rr)r|r_rrRrs r%_inner_generate.GradientLLM._generate.._inner_generate=s5%DkMS r$rFN generations) strrrrOlistmaprminr)rRrrrr_rrps` ``` r% _generateGradientLLM._generate3s C D,<   w<1 s?<=K#C3w<$89Q"155#BC :[11:9s %B Bc # /n[R"UVs/sHnUR"U4X#S.UD6PM sn6IShvN HnUR[ US9/5 M [ US9$s snfN27f)r)rrNrr)asynciogatherrappendrr)rRrrrr_rr| generations r% _agenerateGradientLLM._agenerateNs '&%F FQQ&Q%!   J    ;< =  [11  sA3A,A3A13A3c j[R"S0URX5D6nURS:wa%[ SURSUR 35eUR5nUSUS- n[US9$![R Ran[ SU35eSnAff=f) NrrrrsumLossnumberOfTrainableTokensrr) rrrzrrNrrrrur)rRr^r_rr response_jsonrs r%train_unsupervisedGradientLLM.train_unsupervised`s V}}55fEH##s*K++,Bx}}o?+!  Y'-8Q*RR%% ""33 VPQRPSTU U VsABB2B--B2c # UR(d[R"5IShvN nUR"S0UR X5D6IShvN nUR S:wa%[ SUR SUR35eUR5IShvN nUSUS- nSSS5IShvN SSS5IShvN OURR"S0UR X5D6IShvN nUR S:wa%[ SUR SUR35eUR5IShvN nUSUS- nSSS5IShvN [WS9$GNMGN&NN!,IShvN (df  N=fN!,IShvN (df  NF=fNNjNQ!,IShvN (df  Nf=f7f)Nrrrrrrr) r2rrrrzrrNrrur)rRr^r_rrrrs r%atrain_unsupervisedGradientLLM.atrain_unsupervisedus ,,..'"<<99&I#-'S'/r(--B+3--/$9M%i0'(ABC/..++55fE??c)#O#??+2hmm_>'/mmo 5 !),}=V/WW%%9/%:/...!6s+GE:G&F E=F A F$F%F4 F ?FF  GF4GF:GA GF<G! G,F>-G=F FF F F  F F G F7&F) ' F73G<G>GGG  GGr)NN).rrrrr rr-rr"r.rr/r0rvr1r2rrr model_configr classmethodrrr?rrTpropertyrrXr\r rzrrr rr rrrrrrrr#rr$r%r'r's6A6Hc6;+/8C=/*+/8C=/ $(L(4.'19c926J../6IL (# $ 3 $ '""4"#"H WS#X%6  3- sm- -4S#X->- c - ^  #*38#4 c  F%):>  tCy! 67    J%)?C **tCy!*;< *  * *^%):> 2c2tCy!267 2  2  2<%)?C 2c2tCy!2;< 2  2  2$& &&  &*"& "&"&  "&r$r')"rrLconcurrent.futuresrtypingrrrrrr r rrlangchain_core.callbacksr r #langchain_core.language_models.llmsr langchain_core.outputsrrlangchain_core.utilsrpydanticrrrtyping_extensionsrlangchain_community.llms.utilsrrr'rr$r%rsS1JJJ88577">) |&'|&r$