dhr!jSSKrSSKJrJrJrJrJrJr SSKJ r SSK J r SSK J r Jr "SS\ 5rg)N)AnyDictListMappingOptionalUnion)CallbackManagerForLLMRun)LLM)Field SecretStrc *\rSrSr%Sr\\S'\\S'Sr\ \\S'Sr \ \\S'Sr \ \ \S'\ "\S 9r\\\4\S '\ "S S S .5r\\S'\S\4Sj5rSS\S\ \\S\ \S\S\4 Sjjr\S\\\44Sj5rS\4SjrSrg) Predibase aUse your Predibase models with Langchain. To use, you should have the ``predibase`` python package installed, and have your Predibase API key. The `model` parameter is the Predibase "serverless" base_model ID (see https://docs.predibase.com/user-guide/inference/models for the catalog). An optional `adapter_id` parameter is the Predibase ID or HuggingFace ID of a fine-tuned LLM adapter, whose base model is the `model` parameter; the fine-tuned adapter must be compatible with its base model; otherwise, an error is raised. If the fine-tuned adapter is hosted at Predibase, then `adapter_version` in the adapter repository must be specified. An optional `predibase_sdk_version` parameter defaults to latest SDK version. modelpredibase_api_keyNpredibase_sdk_version adapter_idadapter_version)default_factory model_kwargsg?)max_new_tokens temperaturedefault_options_for_generationreturncg)N predibaseselfs Z/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/predibase.py _llm_typePredibase._llm_type(spromptstop run_managerkwargsc @0UREUR=(d 0EU=(d 0EnUR5(aSSKJn SSKJn SSKJnJ n SSK J n J n SSK Jn SSKJn U"UR"R%5SS S 9nU"US 9nUR+SUR,3S9nUR.(aPUR1UR.UR2SS9nUR5US9R7UUS9nUR8$UR7UUS9nUR8$SSKJn S[<R>S'U"UR"R%5S9nSSK nSSK!J"n SSK#J$n SSK%J&n URNRQUR,S9nUR.(axUR2(aDUR.SUR23nURSSS5 UR6"S(UUS.UD6nO7UR6"S(UUR.S!S".UD6nOUR6"S(S%U0UD6nURVnU$![&an['S 5UeSnAf[(an[)S 5UeSnAff=f!Ua UR+SUR.3S9nGNf=f!Uan[)SUS 35UeSnAff=f!Uan[)S#UR.S$35UeSnAff=f!URTan[)S&UR,S'35UeSnAff=f))Nr)PredibaseClient) get_session)ServerResponseErrorSession)HuggingFaceLLM LLMDeployment)GeneratedResponse)Modelz https://api.app.predibase.com/v1zserving.app.predibase.com)tokengatewayserving_endpoint)sessionzZCould not import Predibase Python package. Please install it with `pip install predibase`.z-Your API key is not correct. Please try againzpb://deployments/)uri)nameversionmodel_idzhf://)r)r%options)rzhttps://api.app.predibase.comPREDIBASE_GATEWAY) api_token)Client)GenerationError)Response)deployment_ref/r<)r%rzAn adapter with the ID "zE" cannot be found in the Predibase repository of fine-tuned adapters.hub)r%radapter_sourcezEither an adapter with the ID "z" cannot be found in a HuggingFace repository, or it is incompatible with the base model (please make sure that the adapter configuration is consistent). r%zAn LLM with the deployment ID "z" cannot be found at Predibase (please refer to "https://docs.predibase.com/user-guide/inference/models" for the list of supported models). r),rr_is_deprecated_sdk_versionrr* predibase.pqlr+predibase.pql.apir,r- predibase.resource.llm.interfacer.r/predibase.resource.llm.responser0predibase.resource.modelr1rget_secret_value ImportError ValueErrorr rr get_modelr with_adaptergenerateresponserosenvironrequests lorax.clientr= lorax.errorsr> lorax.typesr? deploymentsclientpopJSONDecodeErrorgenerated_text) r r%r&r'r(r:r*r+r,r-r.r/r0r1r5pcebase_llm_deployment adapter_modelresultrrrS LoraxClientr>r? lorax_client pb_adapter_idrPgejde response_texts r!_callPredibase._call,s1 111   &B1 |1   * * , , Y55N:#.00AAC>%@$ '6g&F24' |4282  J$&LL!__ $ 4 4!%%1%M-99 9NWW!#X?? " -55!#6?? "'*I &'(,,==?  60($-$9$9$@$@::%A% ?? ##(,'8$:N:N9O%P   +44 %#0 " H +44 %#'??', "  H '00!!// _ !F Y !PQWXX Y(+J$&FFt6G/HF$IMJ`'$4]OD:='$;DOO;LM  ++  7 |D   sAI%I?-J( K&K. I< I I<+ I77I<?"J%$J%(K.J>>KK+ K&&K+.L>LLc"0SUR0E$)zGet the identifying parameters.r)rrs r!_identifying_paramsPredibase._identifying_paramss t001  r$cSSKnSSKJn SSKJn UR SS9nUR =(d UnUR US9nXd:=(d SU;(+$![ an[ S5UeSnAff=f)Nr) __version__)Versionz2024.4.8)version_stringz+devzkCould not import Predibase Python package. Please install it with `pip install semantic_version predibase`.)semantic_versionpredibase.versionrmsemantic_version.basernrrK)r rpcurrent_versionrnsdk_semver_deprecatedactual_current_versionsdk_semver_currentr]s r!rD$Predibase._is_deprecated_sdk_versions  # H 5-=-E-E).F. !+/*D*D*W "*:*B*B5+C+ $;644  S  sAA A5$ A00A5r)NN)__name__ __module__ __qualname____firstlineno____doc__str__annotations__r rrrrintr dictrrrrpropertyr"rr rgrrjboolrD__static_attributes__rr$r!rr s" J  +/8C=/ $J $%)OXc])#(#>L$sCx.>+0! ,"D3 %):> PPtCy!P67 P  P Pd WS#X%6  Dr$r)rQtypingrrrrrrlangchain_core.callbacksr #langchain_core.language_models.llmsr pydanticr r rrr$r!rs% <<=3%QQr$