dh'8SSKrSSKrSSKJrJrJrJrJrJr SSK r SSK J r J r SSK Jr SSKJr SSKJr \R&"\5r"SS\5rg) N)Any AsyncIteratorDictIteratorListOptional)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM)GenerationChunk)Fieldc \rSrSr%Sr\\S'Sr\\\S'Sr \\ \S'\ "SS S 9r \ \S 'S r\\\S 'S r\\\S'Sr\\\S'Sr\\\S'Sr\\\S'Sr\\\S'Sr\\\S'Sr\\ \S'Sr\\ \S'Sr\\ \S'Sr\\\S'Sr\\\S'\ "SSS 9r\ \S'\ "SS S 9r\ \S '\ "SS!S 9r\ \S!'S"r\\ \S#'\ "SS$S 9r\ \S$'\ "SS%S 9r \ \S%'/r!\\"\\S&'Sr#\ \S''\$S(\%\\&44S)j5r'\$S(\%\\&44S*j5r(\$S(\4S+j5r)S6S,\\"\S(\%\\&44S-jjr*S7S.\S,\\"\S/\\+S0\&S(\4 S1jjr,S7S.\S,\\"\S/\\-S0\&S(\4 S2jjr.S7S.\S,\\"\S/\\+S0\&S(\/\04 S3jjr1S7S.\S,\\"\S/\\-S0\&S(\2\04 S4jjr3S5r4g)8TextGenaNText generation models from WebUI. To use, you should have the text-generation-webui installed, a model loaded, and --api added as a command-line option. Suggested installation, use one-click installer for your OS: https://github.com/oobabooga/text-generation-webui#one-click-installers Parameters below taken from text-generation-webui api example: https://github.com/oobabooga/text-generation-webui/blob/main/api-examples/api-example.py Example: .. code-block:: python from langchain_community.llms import TextGen llm = TextGen(model_url="http://localhost:8500") model_urlNpresetmax_new_tokensT do_sample)aliasg? temperatureg?top_p typical_prepsilon_cutoff eta_cutoffgzG?repetition_penalty(top_k min_lengthno_repeat_ngram_size num_beams penalty_alphalength_penaltyFearly_stoppingseed add_bos_tokenitruncation_length ban_eos_tokenskip_special_tokensstopping_strings streamingreturnc0SUR_SUR_SUR_SUR_SUR_SUR _SUR _SUR_S UR_S UR_S UR_S UR_S UR_SUR_SUR_SUR_SUR _UR"UR$UR&UR(S.E$)z/Get the default parameters for calling textgen.rrrrrrrrrr r!r"r#r$r%r'r()r)r*r+r,)rrrrrrrrrr r!r"r#r$r%r'r(r)r*r+r,selfs X/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/textgen.py_default_paramsTextGen._default_paramsvsU d11   4++  TZZ    d11   $//  !$"9"9  TZZ  $//  #D$=$=    T//  d11  d11 DII! " T//# $"&!7!7!//#'#;#; $ 5 5+  c:0SUR0EURE$)zGet the identifying parameters.r)rr3r0s r2_identifying_paramsTextGen._identifying_paramss$I;/H43G3GHHr5cg)zReturn type of llm.textgenr0s r2 _llm_typeTextGen._llm_typesr5stopcUR(aUb [S5eURc URnOSUR0nUR=(d U=(d /US'U$)z Performs sanity check, preparing parameters in format needed by textgen. Args: stop (Optional[List[str]]): List of stop sequences for textgen. Returns: Dictionary containing the combined parameters. z2`stop` found in both the input and default params.rr,)r, ValueErrorrr3)r1r>paramss r2_get_parametersTextGen._get_parameterssc  T%5QR R ;; ))F ,F&*%:%:%Hd%Hb!" r5prompt run_managerkwargsc UR(a0SnUR"S XUS.UD6HnXVR- nM UnU$URS3nUR U5n U R 5n XS'[ R"XS9n U RS:XaU R5SSS nU$[S U 35 SnU$) Call the textgen web API and return the output. Args: prompt: The prompt to use for generation. stop: A list of strings to stop generation when encountered. Returns: The generated text. Example: .. code-block:: python from langchain_community.llms import TextGen llm = TextGen(model_url="http://localhost:5000") llm.invoke("Write a story about llamas.") rDr>rE/api/v1/generaterDjsonresultsrtextERROR: response: r;) r-_streamrPrrBcopyrequestspost status_coderMprint r1rDr>rErFcombined_text_outputchunkresulturlrArequestresponses r2_call TextGen._calls. >>#% kEK% 2$*F ^^$$45C))$/FkkmG &H }}S7H##s*!3A6v>  )(45 r5c# UR(a0SnUR"S XUS.UD6ShvN nXVR- nMURS3nUR U5n U R 5n XS'[ R"XS9n U RS:XaU R5SS S nU$[S U 35 SnU$N UnU$7f) rHrIrJNrKrDrLrNrOrrPrQr;) r-_astreamrPrrBrSrTrUrVrMrWrXs r2_acallTextGen._acalls. >>#% #}} k EK  3e% 2$^^$$45C))$/FkkmG &H }}S7H##s*!3A6v>  )(45 ' 3 *F s&)CC C C BC C  Cc+># SSKn0URU5EUEnURS3nUR 5nXS'UR 5n U R U5 U R[R"U55 U R5n [R"U 5n U SS:Xa2[U SSS 9n U(aURU RS 9 U v OU SS :XaU R5 gM}![a [S5ef=f7f aYields results objects as they are generated in real time. It also calls the callback manager's on_llm_new_token event with similar parameters to the OpenAI LLM class method of the same name. Args: prompt: The prompts to pass into the model. stop: Optional list of stop words to use when generating. Returns: A generator representing the stream of tokens being generated. Yields: A dictionary like objects containing a string token and metadata. See text-generation-webui docs and below for more. Example: .. code-block:: python from langchain_community.llms import TextGen llm = TextGen( model_url = "ws://localhost:5005" streaming=True ) for chunk in llm.stream("Ask 'Hi, how are you?' like a pirate:'", stop=["'"," "]): print(chunk, end='', flush=True) # noqa: T201 rNz9The `websocket-client` package is required for streaming.z/api/v1/streamrDevent text_streamrP)rPgeneration_info)token stream_end websocket ImportErrorrBrrS WebSocketconnectsendrMdumpsrecvloadsr on_llm_new_tokenrPclose r1rDr>rErFrmrAr\r]websocket_clientr[rZs r2rRTextGen._streams H   :D((.9&9 /++-"$..0  %djj12%**,FZZ'Fg-/'$(00uzz0B L0 &&(% K  sDDC?ND?b'D#'O:%):> ,,tCy!,67 ,  , ,b%)?C ,,tCy!,;< ,  , ,b%):> FFtCy!F67 F  F / " FV%)?C FFtCy!F;< F  F  ' FFr5r)rMloggingtypingrrrrrrrTlangchain_core.callbacksr r #langchain_core.language_models.llmsr langchain_core.outputsr pydanticr getLoggerr|loggerrr;r5r2rsB EE42   8 $NcNr5