dh}jSSKJr SSKJrJrJrJrJr SSKJ r J r SSK J r SSK Jr "SS\ 5rg) )partial)AnyDictListOptionalSequence)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM)pre_initc X\rSrSr%Sr\\S'\\S'Sr\ \\S'Sr \ \\S'Sr \ \ \\4\S'Sr \ \\S '\S \ \\44S j5r\S \4S j5r\S \ S \ 4Sj5rSS\S\ \\S\ \S\S \4 SjjrSS\S\ \\S\ \S\S \4 SjjrSrg) CTransformers aCC Transformers LLM models. To use, you should have the ``ctransformers`` python package installed. See https://github.com/marella/ctransformers Example: .. code-block:: python from langchain_community.llms import CTransformers llm = CTransformers(model="/path/to/ggml-gpt-2.bin", model_type="gpt2") clientmodelN model_type model_fileconfiglibreturnc`URURURURS.$)zGet the identifying parameters.rrrrrselfs ^/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/ctransformers.py_identifying_params!CTransformers._identifying_params-s*ZZ////kk   cg)zReturn type of llm. ctransformersrs r _llm_typeCTransformers._llm_type7srvaluescSSKJn US=(d 0nUR"US4USUSUSS .UD6US 'U$![a [S5ef=f) z5Validate that ``ctransformers`` package is installed.r)AutoModelForCausalLMz\Could not import `ctransformers` package. Please install it with `pip install ctransformers`rrrrr)rrrr)r r& ImportErrorfrom_pretrained)clsr$r&rs rvalidate_environment"CTransformers.validate_environment<s  :!'R/?? 7O l+l+u    x  E  s >Apromptstop run_managerkwargsc /nU=(d [R"5nURXSS9H-nURU5 UR XpR S9 M/ SR U5$)aGenerate text from a prompt. Args: prompt: The prompt to generate text from. stop: A list of sequences to stop generation when encountered. Returns: The generated text. Example: .. code-block:: python response = llm.invoke("Tell me a joke.") Tr-streamverbose)r get_noop_managerrappendon_llm_new_tokenr4join)rr,r-r.r/text _run_managerchunks r_callCTransformers._callQsf*"Q&>&O&O&Q [[4[@E KK   ) )% ) FAwwt}rc# SnU(a[URURS9nSnURXSS9HnU(aU"U5IShvN Xg- nM U$N7f)amAsynchronous Call out to CTransformers generate method. Very helpful when streaming (like with websockets!) Args: prompt: The prompt to pass into the model. stop: A list of strings to stop generation when encountered. Returns: The string generated by the model. Example: .. code-block:: python response = llm.invoke("Once upon a time, ") Nr3r5Tr1)rr8r4r)rr,r-r.r/ text_callbackr:tokens r_acallCTransformers._acallmsf* #K$@$@$,,WM[[4[@E#E*** MDA  +sAA"A A"r!)NN)__name__ __module__ __qualname____firstlineno____doc__r__annotations__strrrrrrrpropertyrr"r r*rr r=rr rB__static_attributes__r!rrrr sf  K J!%J $ $J $:'+FHT#s(^ $+;C#H  T#s(^  3$4.)-:> x}%67    >%)?C tCy!;<    rrN) functoolsrtypingrrrrrlangchain_core.callbacksr r #langchain_core.language_models.llmsr langchain_core.utilsr rr!rrrRs)664)@C@r