dhf0SSKJr SSKrSSKJr SSKJrJrJrJ r J r J r SSK J r SSKJr SSKJr SSKJrJr SS KJr SS KJrJr \R4"\5r"S S \5rg) ) annotationsN)Path)AnyDictIteratorListOptionalUnion)CallbackManagerForLLMRun)LLM)GenerationChunk)get_pydantic_field_namespre_init)_build_model_kwargs)Fieldmodel_validatorcn\rSrSr%SrSrS\S'S\S'SrS\S 'SrS\S '\ "S S S 9r S\S '\ "SSS 9r S\S'\ "SSS 9r S\S'\ "SSS 9r S\S'\ "SSS 9rS\S'\ "SSS 9rS\S'\ "SSS 9rS\S'\ "SSS 9rS\S'\ "SSS 9rS\S'\ "SSS 9rS\S'\ "S5rS\S'SrS\S 'S!rS"\S#'S$rS"\S%'\ "S5rS\S&'SrS'\S('/rS)\S*'S+rS"\S,'S-rS\S.'S/rS\S0'SrS'\S1'S2rS3\S4'S5r S3\S6'\ "\!S79r"S8\S9'Sr#S\S:'Sr$S;\S<'Sr%S=\S>'Sr&S\S?'\'SLS@j5r(\)"SASB9\*SMSCj55r+\,SNSDj5r-\,SNSEj5r.\,SOSFj5r/SPSQSGjjr0SRSSSHjjr1SRSTSIjjr2SUSJjr3SKr4g)VLlamaCppapllama.cpp model. To use, you should have the llama-cpp-python library installed, and provide the path to the Llama model as a named parameter to the constructor. Check out: https://github.com/abetlen/llama-cpp-python Example: .. code-block:: python from langchain_community.llms import LlamaCpp llm = LlamaCpp(model_path="/path/to/llama/model") Nrclientstr model_pathz Optional[str] lora_base lora_pathin_ctx)aliasintn_partsseedTf16_kvboolF logits_all vocab_only use_mlock n_threadsz Optional[int]n_batch n_gpu_layerssuffix max_tokensg?zOptional[float] temperaturegffffff?top_plogprobszOptional[bool]echoOptional[List[str]]stopg?repeat_penalty(top_k@last_n_tokens_sizeuse_mmapg?floatrope_freq_scaleg@rope_freq_base)default_factoryDict[str, Any] model_kwargs streamingzOptional[Union[str, Path]] grammar_pathzOptional[Union[str, Any]]grammarverbosec>SSKJnJn USn/SQnUVs0sHofX_M nnUSbUSUS'UR US5 U"U40UD6US 'US (a(US (aUS n US n [ SU <SU <S35e[US [5(aURUS 5US 'U$US (aURUS 5US 'U$U$![a [S5ef=fs snf![ an[ S US U35eSnAff=f)z4Validate that llama-cpp-python library is installed.r)Llama LlamaGrammarzCould not import llama-cpp-python library. Please install the llama-cpp-python library to use this embedding model: pip install llama-cpp-pythonr)r:r;rrrrr r!r#r$r%r&r(r8r7rBr)Nr>rz&Could not load Llama model from path: z. Received error rAr@zCCan only pass in one of grammar and grammar_path. Received grammar=z and grammar_path=.) llama_cpprDrE ImportErrorupdate Exception ValueError isinstancer from_string from_file) clsvaluesrDrErmodel_param_namesk model_paramserAr@s Y/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/llamacpp.pyvalidate_environmentLlamaCpp.validate_environments  5L)  $/@@.?69 .? @ . ! -+1.+AL (F>23 $Z@<@F8  ) !7Y'G!.1L*/,3 y)3 / / , 8 8 9J KF9   N # , 6 6vn7M NF9    m I  4A 8 E""#&  s(C C7 C<C4< DDDbefore)modec2[U5n[X5nU$)z>Build extra kwargs from additional params that were passed in.)rr)rOrPall_required_field_namess rUbuild_model_kwargsLlamaCpp.build_model_kwargss$>$& '  % 2$ ( '))$/F))&)F[[99&9F)$Q'/ /r^c+,# 0URU5EUEnUR"S USS.UD6nUH`nUSSRSS5n[USSSSU0S9n U(a%UR U R UR US 9 U v Mb g7f) a\Yields results objects as they are generated in real time. It also calls the callback manager's on_llm_new_token event with similar parameters to the OpenAI LLM class method of the same name. Args: prompt: The prompts to pass into the model. stop: Optional list of stop words to use when generating. Returns: A generator representing the stream of tokens being generated. Yields: A dictionary like objects containing a string token and metadata. See llama-cpp-python docs and below for more. Example: .. code-block:: python from langchain_community.llms import LlamaCpp llm = LlamaCpp( model_path="/path/to/local/model.bin", temperature = 0.5 ) for chunk in llm.stream("Ask 'Hi, how are you?' like a pirate:'", stop=["'"," "]): result = chunk["choices"][0] print(result["text"], end='', flush=True) # noqa: T201 T)rtstreamrvrr/Nrw)rwgeneration_info)tokenrB log_probsrk)rprgetr on_llm_new_tokenrwrB) rartr2ruryrbr|partr/r{s rUrxLlamaCpp._stream,sJ:D((.9&9BF4B6BDIq)--j$?H#)_Q'/!+X 6E,,**dllh-KsBBclURRURS55n[U5$)Nzutf-8)rtokenizeencodelen)rarwtokenized_texts rUget_num_tokensLlamaCpp.get_num_tokens_s*--dkk'.BC>""r^rk)rPrreturnr)rPr=rr)rr=)rr)N)r2r1rr=)NN) rtrr2r1ru"Optional[CallbackManagerForLLMRun]ryrrr) rtrr2r1rurryrrzIterator[GenerationChunk])rwrrr)5__name__ __module__ __qualname____firstlineno____doc__r__annotations__rrrrrr r!r#r$r%r&r(r)r*r,r-r.r/r0r2r3r5r7r8r:r;dictr>r?r@rArBrrVr classmethodr\propertyrcrgrlrpr}rxr__static_attributes__rkr^rUrrs FCO+#I}#0#I}#As'*E3*9-GS-?b'D#'-X.FD.1U,7J7@U,7J7/E5It5,$T=I}=C#1I6G]6/#(N"CL-CF!$KFM'S #J #3#&K&.!E?!.#DkHm)N D. % "D "@&)NO)2E=.(* *M#Hn#1 OU )#NE#+#(#>L.>?It8/3L,3 *.G &- GT) ::x(#$ "KK8%):> (0(0"(08 (0  (0 (0Z%):> 11"18 1  1 # 1f#r^r) __future__rloggingpathlibrtypingrrrrr r langchain_core.callbacksr #langchain_core.language_models.llmsr langchain_core.outputsr langchain_core.utilsrrlangchain_core.utils.utilsrpydanticrr getLoggerrloggerrrkr^rUrsD"===32C:+   8 $P#sP#r^