dh"SSKJr SSKJrJrJrJrJrJrJ r SSKJr SSK J r SSKJr SSK J r Jr SSKJr SSKJr SSKJr SSKJr SSKJr SSKJr "SS \5rg ) )pre_init)Any AsyncIteratorDictIteratorListOptionalUnion)root_validator)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)LLM)enforce_stop_tokens)GenerationChunkc \rSrSr%Sr\\S'\\S'Sr\ \ \\4\S'Sr \ S\\ 4\S'Sr \\S '\S \ \\44S j5r\S \4S j5r\S \ S \ 4Sj5rSS\S\ \\S\ \S\S \4 SjjrSS\S\ \\S\ \S\S \4 SjjrSS\S\ \\S\ \S\S \\4 SjjrSS\S\ \\S\ \S\S \\4 SjjrSrg) DeepSparsea$Neural Magic DeepSparse LLM interface. To use, you should have the ``deepsparse`` or ``deepsparse-nightly`` python package installed. See https://github.com/neuralmagic/deepsparse This interface let's you deploy optimized LLMs straight from the [SparseZoo](https://sparsezoo.neuralmagic.com/?useCase=text_generation) Example: .. code-block:: python from langchain_community.llms import DeepSparse llm = DeepSparse(model="zoo:nlg/text_generation/codegen_mono-350m/pytorch/huggingface/bigpython_bigquery_thepile/base_quant-none") pipelinemodelNmodel_configurationgeneration_configF streamingreturnc`URURURURS.$)zGet the identifying parameters.)r model_configrr)rrrrselfs [/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/llms/deepsparse.py_identifying_paramsDeepSparse._identifying_params1s.ZZ 44!%!7!7   cg)zReturn type of llm. deepsparsers r _llm_typeDeepSparse._llm_type;sr!valuescSSKJn US=(d 0nUR"S SUSS.UD6US'U$![a [S5ef=f) z2Validate that ``deepsparse`` package is installed.r)Pipelinez[Could not import `deepsparse` package. Please install it with `pip install deepsparse[llm]`rtext_generationr)task model_pathrr$)r#r) ImportErrorcreate)clsr'r)rs rvalidate_environmentDeepSparse.validate_environment@ss  +34: %__ "g  z   G  s 3A promptstop run_managerkwargsc UR(a/SnUR"SXUS.UD6HnXVR- nM UnO5UR"SSU0URD6R SRnUb [ Xr5nU$)Generate text from a prompt. Args: prompt: The prompt to generate text from. stop: A list of strings to stop generation when encountered. Returns: The generated text. Example: .. code-block:: python from langchain_community.llms import DeepSparse llm = DeepSparse(model="zoo:nlg/text_generation/codegen_mono-350m/pytorch/huggingface/bigpython_bigquery_thepile/base_quant-none") llm.invoke("Tell me a joke.") r2r3r4 sequencesrr$)r_streamtextrr generationsrrr2r3r4r5combined_outputchunkr<s r_callDeepSparse._callTs& >> OkEK ::-#D II$2H2HIQ    &t2D r!c"# UR(a0SnUR"SXUS.UD6ShvN nXVR- nMUR"SSU0URD6R SRnUb [ Xr5nU$NY UnN7f)r7r8r9Nr:rr$)r_astreamr<rrr=rr>s r_acallDeepSparse._acallzs& >> O#}} k EK  .e ::- II$2H2HIQ    &t2D  . #Ds&)BB B B AB B  Bc+# UR"SUSS.URD6nUHGn[URSRS9nU(aUR URS9 Uv MI g7faYields results objects as they are generated in real time. It also calls the callback manager's on_llm_new_token event with similar parameters to the OpenAI LLM class method of the same name. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: A generator representing the stream of tokens being generated. Yields: A dictionary like object containing a string token. Example: .. code-block:: python from langchain_community.llms import DeepSparse llm = DeepSparse( model="zoo:nlg/text_generation/codegen_mono-350m/pytorch/huggingface/bigpython_bigquery_thepile/base_quant-none", streaming=True ) for chunk in llm.stream("Tell me a joke", stop=["'"," "]): print(chunk, end='', flush=True) # noqa: T201 T)r:rr)r<)tokenNr$rrrr=r<on_llm_new_tokenrr2r3r4r5 inferencerIr@s rr;DeepSparse._streamsq8MM  040F0F E#):):1)=)B)BCE,,5::,>K sA.A0c # UR"SUSS.URD6nUHPn[URSRS9nU(a!UR URS9IShvN U7v MR gN7frHrJrLs rrDDeepSparse._astreams}8MM  040F0F E#):):1)=)B)BCE!222DDDK EsA(A;*A9+A;r$)NN)__name__ __module__ __qualname____firstlineno____doc__r__annotations__strrr rrr rboolpropertyrr%rr0rr rAr rErrr;rrD__static_attributes__r$r!rrrs M JV48$sCx.18E15uT3_-4) It8  T#s(^  3$4,%):> $$tCy!$67 $  $ $R%)?C $$tCy!$;< $  $ $R%):> $$tCy!$67 $  $ / " $R%)?C $$tCy!$;< $  $  ' $$r!rN)langchain_core.utilsrtypingrrrrrr r pydanticr langchain_core.callbacksr r #langchain_core.language_models.llmsrlangchain_community.llms.utilsrlangchain_core.outputsrrr$r!rrbsA)LLL)#)*3)>)2WWr!