dhMdSSKJr SSKrSSKrSSKJr SSKJrJ r J r J r J r J r JrJrJrJrJrJrJr SSKJr SSKJr SSKJr SSKJr SS KJrJrJ r SS K!J"r"J#r# SS K$J%r%J&r&J'r' SS K(J)r) SS K*J+r+ SSK,J-r- SSK.J/r/J0r0J1r1 SSK2J3r3 SSK4J5r5 \"S\/S9r6\\ \7\4\\6\4r8"SS\5r9g)) annotationsN) AsyncIterator) AnyCallableDictIteratorListOptionalSequenceTupleType TypedDictTypeVarUnion get_origin)CallbackManagerForLLMRun)AsyncCallbackManagerForLLMRun)LanguageModelInput) BaseChatModel) AIMessageAIMessageChunk BaseMessage)JsonOutputParserPydanticOutputParser)ChatGenerationChatGenerationChunk ChatResult)Runnable)BaseTool)convert_to_openai_tool) BaseModelFieldmodel_validator)Literalconvert_message_to_dict_BM)boundcX^\rSrSr%SrSrS\S'S\S'SrS \S 'S rS \S 'Sr S\S'Sr S\S'Sr S\S'Sr S\S'Sr S\S'SrS\S'SrS\S'\"\S9rS\S'\"SS 9S3S!j5rS3S"jr\S4S#j5r\S5S$j5r\S5S%j5r\S6S&j5rS7S'jrS8S(jrSS).S9U4S*jjjrS+S,.S:S-jjrS;SU4S0jjjr!S;S?U4S1jjjr"S2r#U=r$$)@ ChatOutlines)uOutlines chat model integration. Setup: pip install outlines Key init args — client params: backend: Literal["llamacpp", "transformers", "transformers_vision", "vllm", "mlxlm"] = "transformers" Specifies the backend to use for the model. Key init args — completion params: model: str Identifier for the model to use with Outlines. max_tokens: int = 256 The maximum number of tokens to generate. stop: Optional[List[str]] = None A list of strings to stop generation when encountered. streaming: bool = True Whether to stream the results, token by token. See full list of supported init args and their descriptions in the params section. Instantiate: from langchain_community.chat_models import ChatOutlines chat = ChatOutlines(model="meta-llama/Llama-2-7b-chat-hf") Invoke: chat.invoke([HumanMessage(content="Say foo:")]) Stream: for chunk in chat.stream([HumanMessage(content="Count to 10:")]): print(chunk.content, end="", flush=True) Nrclientstrmodel transformerszKLiteral['llamacpp', 'transformers', 'transformers_vision', 'vllm', 'mlxlm']backendint max_tokensOptional[List[str]]stopTbool streamingz Optional[str]regexzOptional[Union[type, str]]type_constraintsz$Optional[Union[Any, Dict, Callable]] json_schemagrammarz Optional[Any]custom_generator)default_factoryDict[str, Any] model_kwargsafter)modec[[UR5[UR5[UR5[UR 5/5nUS:a [ S5eUR5$)z@Validate that outlines is installed and create a model instance._Either none or exactly one of regex, type_constraints, json_schema, or grammar can be provided.)sumr6r8r9r:r; ValueError build_client)selfnum_constraintss `/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/chat_models/outlines.pyvalidate_environment!ChatOutlines.validate_environmentstTZZ T**+T%%&T\\"    Q ;   ""c<SSKJn SSjnURS:XaoU"S/5 SUR;a'URR SS5up4nUSU3nO [ S 5eUR"Xe40URD6Ul U$URS :Xa9U"/S Q5 UR"SS UR0URD6Ul U$URS :XaR[US 5(a6SSK J n UR"UR4SU0URD6Ul U$[ S5eURS:Xa[[R"5S:Xa [ S5eU"S/5 UR "UR40URD6Ul U$URS:Xa7U"S/5 UR""UR40URD6Ul U$[ SUR35e![a [S5ef=f)NrzUCould not import the Outlines library. Please install it with `pip install outlines`.c LUVs/sH]n[RR[U[5(aUSOU5bMA[U[ 5(aUOUSPM_ nnU(a/[ SSRU5SSRU535egs snf)NrCrzMissing packages: z, z.. You can install them with: pip install  ) importlibutil find_spec isinstancetupler- ImportErrorjoin)packagespkgmissing_packagess rJcheck_packages_installed;ChatOutlines.build_client..check_packages_installeds $ #C>>++je6L6LCFRUV8z#s++Q7#    !(3C)D(EF''*xx0@'A&BD  s ?B! B!llamacpp)zllama-cpp-python llama_cppz.gguf/z.GGUF file_name must be provided for llama.cpp.r/)r/torchdatasets model_nametransformers_vision)!LlavaNextForConditionalGeneration model_classz,transformers_vision backend is not supportedvllmDarwinz'vLLM backend is not supported on macOS.mlxlmmlxzUnsupported backend: )rXz!List[Union[str, Tuple[str, str]]]returnNone)outlines.modelsmodelsrVr0r.splitrFr]r?r,r/hasattrrerdplatformsystemrgri)rHror[creator repo_name file_namerepo_idres rJrGChatOutlines.build_clients!  , 7    <<: % $&G%H I$**$04 0@0@a0H-I$IQyk2 !QRR //'R@Q@QRDK6 5\\^ + $%J K --::)-):):DK0 +\\2 2v455J$88JJ A'' " !!OPP \\V # H, !JKK $fX . ++djjFD4E4EFDK  \\W $ $eW - ,,tzzGT5F5FGDK 4T\\NCD Do A  s HHcg)Nz outlines-chatrmrHs rJ _llm_typeChatOutlines._llm_typesrMcLURURS.URE$)N)r3stop_at)r3r5r?rzs rJ_default_paramsChatOutlines._default_paramss,//yy   rMcURURURURURUR S.UR E$)N)r.r0r8r9r:r;)r.r0r8r9r:r;rrzs rJ_identifying_params ChatOutlines._identifying_params"sLZZ||ZZ $ 5 5++||  ""  rMcSSKJn UR(a UR$URURUR UR /n[SU55nUS:waUS:wa [S5eUR(a$URURURS9$UR(a$URURURS9$UR (a$URURUR S9$UR (a$URURUR S 9$URUR5$) Nr)generatec3&# UHoSLv M g7fNrm).0 constraints rJ *ChatOutlines._generator..;sS{4{srCrD) regex_str) python_type) schema_object)cfg_str)outlinesrr<r8r9r:r;rErFr,formatjsoncfgtext)rHr constraintsrIs rJ _generatorChatOutlines._generator.s%  (( ( JJ  ! !    LL  S{SS a Oq$8;  ::>>$++>D D  ??4;;D^UVs/sHn[U5PM nnUVs/sH ofSSPM nnT(a[T[5(a.[U4SjU55(d[ ST<SUS35eO[T[ 5(a9UVs/sHoSST:XdMUPM n nU (d[ ST<SUS35eOA[T[ 5(a,[U5S:a[ S[U5S 35eUS mTUS 'UVs/sHn[U5PM nn[T U]$"S S U0UD6$s snfs snfs snfs snf)zBind tool-like objects to this chat model tool_choice: does not currently support "any", "auto" choices like OpenAI tool-calling API. should be a dict of the form to force this tool {"type": "function", "function": {"name": <>}}. functionnamec38># UHnTSSU:Hv M g7f)rrNrm)rrrs rJr*ChatOutlines.bind_tools..ws#HRK +F3t; szTool choice tool_choice=z1 was specified, but the only provided tools were .rCzQtool_choice=True can only be specified when a single tool is passed in. Received z tools.rrtoolsrm) r rTdictanyrFr-r6lensuper bind_tools) rHrrkwargstoolformatted_toolsft tool_namesfchosen __class__s ` rJrChatOutlines.bind_toolsfsEJJED1$7EJ7FGnV, G +t,,HR%3{n5//9l!=K--..!J-2G;2VA$3{n5//9l!= K..'!+$//25zl'C.a0 +}DIJED1$7EJw!BB6BB=KG"KsD=EE(EE F) include_rawc [U5[La [S5eXl[ U[ 5(a[ U[5(a [US9nO [5nU(a [S5eX-$)Nz*TypedDict is not supported yet by Outlines)pydantic_objectz include_raw is not yet supported) rrNotImplementedErrorr:rTtype issubclassr!rr)rHschemarrparsers rJwith_structured_output#ChatOutlines.with_structured_outputsj f  *%&RS S! fd # # 69(E(E$V< &'F %&HI I}rMc 0UREUEnU(aX%S'URU5nSnUR(aUR"SUUUS.UD6Hon[ UR R [5(aXxR R - nMF[S[UR R 535e OUR"U40UD6n[US9n [U S9n [U /S9$) Nr~)rr5 run_managerz1Invalid content type, only str is supported, got contentr generationsrm)rrr7_streamrTrrr-rFrrrrr) rHrr5rrparamspromptresponsechunkr generations rJ _generateChatOutlines._generates4D((3F3  $9 11(; >>!'  emm33S99 5 55H$#EMM$9$9:;=v88HH-#G4 zl33rMc+# 0UREUEnU(aX%S'URU5nURR"U40UD6H1nU(aUR U5 [ US9n[ US9n U v M3 g7f)Nr~rr)rrrstreamon_llm_new_tokenrr) rHrr5rrrrtoken message_chunkrs rJrChatOutlines._streams4D((3F3  $9 11(;__++F=f=E,,U3*59M' >EK >sBBc<># [URS5(am0UREUEnU(aX%S'URU5nURR"U40UD6IShvN n[ US9n[ US9n [U /S9$UR(aBSnUR"XU40UD6ShvN n XzRR=(d S- nM,[T U]4"XU40UD6IShvN $NNC [ US9n[ US9n [U /S9$N%7f)N agenerater~rrrr)rqrrrrrrrr7_astreamrrr _agenerate) rHrr5rrrrrrrrrs rJrChatOutlines._agenerates 4??K 0 07,,77F$(y!55h?F!__66vHHHH1G'8J:,7 7 ^^H#}}X[SFS 8eMM117R7 +HKR6RR RI 8S1G'8J:,7 7RsCA(D+C9,AD3C=7C;8C=;9D4D5D;C==Dc ># [URS5(a0UREUEnU(aX%S'URU5nURR"U40UD6ShvN nU(aUR U5IShvN [ US9n[US9n U 7v MB[T U]$"XU40UD6ShvN n U 7v MN_NA gN g7f)Nastreamr~rr) rqrrrrrrrrr) rHrr5rrrrrrrrs rJrChatOutlines._astreams 4??I . .7,,77F$(y!55h?F#66vHH e%66u=== .u = +MB $w/ VvV e  = I Vs`A%C(C,C -C0C C /C<CCCC CCCCC)r,r:)rkz'ChatOutlines')rkr-)rkr>)rkr)rlist[BaseMessage]rkz list[dict])rrrkr-)rz?Sequence[Dict[str, Any] | type | Callable[..., Any] | BaseTool]rz Optional[Union[Dict, bool, str]]rrrkz)Runnable[LanguageModelInput, BaseMessage])rzOptional[_DictOrPydanticClass]rr6rrrkz4Runnable[LanguageModelInput, Union[dict, BaseModel]])NN) rList[BaseMessage]r5r4r"Optional[CallbackManagerForLLMRun]rrrkr) rrr5r4rrrrrkzIterator[ChatGenerationChunk]) rrr5List[str] | Noner$AsyncCallbackManagerForLLMRun | Nonerrrkr) rrr5rrrrrrkz"AsyncIterator[ChatGenerationChunk])%__name__ __module__ __qualname____firstlineno____doc__r,__annotations__r0r3r5r7r8r9r:r;r<r"rr?r#rKrGpropertyr{rrrrrrrrrrr__static_attributes__ __classcell__)rs@rJr*r*)s DFC J    J3 $D $@It8E= 4807 9=K5<$"G]!0'+m*R#(#>L.> '"###";z      **8J)J J  49= +CN+C6 +C  +C 3 +C+Cb" .    > 6%):> !4#!4"!48 !4  !4  !4L%):> #"8    ' ."&<@ S#SS: S  S  SS>"&<@ #:    , rMr*): __future__rimportlib.utilrQrrcollections.abcrtypingrrrrr r r r r rrrrlangchain_core.callbacksr langchain_core.callbacks.managerrlangchain_core.language_modelsr*langchain_core.language_models.chat_modelsrlangchain_core.messagesrrrlangchain_core.output_parsersrrlangchain_core.outputsrrrlangchain_core.runnablesrlangchain_core.toolsr%langchain_core.utils.function_callingr pydanticr!r"r#typing_extensionsr$#langchain_community.adapters.openair&r'r-_DictOrPydanticClassr*rmrMrJr s") >J=DJJPRR-)H66%G e9%T#s(^T#Y<=k=krM