tjT0~UdZddlmZddlZddlmZddlmZmZm Z ddl m Z ddl m Z mZddlmZerdd lmZmZdd lmZdd lmZdd lmZmZmZmZmZmZee zZd e d< GddeZ!dddddidZ"de d<GddeeeeefZ#d6dZ$d7d$Z%d8d%Z&d9d+Z'd:d.Z(d;d1Z)dz%Provider-side tool search middleware.) annotationsN)Mapping) TYPE_CHECKINGAny TypeAlias)BaseTool) NotRequired TypedDict)_attempt_infer_model_provider) AwaitableCallable) BaseChatModel) AIMessage)AgentMiddleware AgentStateContextT ModelRequest ModelResponse ResponseTrToolIdentifierc(eZdZUdZded<ded<dS)_ServerToolSearchSpeczHProvider-native tool search tool descriptor sent to the model as a tool.strtypezNotRequired[str]nameN)__name__ __module__ __qualname____doc____annotations__n/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain/agents/middleware/provider_tool_search.pyrr!s-RR IIIr"rtool_search_tool_bm25_20251119tool_search_tool_bm25)rrr tool_search) anthropicopenaiz dict[str, _ServerToolSearchSpec]_SERVER_TOOL_SEARCH_TOOLScBeZdZdZdddfdZdd ZddZddZxZS)ProviderToolSearchMiddlewareaDefer selected tools behind provider-native tool search. Instead of sending every tool schema on every turn, this middleware marks selected tools as deferred (via `extras["defer_loading"]`) and injects the provider's server-side tool search tool. The provider then retrieves the full schema of a deferred tool only when the model needs it, which keeps the request payload small when many tools are bound. A tool is deferred when its name (or instance) is passed in `searchable_tools`, or when it already carries `extras["defer_loading"] is True`. Only providers with server-side tool search are supported (currently Anthropic and OpenAI). The provider is inferred from the bound model. !!! warning This relies on provider-native tool search and only takes effect for supported providers. If a tool is deferred but the model's provider cannot be identified or does not support tool search, the model call raises `ValueError`. When no tool is deferred, the middleware passes the request through unchanged regardless of provider. Example: ```python from langchain.agents import create_agent from langchain.agents.middleware import ProviderToolSearchMiddleware agent = create_agent( "anthropic:claude-opus-4-8", tools=[get_weather, send_email, lookup_order], middleware=[ProviderToolSearchMiddleware(searchable_tools=["lookup_order"])], ) ``` N)searchable_toolsr,list[ToolIdentifier] | NonereturnNonecptt||_dS)zInitialize provider-side tool search. Args: searchable_tools: Tools or tool names to defer behind provider-native tool search. N)super__init___to_tool_namessearchable_tool_names)selfr, __class__s r#r2z%ProviderToolSearchMiddleware.__init__]s2 %34D%E%E"""r"requestModelRequest[ContextT]c|j}jrLd|D}tj|z }|r'dd|}t |t fd|Ds|St |j|j}|Kd|jj j ddtt}t ||tvrz@ProviderToolSearchMiddleware._prepare_request..}s)SSSt 48R8RSSSSr"zZProviderToolSearchMiddleware: searchable_tools references tool(s) not bound to the model: z, c3BK|]}t|jVdS)N)_is_deferred_toolr4r=r>r5s r# z@ProviderToolSearchMiddleware._prepare_request..s1YY4$T4+EFFYYYYYYr"NzHProviderToolSearchMiddleware could not determine the provider for model z$; server-side tool search supports: zWProviderToolSearchMiddleware requires a provider with server-side tool search, but got z; supported providers: c:g|]}t|jSr!)_defer_tool_if_neededr4rBs r# zAProviderToolSearchMiddleware._prepare_request..s(aaaSW,T43MNNaaar"tools)rHr4sortedjoin ValueErrorany_get_model_providermodelruntimer6rr)overridedict)r5r7rH availableunknownmsgprovider bound_toolss` r#_prepare_requestz-ProviderToolSearchMiddleware._prepare_requestgs(   % &SSuSSSIT7)CDDG &L7;yy7I7ILL!oo%YYYYSXYYYYY N&w}goFF  L 09LL!YYv.G'H'HIILL  S// ! 4 4 4B(0BB99V$=>>??BB  S// !aaaa[`aaa &_ &_T:ST\:]5^5^&_```r"handler|||S)aDefer tools before invoking the model. Args: request: Model request to execute. handler: Callback that executes the model request. Returns: The model call result. Raises: ValueError: If `searchable_tools` references a tool not bound to the model, or if a tool is deferred but the model's provider cannot be identified or does not support server-side tool search. rWr5r7rXs r#wrap_model_callz,ProviderToolSearchMiddleware.wrap_model_calls"&wt,,W55666r"GCallable[[ModelRequest[ContextT]], Awaitable[ModelResponse[ResponseT]]]cNK|||d{VS)aDefer tools before asynchronously invoking the model. Args: request: Model request to execute. handler: Callback that executes the model request. Returns: The model call result. Raises: ValueError: If `searchable_tools` references a tool not bound to the model, or if a tool is deferred but the model's provider cannot be identified or does not support server-side tool search. Nr\r]s r#awrap_model_callz-ProviderToolSearchMiddleware.awrap_model_calls8&WT227;;<<<<<<<<.s- K K KTJtS)) 8DDty K K Kr")setrGs r#r3r3s$ }uu K KU K K KKr"r>BaseTool | dict[str, Any] tool_namesboolct|tsdSt|jtr|jni}|ddup|j|vS)zReturn whether a tool should be deferred. Only `BaseTool` instances can be deferred; dict-form tools (e.g. provider tool specs) have no `extras` or name to match and are never deferred. F defer_loadingT)r;rextrasrQgetrr>rhrls r#rArAsZ dH % %u&t{D99 AT[[rF ::o & &$ . I$)z2IIr"ct||s|St|ts|Si|jpiddi}|d|iS)zReturn the tool with `defer_loading` set, or unchanged if not deferred. Returns the input unchanged when the tool should not be deferred or is not a `BaseTool` (only `BaseTool` instances carry the `extras` that flags deferral). rkTrl)update)rAr;rrl model_copyrns r#rErEsf T: . . dH % % ;" ;_d ; ;F ??8V"4? 5 55r"rNrrOr str | Nonect|dd}t|dd}t|rzt|dd}|t|tsd}||}t|tr0t|tri||n|}t |x}r|St|trt |x}r|St|dd}t|r\|} t| tr=t| dtrt| dSt|j j S)zInfer the normalized provider name for server-side tool search. Returns `None` when no provider can be identified, so callers can distinguish a detection failure from a provider that is simply unsupported. _default_configN _model_paramsconfig_get_ls_params ls_provider) getattrcallabler;rrQ_provider_from_paramsrmr_normalize_provider_provider_from_class_namer6r) rNrOdefault_configmodel_params_fnrv model_paramsparamsrU get_ls_params ls_paramss r#rMrMs U$5t<2\22!  1888x .$''9N~9^9^-^XE#3T::M A!MOO i & & A:immM6R6RTW+X+X A&y'?@@ @ $U_%= > >>r"rdict[str, Any]c|d}t|trt|S|d}t|trt |SdS)z>Infer the provider from model parameters, or `None` if absent.model_providerrNN)rmr;rr|_provider_from_model_name)rrU model_names r#r{r{sjzz*++H(C  -"8,,,G$$J*c""5(444 4r"rrc$|d\}}}|rt|Stj5tjdt t |}dddn #1swxYwY|rt|ndS)z@Infer the provider from a model name, or `None` if unrecognized.:ignoreN) partitionr|warningscatch_warnings simplefilterDeprecationWarningr )rrU_restinferreds r#rrs",,S11Ha -"8,,,  " "==h(:;;;0<<===============-5 > x ( ( ($>s*A44A8;A8 class_namec|dvrdS|dvrdSdS)zFInfer the provider from a model class name, or `None` if unrecognized.> AnthropicChat ChatAnthropicr'> ChatOpenAI OpenAIChatr(Nr!)rs r#r}r}(s)777{111x 4r"rUcR|ddS)zFNormalize a provider identifier by lowercasing and mapping `-` to `_`.-r)replacelower)rUs r#r|r|1s$   C % % + + - --r")rHr-r.rc)r>rgrhrcr.ri)r>rgrhrcr.rg)rNrrOrr.rr)rrr.rr)rrr.rr)rrr.rr)rUrr.r),r __future__rrcollections.abcrtypingrrrlangchain_core.toolsrtyping_extensionsr r langchain.chat_models.baser r r *langchain_core.language_models.chat_modelsrlangchain_core.messagesr!langchain.agents.middleware.typesrrrrrrrrr rr)r+r3rArErMr{rr}r|r!r"r#rs+++""""""######0000000000))))))44444444DDDDDD233333333HHHHHH111111 (N****RI"1'}% ??K=K=K=K=K=?:i3H(T]3]#^K=K=K=\LLLL J J J J 6 6 6 6 "?"?"?"?J ? ? ? ?......r"