tjoDUdZddlZddlmZddlmZmZejeZ GddeZ ede dzfZ edZ ia eee fed <daeee fdzed <d ee zd e d dfdZd ee zd dfdZd eefdZd edzfdZdded dfdZdS)zRegistry for flash attention implementations. This module contains the registration system for flash attention implementations. It has no torch dependencies to avoid circular imports during initialization. N)Callable)LiteralProtocolceZdZddZdS)FlashAttentionHandlereturnNcdS)N)selfs Z/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/nn/attention/_registry.pyremovezFlashAttentionHandle.removes)rN)__name__ __module__ __qualname__r r rr rrs!!!!!!rr.)FA3FA4_FLASH_ATTENTION_IMPLS_FLASH_ATTENTION_ACTIVEimpl register_fnrc|t|<dS)a# Register the callable that activates a flash attention impl. .. note:: This function is intended for SDPA backend providers to register their implementations. End users should use :func:`activate_flash_attention_impl` to activate a registered implementation. Args: impl: Implementation identifier (e.g., ``"FA4"``). register_fn: Callable that performs the actual dispatcher registration. This function will be invoked by :func:`activate_flash_attention_impl` and should register custom kernels with the PyTorch dispatcher. It may optionally return a handle implementing :class:`FlashAttentionHandle` to keep any necessary state alive. Example: >>> def my_impl_register(module_path: str = "my_flash_impl"): ... # Register custom kernels with torch dispatcher ... pass # doctest: +SKIP >>> register_flash_attention_impl( ... "MyImpl", register_fn=my_impl_register ... ) # doctest: +SKIP N)r)rrs r register_flash_attention_implrs<$/4   rctdt|}|!td|dt |}|||fadSdS)ac Activate into the dispatcher a previously registered flash attention impl. .. note:: Backend providers should NOT automatically activate their implementation on import. Users should explicitly opt-in by calling this function or via environment variables to ensure multiple provider libraries can coexist. Args: impl: Implementation identifier to activate. See :func:`~torch.nn.attention.list_flash_attention_impls` for available implementations. If the backend's :func:`register_flash_attention_impl` callable returns a :class:`FlashAttentionHandle`, the registry keeps that handle alive for the lifetime of the process (until explicit uninstall support exists). Example: >>> activate_flash_attention_impl("FA4") # doctest: +SKIP F) _raise_warnNzUnknown flash attention impl 'z'. Available implementations: )restore_flash_attention_implrget ValueErrorlist_flash_attention_implsr)rrhandles r activate_flash_attention_implr!=s2!),,T22K IT I I*D*F*F I I   []]F #'.rcNttS)zBReturn the names of all available flash attention implementations.)sortedrkeysr rr rrfs (--// 0 00rc8t tdntS)z Return the currently activated flash attention impl name, if any. ``None`` indicates that no custom impl has been activated. Nr)rr rr current_flash_attention_implr&ks # . "" $rTrcd}t td}||n|rtddadS)z0 Restore the default FA2 implementation NzDTrying to restore default FA2 impl when no custom impl was activated)rr loggerwarning)rr s r rrxs] F*(+     R   #r)T)__doc__loggingcollections.abcrtypingrr getLoggerrr)r _RegisterFn_FlashAttentionImplrdictstr__annotations__rtuplerr!listrr&boolrr rr r8s $$$$$$$$$$$$$$  8 $ $"""""8"""s04778 l+13S+-.333CGs$889D@GGG/ # #// ////B&1 # #&1 &1&1&1&1R1DI1111 cDj    ##d#d######r