tjHdZddlZddlZddlmZmZddlmZddlm Z m Z ddl m Z Gddej Ze Gd d Ze Gd d ZeZd eegdfdeegdffdZd eegdfdeegdffdZdS)a  This module provides callback management functionality for TorchDynamo's compilation process. It implements a thread-safe system for registering, managing and executing callbacks that run at the start and end of TorchDynamo compilations. Key features include: - Registration and deregistration of compilation callbacks - Thread-safe callback handling with proper locking mechanisms - Prevention of duplicate callback execution when configured - Decorator utilities for easy callback registration - Context manager for controlled callback lifecycle The module centers around the CompilationCallbackHandler class which maintains separate lists for start and end callbacks, manages their execution order, and ensures thread-safety. Utility decorators @on_compile_start and @on_compile_end provide a convenient way to register compilation hooks. Example usage: @on_compile_start def my_start_callback(): print("Starting compilation") @on_compile_end def my_end_callback(): print("Compilation complete") N)Callable Generator)contextmanager) dataclassfield)AnyceZdZdZdZdZdZdS)CallbackTriggerN)__name__ __module__ __qualname__DYNAMO LAZY_BACKWARDTRITON_AUTOTUNINGCUDAGRAPH_RECORDINGT/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/_dynamo/callback.pyr r $s& FMrr c$eZdZUeed<eed<dS) CallbackArgscallback_trigger compile_idN)rrrr __annotations__strrrrrr/s%%%%%OOOOOrrc eZdZUeeZeeegdfed<eeZ eeegdfed<edddZ e ed<ee j dd Ze j ed <d eegdfd eegdffd Zd eegdfd eegdffdZd eegdfd dfdZd eegdfd dfdZded dfdZded dfdZededed edeeffdZddZdS)CompilationCallbackHandler)default_factoryNstart_callbacks end_callbacksrF)defaultinitrepr6_CompilationCallbackHandler__pending_callbacks_counter)r!r%r&;_CompilationCallbackHandler__pending_callbacks_counter_lockcallbackreturnc:|j||S)z Register a callback function to be called when the compilation starts. Args: - callback (Callable): The callback function to register. )r"appendselfr)s rregister_start_callbackz2CompilationCallbackHandler.register_start_callback?s  ##H---rc:|j||S)z Register a callback function to be called when the compilation ends. Args: - callback (Callable): The callback function to register. )r#r,r-s rregister_end_callbackz0CompilationCallbackHandler.register_end_callbackKs  !!(+++rc:|j|dS)z Remove a registered start callback function. Args: - callback (Callable): The callback function to remove. N)r"remover-s rremove_start_callbackz0CompilationCallbackHandler.remove_start_callbackWs! ##H-----rc:|j|dS)z Remove a registered end callback function. Args: - callback (Callable): The callback function to remove. N)r#r3r-s rremove_end_callbackz.CompilationCallbackHandler.remove_end_callback`s! !!(+++++rargsc0|jD] }||dS)z9 Execute all registered start callbacks. N)r"r.r7r)s rrun_start_callbacksz.CompilationCallbackHandler.run_start_callbacksis/,  H HTNNNN  rc0|jD] }||dS)z7 Execute all registered end callbacks. N)r#r9s rrun_end_callbacksz,CompilationCallbackHandler.run_end_callbacksps/*  H HTNNNN  rtriggerrc#Kt||} |j5|xjdz c_|jdkr||dddn #1swxYwYdV|j5|jdkrt d|jdkr|||xjdzc_ddddS#1swxYwYdS#|j5|jdkrt d|jdkr|||xjdzc_dddw#1swxYwYwxYw)zc Context manager to install the callbacks and run them when the context is exited. r Nrz1Pending callbacks counter cannot become negative.)rr(r'r:AssertionErrorr<)r.r=rr7s rinstall_callbacksz,CompilationCallbackHandler.install_callbackswsDGZ00 66 3 300A5003q88,,T222 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 EEE6 6 63q88(K3q88**400000A500 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 66 6 63q88(K3q88**400000A500 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6sfC1A CACA C.A CC  C D>A D2& D>2D6 6D>9D6 :D>c|j|j|jdkrt d|jddS)z1 Clear all registered callbacks. rzCannot clear callbacks while z are pendingN)r"clearr#r'r?)r.s rrBz CompilationCallbackHandler.clearsg ""$$$   """  +q 0 0 ^0P^^^  1 0r)r*N)rrrrlistr"rrrr#r'int threadingLockr(r/r1r4r6r:r<rr rrrr@rBrrrr r 5s94#789WWW:?%PT:U:U:UM4,!567UUU',uQU'O'O'OOOO7 "666^6.      rr r)r*c:t||S)zU Decorator to register a callback function for the start of the compilation. )callback_handlerr/r)s ron_compile_startrJs ,,X666 Orc:t||S)zS Decorator to register a callback function for the end of the compilation. )rHr1rIs ron_compile_endrLs **8444 Or)__doc__enumrEcollections.abcrr contextlibr dataclassesrrtypingrEnumr rr rHrJrLrrrrTs6 ////////%%%%%%((((((((di    bbbbbbb bJ.-// ~t+, |nd"# ~t+, |nd"#r