Otj)&ddlZddlZddlmZddlmZddlmZddlm Z m Z m Z ddl m Z ddlmZdd lmZmZd Zd efd Zd edeeeefd efdZd ed dfdZ d$dddddddeedeedeed eedeeeefdeeee fd eefdZd$deed dfdZd%deeded dfdZd&deedeed dfd Z d'deedeedeed eedeedeeee ff d!Z d$ddddddd"deedeedeed eedeedeeee ff d#ZdS)(N)proton)getenv)flags) HookManager LaunchHookInstrumentationHook)Hook)BaseMode)OptionalUnionrreturnctjjjj}|dkrdS|dkrdSt d)Ncudacuptihip roctracerz/No backend is available for the current target.)tritonruntimedriveractiveget_current_targetbackend ValueError)rs U/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/triton/profiler/profile.py_select_backendrsMn#*==??GG&w E  {JKKKrmodec|dkr8tjjjj}|r|d|n|S|rt |ndS)Ninstrumentation:)rrrrrrstr)rrprefixs r _get_mode_strr%s]###&-@@BBJ%)5&!!4!!!v5 $3t999"$rc|dkr,ddg}|D]%}t|dtd|d&tjjjD]\}}|j}t|dhttjj|}|Gtj |x}r&tj ||ddS)NrHIP_VISIBLE_DEVICESCUDA_VISIBLE_DEVICESz3Proton does not work when the environment variable zK is set on AMD GPUs. Please unset it and use `ROCR_VISIBLE_DEVICES` insteadr) rrrknobsrknob_descriptorsitemskeygetattrtoenvsetenv)rhip_device_envsenvattrdescr,valenv_vals r _check_envr6 s+02HI"  Cc4  , [#[[[- l):@@BB99 dh #t   $&,-t44C$l0055579L''WQZ888 99rshadowtreecontextdatarrhooknamer:r;r<c,tjstjjjrdSdt_|tn|}|tn|}t||}t|tj |||||}t|trtj||n<|dkr"tjt#|n|t%d||dkr"tjt'|||S)a- Start profiling with the given name and backend. Usage: ```python proton.start("my_profile") # do something proton.finalize() ``` Args: name (str, optional): The name (with path) of the profiling session. If not provided, the default name is "~/proton.", where suffix is the default format according to the data type. For example, if data is "tree", the default name is "~/proton.hatchet". context (str, optional): The context to use for profiling. Available options are ["shadow", "python"]. Defaults to "shadow". data (str, optional): The data structure to use for profiling. Available options are ["tree", "trace"]. Defaults to "tree". backend (str, optional): The backend to use for profiling. Available options are [None, "cupti", "roctracer", "instrumentation"]. Defaults to None, which automatically selects the backend matching the current active runtime. mode (Union[str, BaseMode], optional): The "mode" to use for profiling, which is specific to the backend. Can be a string or an instance of BaseMode (or any subclass thereof). Defaults to None. For "cupti", available options are [None, "pcsampling", "periodic_flushing"]. For "roctracer", available options are ["periodic_flushing"]. For "instrumentation", available options are [None]. Each mode has a set of control knobs following with the mode name. For example, "periodic_flushing" mode has a knob: - format: The output format of the profiling results. Available options are ["hatchet", "hatchet_msgpack", "chrome_trace"]. Default is "hatchet". The can be set via `mode="periodic_flushing:format=chrome_trace"`. hook (Union[str, Hook], optional): The hook to use for profiling. You may pass either: - a string hook name, e.g. "triton" (kernel launch metadata), or - a custom Hook instance. Defaults to None. Returns: session (Optional[int]): The session ID of the profiling session, or None if profiling is disabled. NTrzUnsupported hook: r )r command_linerr)rdisable profiling_onDEFAULT_PROFILE_NAMErr%r6 libprotonstart isinstancer rregisterrrr )r=r:r;rrr<mode_strsessions rrDrD3sf V\08tE#'<  TD#*?oGWd++HwodGT7HEEG$8T7++++   Z\\73333 6d66777###066@@@ NrrHctjr|dkrtdtj||t jdSt j|dS)z Activate the specified session. The profiling session will be active and data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzEOnly one session can be activated when running from the command line.N)rr?rractivaterC activate_all)rHs rrJrJsi bgll`aaa!!!     7#####rFflushingctjr|dkrtdtj||t j|dSt j||dS)ap Stop the specified session. The profiling session's data will still be in the memory, but no more data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) flushing (bool): Whether to flush the profiling data before deactivating. Defaults to True. Returns: None rzGOnly one session can be deactivated when running from the command line.N)rr?rr deactivaterCdeactivate_all)rHrLs rrNrNsm dgllbccc7### *****Wh/////rr" output_formatctj||"dt_t j|dStjr|dkrtdt j||dS)a Finalizes a profiling session. Flush and write the profiling data to the file specified by the session name. Args: session (int, optional): The session ID to finalize. If None, all sessions are finalized. Defaults to None. output_format (str, optional): The output format for the profiling results. Available options are ["hatchet", "hatchet_msgpack", "chrome_trace"]. Returns: None NFrzEOnly one session can be finalized when running from the command line.) r unregisterrrArC finalize_allr?rfinalize)rHrPs rrTrTsu7###"}-----   f'Q,,dee e7M22222rc^tjfd}|S)z Context manager for profiling. Internally use only. Args: See start() for the arguments. Returns: wrapper (function): The wrapped function. c`t  }|i|}t||S)Nr9)rDrN) argskwargsrHretrr:r;funcr<rr=s rwrapperz_profiling..wrappersFgD'PT[_```dD#F##7 r) functoolswraps)rZr=r:r;rrr<r[s``````` r _profilingr^s^&_T Nrr=r:r;rrr<c V| fd}|St|S)z Decorator for profiling. Usage: ```python @proton.profile def foo(): pass ``` Args: See start() for the arguments. Returns: decorator (function): The decorator function. Nc 0t|S)Nr_r^)frr:r;r<rr=s r decoratorzprofile..decorators#adG$PW^bimnnn nrr_rb)rZr=r:r;rrr<rds `````` rprofilerest6 | o o o o o o o o o o$T7w]ahlmmmmr)N)NF)Nr")Nr7r8NNN) r\rtriton._C.libprotonrrCtriton._C.libtritonrrhooksrrr hooks.hookr rr typingr r rBr#rr%r6intrDrJboolrNrTr^rerrrns 333333&&&&&&??????????""""""""LLLLL%3%huS(]/C&D%%%%%999999(K& !+/'+KKK 3-Kc]K 3- K c] K 5h' ( K 5d# $Kc]KKKK\$$hsm$t$$$$,00 000000.33hsm38C=3RV33334% !'+ 3-c] 3-  c]  3-  5d# $< #n% !'+#n#n#n 3-#nc] #n 3- #n c] #n 3-#n 5d# $#n#n#n#n#n#nr