tjM#|ddlmZmZgdZgdZedddgedded d geed d ged ddgeddedddgeddedeeddedeedddgedddged d!ged"d#d$ged%d&d'ged(d)ed*d+ed,d d-d.ged/d0d1d2ed3d4d56ed7d8d59ed:d;d59edd?ed@dAedBdCedDdEedFdGedHdIedJdKd56edLdMedNdOd56edPdQedRdSedTdUd59edVdWd59edXdYd56edZd[d59ed\d]ed^d_d56ed`dad5d5bedcddd56ededfd56edgdhedidjd5d5kedldmd5d5kedndod59edpd8d59edqd8d59edrd8d59edsdtd59edudvd59edwdvd59edxdyd59edzd{d59ed|d}d59ed~dd59eddd59eddd59eddd59eddd59eddd59eddd59eddd59eddd59eddd59eddd59eddd8eddd59dS))register_artifact register_log)z%torch.fx.experimental.symbolic_shapesztorch.fx.experimental.sym_nodeztorch.fx.experimental.recording)ztorch.distributed"torch._dynamo.backends.distributedtorch.nn.parallel.distributed async_compileztorch._inductor.async_compilez3torch._inductor.compile_worker.tracked_process_poolcache)ztorch._inductor.remote_cacheztorch._inductor.fb.remote_cachedynamoz torch._dynamo fake_tensorztorch._subclasses.fake_tensoraotztorch._functorch.aot_autogradztorch._functorch._aot_autogradautogradztorch.autogradinductorztorch._inductorztorch._inductor.cudagraph_trees cudagraphszGLogs information from wrapping inductor generated code with cudagraphs.dynamictorch distributedc10dz"torch.distributed.distributed_c10dztorch.distributed.rendezvousddprrppztorch.distributed.pipeliningfsdpztorch.distributed.fsdpz"torch.distributed._composable.fsdpdtensorztorch.distributed._tensorztorch.distributed.tensoronnxz torch.onnx native_dslz torch._nativeexportz torch.exportztorch.export.dynamic_shapesztorch._export.converterztorch._export.non_strict_utilsztorch._export.serde.serializez"torch.fx.experimental.proxy_tensorguardszhThis prints the guards for every compiled Dynamo frame. It does not tell you where the guards come from.T)visibleverbose_guards)off_by_defaultbytecodez{Prints the original and modified bytecode from Dynamo. Mostly useful if you're debugging our bytecode generation in Dynamo.graphzvPrints the dynamo traced graph (prior to AOTDispatch) in a table. If you prefer python code use `graph_code` instead. graph_codez4Like `graph`, but gives you the Python code instead.graph_code_verbosezLVerbose FX pass logs, e.g. from tensorify_python_scalars and runtime_assert. graph_sizesz5Prints the sizes of all FX nodes in the dynamo graph. trace_sourcezAs we execute bytecode, prints the file name / line number we are processing and the actual source code. Useful with `bytecode` trace_callzhLike trace_source, but it will give you the per-expression blow-by-blow if your Python is recent enough.trace_bytecodezCAs we trace bytecode, prints the instruction and the current stack. aot_graphszPrints the FX forward and backward graph generated by AOTDispatch, after partitioning. Useful to understand what's being given to Inductoraot_joint_graphz_Print FX joint graph from AOTAutograd, prior to partitioning. Useful for debugging partitioningaot_graphs_effectszkPrints the FX forward and backward graph generated by AOTDispatch, useful for debugging effects processing.pre_grad_graphsz{Prints the FX graph before inductor pre grad passes. Useful to understand what's being given to Inductor before grad passespost_grad_graphsz}Prints the FX graph generated by post grad passes. Useful to understand what's being given to Inductor after post grad passes ir_pre_fusionz,Prints the IR before inductor fusion passes.ir_post_fusionz+Prints the IR after inductor fusion passes.compiled_autogradzzPrints various logs in compiled_autograd, including but not limited to the graphs. Useful for debugging compiled_autograd.compiled_autograd_verbosezjWill affect performance. Prints compiled_autograd logs with C++ info e.g. autograd node -> fx node mapping ddp_graphszOnly relevant for compiling DDP. DDP splits into multiple graphs to trigger comms early. This will print each individual graph here. recompilesz?Prints the reason why we recompiled a graph. Very, very useful.recompiles_verbosezPrints all guard checks that fail during a recompilation. At runtime, Dynamo will stop at the first failed check for each failing guard. So not all logged failing checks are actually ran by Dynamo.)rr graph_breakszPrints whenever Dynamo decides that it needs to graph break (i.e. create a new graph). Useful for debugging why torch.compile has poor performance side_effectszPrints all side effects that Dynamo codegenerates, including mutations to variables, attributes, cells, and globals. Useful for debugging side effect handlingnot_implementedzPrints log messages whenever we return NotImplemented in a multi-dispatch, letting you trace through each object we attempted to dispatch to output_codez>Prints the code that Inductor generates (either Triton or C++))rr kernel_codez?Prints the code that Inductor generates (on a per-kernel basis)schedulezIInductor scheduler information. Useful if working on Inductor fusion algo perf_hintsonnx_diagnosticscompute_dependenciesfusionzADetailed Inductor fusion decisions. More detailed than 'schedule' loop_orderingzLogs related to loop ordering loop_tiling auto_chunkerz Logs related to the auto chunkeroverlapz0Detailed Inductor compute/comm overlap decisionsoverlap_schedulingz5Detailed Inductor overlap scheduling pass informationsym_nodez.Logs extra info for various SymNode operationstrace_shape_eventszBLogs traces for every ShapeEnv operation that we record for replaycudagraph_static_inputsz:Logs static inputs handling in dynamo, AOT, and cudagraphs benchmarkingz+Detailed Inductor benchmarking information. incrementalzIncremental autotuning logs.node_runtime_estimationz@Node runtime estimation for compile-time optimization decisions. autotuningzKAutotuning choice logs, such as kernel source, perf, and tuning parameters.graph_region_expansionzMLogs detailed steps of the duplicate graph region tracker expansion algorithminductor_metricszGLogs Inductor metrics, such as num_bytes, nodes_num_elem, node_runtimeshierarchical_compilez,Logs debug info for hierarchical compilation annotationz=Logs detailed steps of the creating annotation on graph nodescustom_format_test_artifactz Testing only) log_formatcachingz&Detailed Inductor caching information.N) _internalrrDYNAMIC DISTRIBUTED[/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/_logging/_registrations.pyrVs 66666666      '=  P X2'2333 ]<=>>> U46VWXXX Z)*** Z+-NOPPPM  Y Wg ]K(((  13Q R  +-Q R T23444 V.0TUVVV Y46PQRRR V\""" \?+++  %    "  )  (  -     n  "Bt<<<<B  |, VWWWRJFnIQ  eq  BD2 1 A  p KE  C  Y  e  SD   E   O ,48888$b>>>>("TBBBB G # # &  6 ; 4 H @ 1 " F Q S M 2 C /BOOOO ,rT