tj&vddlZdgZeZdZeejdrejjZdZGddeZdS)N GreenContextF_CUDAGreenContextTc eZdZdZeddddddedzdedzdedzdedzdef d Zeddedzdefd Z dfd Z dfd Z dfd Z xZ S)rzyWrapper around a CUDA green context. .. warning:: This API is in beta and may change in future releases. Nnum_smsworkqueue_scopeworkqueue_concurrency_limit device_idrrr r returncjtstdt||||S)a+Create a CUDA green context. At least one of ``num_sms`` or ``workqueue_scope`` must be specified. Both can be combined to partition SMs and configure workqueues in the same green context. Arguments: num_sms (int, optional): The number of SMs to use in the green context. When ``None``, SMs are not partitioned. workqueue_scope (str, optional): Workqueue sharing scope. One of ``"device_ctx"`` (shared across all contexts, default driver behaviour) or ``"balanced"`` (non-overlapping workqueues with other balanced green contexts). When ``None``, no workqueue configuration is applied. workqueue_concurrency_limit (int, optional): Maximum number of concurrent stream-ordered workloads for the workqueue. Requires ``workqueue_scope`` to be set. device_id (int, optional): The device index of green context. When ``None``, the current device is used. 1PyTorch was not built with Green Context support!)r rrr ) SUPPORTED RuntimeError _GreenContextcreaters W/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/cuda/green_contexts.pyrzGreenContext.createsE8 TRSS S##+(C $   cdtstdt|S)awReturn the maximum workqueue concurrency limit for the device. This queries the device for the default number of concurrent stream-ordered workloads supported by workqueue configuration resources. Arguments: device_id (int, optional): The device index to query. When ``None``, the current device is used. r r )rrrmax_workqueue_concurrencyrs rrz&GreenContext.max_workqueue_concurrency>s3 TRSS S666KKKrcDtS)z+Make the green context the current context.)super set_contextself __class__s rrzGreenContext.set_contextPsww""$$$rcDtS)zAssuming the green context is the current context, pop it from the context stack and restore the previous context. )r pop_contextrs rrzGreenContext.pop_contextTsww""$$$rtorch.cuda.StreamcDtS)z1Return the CUDA Stream used by the green context.)rStreamrs rr!zGreenContext.StreamZsww~~r)N)r N)r r)__name__ __module__ __qualname____doc__ staticmethodintstrrrrrrr! __classcell__)rs@rrrs: #&*26 $ " " " t" t" &)4Z " : "  " " " \" H L LS4Z L3 L L L\ L"%%%%%%%%%%%%           r) torch__all__objectrrhasattr_Crrrrr0s     758())H.MI J J J J J =J J J J J r