tjdZddlmZddlZddlmZmZddlmZddede e effd Z ddede fd Z ddede fd Zddeddfd Zgd ZdS)zKThis package adds support for device memory management implemented in MTIA.)AnyN)Deviceis_initialized)_get_device_indexdevicereturnc~tsiStjt |dS)aReturn a dictionary of MTIA memory allocator statistics for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Toptional)rtorch_C_mtia_memoryStatsrrs O/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/mtia/memory.py memory_statsr s;    8 % %&7&N&N&N O OOctsdSt|ddddS)aReturn the maximum memory allocated in bytes for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). rdram peak_bytesrrgetrs rmax_memory_allocatedrsE   q    # #FA . . 2 2< C CCrctsdSt|ddddS)a?Return the current MTIA memory occupied by tensors in bytes for a given device. Args: device (torch.device or int or str, optional): selected device. Returns statistic for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). rrallocated_bytesrrs rmemory_allocatedr'sF   q    # #FA . . 2 23Da H HHrctsdStjt |ddS)aReset the peak memory stats for a given device. Args: device (torch.device, str, or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). NTr )rr r_mtia_resetPeakMemoryStatsrrs rreset_peak_memory_statsr4sA    H''(9&4(P(P(PQQQQQr)rrrr)N)__doc__typingrr rr_utilsrdictstrrintrrr__all__rrr)s(SR $$$$$$$$%%%%%% P P P4S> P P P P D D D3 D D D D I IV Is I I I I R RF Rd R R R R   r