tj(ddlZGddZdS)NceZdZdZdeejzfdZedZ dedzfdZ de dzfdZ dejfd Zd Z d Zd ZdS) _remote_devicea@ Represents a device on a remote worker. Args: remote_device (str or torch.device): Represents a device on a remote worker. The string format should be one of the following: 1. "/", where the device field can be parsed as torch.device type. E.g., "trainer0/cpu", "trainer0", "ps0/cuda:0". In addition, the device field can be optional and the default value is "cpu". 2. "rank:/", where is the rank of the process and device can be parsed as torch.device type. E.g., "rank:0/cpu", "rank:0", "rank:0/cuda:0" 3. and are optional and formats like "cpu" and "cuda:1", just represent local devices. remote_devicecd|d}d|_d|_d|_t|tjr||_nt|t r|d}t|dkr|\|_|_nt|dkrCt |dr|d|_nC|d|_d|_n.t|tdt||j|jst|t j|j|_|j|jd }t|dkrX|dd kr=|dr#t|d|_d|_dSt|t|dkrt|dSdS) NzCould not parse remote_device: zU. The valid format is '/' or 'rank:/' or ''/rcpuz Invalid type for remote_device: :rank) _worker_name_rank_device isinstancetorchdevicestrsplitlenr_is_valid_local_device ValueError TypeErrortypeisdigitint)selfr PARSE_ERRORfieldss ]/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/remote_device.py__init__z_remote_device.__init__s Nm N N N ! 8< mU\ 2 2 V(DLL  s + + V"((--F6{{a28/!4<<V!!!88CC)#)!9DLL(.q D%#(DLL ---TtM?R?RTTUU U   (1B ([)) )|DL11    (&,,S11F6{{a!9&&6!9+<+<+>+>&!$VAYDJ(,D%%%$[111Vq --- ) (!cR tj|dS#t$rYdSwxYw)NTF)rr Exception)rs rrz%_remote_device._is_valid_local_deviceGs>  L 4   55 s  &&returnNc|jS)zlReturn the name of remote worker representing the remote device and ``None`` if no worker name is available.)r rs r worker_namez_remote_device.worker_namePs   r!c|jS)z Returns the rank of remote worker representing the remote device. Returns ``None`` if no rank is available. )rr&s rr z_remote_device.rankTs zr!c|jS)z-Return the local device on the remote worker.)rr&s rrz_remote_device.device[s |r!c|jE|j|jd|jS|jd|jd|jSt|jS|j|jS|j|jSt d)Nrzrank:zInvalid state!)rr rr RuntimeErrorr&s r__repr__z_remote_device.__repr___s < # ,+<N>NNNr!)__name__ __module__ __qualname____doc__rrrr staticmethodrr'rr r,r0r3r!rrrs"-.cEL&8-.-.-.-.^\!S4Z!!!!cDj 555    OOOOOr!r)rrr9r!rr:sV qOqOqOqOqOqOqOqOqOqOr!