tjxTddlmZddlmZddlmZeGddZdS)) dataclass)reduce)_remote_deviceceZdZUdZgdZeeed<eeed<edzed< d deedeede ezdzfdZ dZ dS) ShardMetadataaH Represents a shard of the overall Tensor including its offsets, lengths and device placement. Args: shard_offsets(List[int]): Offsets in the original tensor indicating the start offsets for this shard. Should have the same rank as the original tensor. shard_sizes(List[int]): Integers indicating the size of each dimension for this shard. Should have the same rank as the original tensor. placement(:class:`torch.distributed._remote_device`): Specifies the placement of this shard. ) shard_offsets shard_sizes placementrr Nr c||_||_t|trt ||_n||_t |jt |jkr-tdt |jd|jdtt |jD]B}|j|dkrtd|j|dkrtdCdS)NzMshard_offsets and shard_sizes should have the same number of elements, found z and z respectivelyrzshard_offsets should be >=0zshard_sizes should be >= 0) rr isinstancestrrr len ValueErrorrange)selfrr r is _/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/_shard/metadata.py__init__zShardMetadata.__init__s +& i % % '+I66DNN&DN t! " "c$*:&;&; ; ;769$:L6M6M77'777  s4-..// ? ?A!!$q(( !>???"Q&& !=>>>' ? ?cd}t||jd}t||j|}|||j}|S)Nc,|dzt|zS)N)hash)abs r _hash_reducez,ShardMetadata.__hash__.._hash_reduce9sFd1gg% %r%)rrr r )rrress r__hash__zShardMetadata.__hash__8sS & & &\4#5r::\4#3S99l3// r)N) __name__ __module__ __qualname____doc__ __slots__listint__annotations__rr rrrrrrs  >==I9c$$$$ 26 ??Cy?#Y?'$. ????2rrN) dataclassesr functoolsrtorch.distributed.remote_devicerrr(rrr,sy!!!!!!:::::: 6666666 666r