tj vUddlmZgZeeed<dededefdZdededeee e e e ffd Z d S) )ChunkStorageMetadata__all__shard1shard2returnct|j}t|D]\}|j||j||j|zkrdS|j||j||j|zkrdS]dS)zCheck if two shards overlap.FT)lenoffsetsrangesizes)rrndimsis e/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/checkpoint/resharding.py"_check_shard_metadata_pair_overlaprs   E 5\\ >! q 1FLO C C C55 >! q 1FLO C C C55 D 4 saved_shard current_shardc4g}tt|j|j|j|jD]a\}\}}}}t ||z||z}|t ||z } ||krd} ||z } n||z } d} ||| | | fb|S)aY Return the overlapping region between saved_shard and current_shard. The returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r) enumeratezipr r minmaxappend) rrnarrowsdimsaved_shard_offsetcurrent_shard_offsetsaved_shard_sizecurrent_shard_size min_range_endlengthoffset_for_saved_tensoroffset_for_current_tensors r+_shards_get_overlap_region_wrt_saved_tensorr$sG     !              !1 1 #5 5  %9;M!N!NN  4 4 4&' #(:=Q(Q % %&:=O&O #() % )+Df M     NrN) %torch.distributed.checkpoint.metadatarrliststr__annotations__boolrtupleintr$rrr-sFFFFFFFc *> $,%,6J, %S#s" #$,,,,,,r