}tjFR$ dZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z dd l mZmZmZmZdd lmZdd lmZmZdd lmZmZdd lmZmZejeZedZ e !dgd d}dee"edfdee#eddfdee dzeddfdee#eddfded df d!Z$d"e"d e#fd#Z%e !d$gd% d~d"ee"dzed&fd'ee#ed(d)d*fd+ee#ed,d-fd.ee#ed/d0d1fd2eded dfd3Z&d4e"dzd2e"dzd'e#d+e#d.e#de"dzd dfd5Z'd"e"d'e#d+e#d.e#de"dzd df d6Z(e !d7d8d9g ddee"ed:fded dfd;Z)e !dee#ed?d@dAfdBee#edCdDfded df dEZ*e !dFgdG dd"ee"edHfd.ee#ed/d0dIfd>ee#ed?d@dAfdJee#edKdLfdMee+e"dzedNfdOee+e"dzedPfded dfdQZ,e !dRgdS ddTee"edUfdVee"edWfded dfdXZ-e !dYgdZ dd[ee"dzed\fd]ee"dzed^fdWWW I """, #J JZ^%:%:%<%<*.QQQQQQargumentc||tr|ttd}n|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r'rlen)r4paths r2 _is_bucket_idr9msA=))M**,,- $;r3z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchc|duot|}|r,|tjdt|||||dSt ||||||dS)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r4r:r;r<r) namespacer=r:r;r<r)r9r)r* _list_files _list_buckets)r4r:r;r<r=r is_file_modes r2list_cmdrCvsr4'CM(,C,CL  $%NOO O)        )       r3r?c|rtjd|rtjd|K|tr1|t td}|d}t |}fd|||D}tj |dd i dS) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr6r"cg|]:}|j|jrt|jn|j|j|jd;S))r+rsize total_files created_at)r+rrrFrGrH).0bucketr:s r2 z!_list_buckets..se     )~@N_K ^<<t|}|jr t jd|dtd|j}n$d|vr t jd|dtdtjd|d| t| }| || tj d | dS)zDelete a bucket. This deletes the entire bucket and all its contents. Use `hf buckets rm` to remove individual files. z-Cannot specify a prefix for bucket deletion: r#r$r6zInvalid bucket ID: z-. Must be in format namespace/bucket_name or z(Are you sure you want to delete bucket ''?r_r")r`zBucket deleted)rN) r'rrr(r)r*r+rconfirmr delete_bucketr-)rr_r`rr0r/s r2r^r^s-JM**  "9--   $W WW1>WWW I I    a) a a;H a a a   KH9HHHcRRRR 5 ! ! !CiJ777J9555555r3z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.cLt|}|j|j}|dkr|stjddd|s|r|stjdt |} |rt jd} g} | |pdd D]R} t| tr;| | | d t| d S| d t| d |s|r t|| fd| D} n| } d| D}t!d| D}t#|d }|st jddSt|d|}|sP|sNt jdd|Dt jd|ddd|rMt jdfd|Dt jd|ddS| |t jd|dd t||!dS|}|stjd"|r7t jd#t.d$|t jd%dSt jd&|d'd|| |gt jd(|)dS)*zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.r"zListing files from remoteNTrSzListing files from remote (z files))include_patternsexclude_patternscHg|]}|j|S)matchesr8)rIfmatchers r2rKzremove..s,MMM1W__QV5L5LMQMMMr3cg|] }|j Srn)r8rIrps r2rKzremove..s444af444r3c3$K|] }|jV dSN)rFrss r2 zremove..s$77A777777r3)r:zNo files to remove.z file(s) totaling  c3 K|] }d|V dS)z Nrn)rIr8s r2rvzremove..s(BBt{D{{BBBBBBr3zRemove z from 'rbFrcc36K|]}dtd|VdS)delete: r6N)r)rIr8rs r2rvzremove..s:ccPTK-KKKTKKccccccr3z (dry run) z would be removed.)r^zRemoved ')r files_deletedrFzFile path cannot be empty.rzr6z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r8r)rr+r(r)r*rrstatusrX isinstancerappendupdater7donersumrtextjoinrdbatch_bucket_filesr-r)r4r<r_rfrgrhrr0rTr/r} all_filesitem matched_files file_paths total_sizesize_str count_label file_pathrrqs @@r2removerRszx ( (F I  F ||I|  R  R RDM R R R   Q7QIQ !OPPP 5 ! ! !C<H788&( (( >T)   U UD $ ++ U  &&& SC NNSSSTTT I#i..IIIJJJ  &g &#WwWWWGMMMM MMMMM%M44m444 7777777 z$???  H* + + + FZFFHFF  P7 P HTYYBBzBBBBB C C C KC+CCiCCC O O O O   HTYYccccXbccccc d d d HA+AAA B B B F y<<< 7{ 7 79 7 7 7j//         C$%ABB B   HF FyFF9FF G G G H9 : : : F ?y??)???SIIII y)=== > YGGGGGGr3move)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}|jr tjd|dtdt|}|jr tjd|dtdt |}||j|jtj d|j|jdS)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: r#r$r")rrz Bucket movedN) rr(r)r*rr move_bucketr+rr-)rrr parsed_from parsed_tor/s r2rrs2$G,,K   S S S-: S S S   "%((I   S S S-: S S S   5 ! ! !COOKN),O???J~{~Y\JJJJJJr3sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzrs >= ######"!!!!! ::::::::((((((((&&&&&&&&  H % %m!EFFF     0   90R0R g    0R  +    0R t w     0R*  F    +0R8 90R: ;0R0R0R  0RfCD     0    E> >  d W    >    7    > $  F    %> 2   C    3> B C> D E> F G> > > > B 3Tz 3 $J 3 3 3  3 : 3  3 3 3 3Fcccc c : c  cccc0  (5 " " Y     "  "  " " " "   .  -.6.6 Y    .6    ,     .6  F    .6, -.6. /.6.6.6.6b    6    [HH a    H   C    H$    ,     %H4  K    5HB S Dd    CHN S D_    OHZ [H\ ]HHH  HD  *"K"K  `    "K  e     "K "K "K"K"K"KT       &         yrPrP  d ^     rP  d c     rP  B     rP&  N    'rP4  O    5rPB  d P     CrPN  d 6     OrPZ  H    [rPh S DI    irPt S DI    urP@ d ;    ArPL  T    MrPZ  V    [rPh   8    irPx yrPz {rPrPrP  rPv      ')r3