}tjG dZddlZddlZddlmZddlmZmZmZddl Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZmZdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&dd l'm(Z(m)Z)dd l*m+Z+dd l,m-Z-m.Z.e&d Z/e&dZ0e/1e0de&dZ2e/1e2dee3e(dfZ4ede3de3dzde3dzdeefdZ5e/6dgd dsdee3dze(dfdee3dze)d d!fd"e-d#ee3dze)d$fd%ed&e d'ed(ed)e"de.d*ee7e)d+d,fde!ddfd-Z8e/6d.d/d0id1d2g3 dtde4d4ee9e3e(d5fd6ee3dze)d7d8d9fd%ed'ed:ee:dze)d;d<fde.de!ddfd=Z;e/6d>d/d0id?d@g3 dude4d4ee9e3e(dAfd6ee3dze)d7d8d9fd%ed'ede.de!ddfdBZe06dgdVdde ddddfdee3dze(dWfd"e-dXee?e)dYddZe d[\fd]ee?dze)d^dd_\fd#ee3dze)d`fde.de!ddfdaZ@e06dbdcg dvde.de!ddfddZAe06dedfg dxdgee3e(dhfdQee7e)dRdSdTfde.de!ddf diZBdje3e9e3zde3fdkZCdede3fdlZDe26dbdmg dvde4de.de!ddfdnZEe26dKdog dvde4dpee?e(dqfde.de!ddf drZFdS)yzCContains commands to run and manage sandboxes on Hugging Face Jobs.N)contextmanager) AnnotatedAnyIterator) DEFAULT_IDLE_TIMEOUT DEFAULT_IMAGEDEFAULT_SANDBOXES_PER_HOST MODE_LABEL MODE_POOL POOL_LABEL SANDBOX_LABEL SHARED_ID_SEPSandbox SandboxPoolSandboxProcess_split_sandbox_id)delete_pool_cache)CLIError SandboxError) EnvFileOptEnvOptSecretsFileOpt SecretsOptTokenOpt VolumesOpt get_hf_api parse_env_map parse_volumes typer_factory)ArgumentOption)out) FlavorOpt NamespaceOptz.Run and manage sandboxes on Hugging Face Jobs.)helpzBWarm pools of host VMs and spawn cheap shared sandboxes from them.pool)namez8List and stop background processes running in a sandbox.processz1The sandbox id as printed by `hf sandbox create`. sandbox_id namespacetokenreturnc#Ktj|||} |V|dS#|wxYw)zIReattach to a sandbox and close the HTTP client when the command is done.r+r,N)rconnectclose)r*r+r,sandboxs Y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/huggingface_hub/cli/sandbox.py_connectr4BsOojIUKKKG   s 5A create)zhf sandbox createzhf sandbox create ubuntu:24.04z%hf sandbox create --flavor a10g-smallz@hf sandbox create --pool pool-ab12cd34ef56 --env LOG_LEVEL=debug)examplesFimagezDocker image (needs /bin/sh).z--poolzJSpawn a cheap shared sandbox in this pool (from `hf sandbox pool create`).flavor idle_timeoutzTAuto-terminate the sandbox after this much inactivity (e.g. '10m'). Defaults to 10m.envsecretsenv_file secrets_filevolumeforward_hf_tokenz--forward-hf-tokenz0Inject your HF token as HF_TOKEN in the sandbox.c tj} ||nt} ||||rtd|s|rtdtj|| | t ||| | }tjd|j |j |tj| z dd tj d |j d tj d |j d dStj|pt|pd| t ||t ||t|| | |  }|tjd|j |jtj| z ddtj d |j d tj d |j d dS)aCreate a sandbox: a dedicated VM by default, or a cheap shared one with `--pool`. Env and idle-timeout apply to the sandbox in both modes. With `--pool`, the image and flavor come from the pool, so passing them here is an error; `--secrets` is also rejected since pooled sandboxes have no encrypted-secrets channel (use `--env`). Define a pool first with `hf sandbox pool create`. NzQ--pool fixes the image/flavor (and volumes aren't supported); drop those options.zF--pool can't encrypt secrets; pass them with --env/--env-file instead.r/)r:r9r?z Sandbox ready.1fs)idhostr'elapsedz$Run a command with `hf sandbox exec z -- echo hello`.z#Terminate it with `hf sandbox kill `. cpu-basic) r7r8r9r:r;volumesr+r?r,)rCr7rE)timerrrr0r5rr#resultrChost_idhintrrrr1r7)r7r'r8r9r:r;r<r=r>r+r?r,startidlesbxr2s r3sandbox_createrPLsL IKKE'3<<9MD    2f 2noo o  el ecdd d!$)5IIIPPc8,,-Q   ?svCKdW[W`WbWbejWjTqTqTqTqrrrr PPPPQQQ AsvAAABBBn$}$ #x ( (g|44f%%)   G MMOOOJ7:W]ty{{]bObLiLiLiLijjjjH PGJ P P PQQQH A7: A A ABBBBBexecignore_unknown_optionsTz5hf sandbox exec -- python -c "print(42)"z1hf sandbox exec -w /app -- pytest -x)context_settingsr6commandzThe command to run.workdirz-wz --workdirzWorking directory. exec_timeoutz --timeoutz)Kill the command after this many seconds.c dtddfd}dtddfd} t|||5} | t|t |||||| d} dddn #1swxYwY| jr?t jd |d tj | j pd | j d kr.tj | j | j nd dS)zRun a command in a sandbox, streaming output. Exits with the command's exit code. To start a long-running command in the background instead of waiting for it, use `hf sandbox spawn`. datar-Nctj|tjdSN)sysstdoutwriteflushrYs r3 write_stdoutz"sandbox_exec..write_stdout2  rQctj|tjdSr[)r\stderrr^r_r`s r3 write_stderrz"sandbox_exec..write_stderrrbrQr/F)r:cwdtimeout on_stdout on_stderrcheckzCommand timed out after zs.|)coderr) strr4runlistr timed_outr#errorclick exceptionsExit exit_code) r*rUrVr:r<rWr+r,rarer2rJs r3 sandbox_execrvsy43434 *  ? ? ?  7 MMc8,, ""                  B =\===>>>##)9)@S#AAA 1##V=M=Y)9)9_`#aaas8A11A58A5spawnz;hf sandbox spawn -- python -m http.server 8000z8hf sandbox spawn -w /app -- uvicorn app:appz%The command to run in the background.cjt|||5}|t|t|||d}dddn #1swxYwYt jd||jt jd|dt jd |d |jddS) zStart a long-running command in the background and return its pid (don't wait). List a sandbox's processes with `hf sandbox process ls` and stop one with `hf sandbox process kill`. r/T)r:rf backgroundNzProcess startedr2pidz+List processes with `hf sandbox process ls rFz&Stop it with `hf sandbox process kill  )r4rnrorr#rJr{rL) r*rUrVr:r<r+r,r2r)s r3 sandbox_spawnr}s, *  ? ? ?m7++d7mmsH1M1MSZgk+llmmmmmmmmmmmmmmmJ *'+FFFFH I: I I IJJJH Rj R R7; R R RSSSSSs5AAAcpz2hf sandbox cp data.csv :/data/data.csvz7hf sandbox cp :/app/result.json result.jsonsrcz,Source: a local path or :.dstz1Destination: a local path or :.cdtdttdztffd}||\}}||\}}|du|dukrtd|Ft|||5} | j||dddn #1swxYwYnI|Jt|||5} | j||dddn #1swxYwYtjd||dS) zCCopy a file between the local machine and a sandbox (docker-style).refr-Ncd|vrE|ds0|dd\}}t|dkr||fSd|fS)N:)./~r) startswithsplitlen)rr*paths r3parsezsandbox_cp..parses[ #::cnn_==:"yya00 J:""!4''SyrQzHExactly one of SRC and DST must be a sandbox path (:).r/Copied)rr) rmtuplerr4filesdownloaduploadr#rJ) rrr+r,r src_sandboxsrc_path dst_sandboxdst_pathr2s r3 sandbox_cprs35tS1"E#JJK!E#JJKt!455abbb kYe D D D 7 M " "8X 6 6 6 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7&&& kYe D D D 5 M 8 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5JxSc******s$1BB B;C##C'*C'kill)zhf sandbox kill zKhf sandbox kill # kills a whole shared host (all its sandboxes)zhf sandbox kill --allz$The sandbox or host id to terminate.all_z--allz2Terminate every sandbox and host in the namespace.yesz-yz--yesz$Answer Yes to prompts automatically.cHt|}|rt|ddgtdi|}|st jddSt jdt|d | |D](}||j |j j )t j d t| dS|tdt||\}} t|vr t!|||5} | dddn #1swxYwYn/#t$$r"} tt'| | d} ~ wwxYwt j d|dS||| }|jpit.t0krXt jd|d| ||j |j j t j d|dS t!|||5} | dddn #1swxYwYn/#t$$r"} tt'| | d} ~ wwxYwt j d|dS)z@Terminate a sandbox, a whole shared host, or everything (--all).r,RUNNING SCHEDULING1statuslabelsr+zNo running sandboxes.N Terminate zA sandbox job(s) (including shared hosts and all their sandboxes)?rjob_idr+ Terminated)jobsz*Provide a sandbox id, a host id, or --all.r/zSandbox terminated)rCzTerminate shared host z and all of its sandboxes?zHost terminated)rro list_jobsr r#textconfirmr cancel_jobrCownerr(rJrrrr4rrrm inspect_jobrgetr r ) r*rrr+r,apirjobsidnsr2es r3 sandbox_killr s5 5 ! ! !C CMM)\)BM[^K_ktMuuvv  H, - - - F mTmmmsvwwww D DC NN#&CINN C C C C D=D1% D=1D55D=8D59D== E)E$$E)I0I IIIII J 'JJ )zhf sandbox pool createz5hf sandbox pool create python:3.12 --flavor cpu-basicz7hf sandbox pool create --per-host 50 --idle-timeout 30mz+Docker image for the hosts (needs /bin/sh).per_hostz --per-hostz&Sandboxes packed per host VM (default z).)minr& max_hostsz --max-hostsz'Optional cap on the number of host VMs.zZShut a host down once it has had no sandboxes for this long (e.g. '10m'). Defaults to 10m.c ptj}|pt}t||pd||||nt||}|j} |j} t jd| ||pd| dtj|z ddt jd | d t jd | d dS) zRWarm a pool: boot one host VM now, tagged so it can be found later by its pool id.rGN)r7r8sandboxes_per_hostrr9r+r,z Pool createdrrArB)rCr7r8rDrEz/Spawn a sandbox with `hf sandbox create --pool rFz=Delete the pool (and its hosts) with `hf sandbox pool delete ) rIrrrr(host_idsr#rJrL) r7r8rrr9r+r,rMr'pool_idrs r3 pool_createrGs4 IKKE  "]E $#%1%=\\CW   DiG}HJ $ a[9;;&---- H Jw J J JKKKH XW X X XYYYYYrQz ls | listzhf sandbox pool lsc nt|}i}|dtti|D]}|jpit }|s&t|jtr|jni}| |||j p|j |j |dddd}|dxxd z cc<t|}t!j|d |st!jd dSt!jd dS)z9List running sandbox pools (grouped from their host VMs).rrr SBX_CAPACITYr)rCr7r8rhostsrrrCid_keyz)Create one with `hf sandbox pool create`.z5Spawn a sandbox with `hf sandbox create --pool `.N)rrr r rrr isinstance environmentdict setdefault docker_imagespace_idr8rovaluesr#tablerL) r+r,rpoolsrr{r:inforowss r3pool_lsrzsG 5 ! ! !C')E}}Iz96MYb}cczR$$Z00  !+COT!B!BJcoo )9S\*GGNB77       W     DId4    J <===== HIIIIIrQz delete | rmz hf sandbox pool delete rzPool id to delete.c t|}t|ddgttt |i|}|s)t |tjd|ddStj dt|d |d | |D](}| |j |j j )t |tjd |t|dS)zDTerminate every host VM of a pool (and therefore all its sandboxes).rrrrzNo running hosts for pool 'z'.Nrz host(s) of pool 'z' (and all their sandboxes)?rrz Pool deleted)rChosts_terminated)rrorr r r rr#rrrrrCrr(rJ)rrr+r,rrrs r3 pool_deleters 5 ! ! !C  |, :w?     E '""" :w:::;;;K`SZZ``7```fijjjj@@ cf ????gJ~'CJJGGGGGGrQcmdcZt|tr|nd|S)Nr|)rrmjoin)rs r3_fmt_cmdrs%S#&& 933CHHSMM9rQc<|jrdS|jdn d|jdS)Nrunningexitedzexited ())rru)r)s r3 _fmt_statusrs2y(0886UAR6U6U6UUrQz"hf sandbox process ls c.t|||5}|}dddn #1swxYwYd|D}tj|d|stjd|ddStjd|d dS) zUList the background processes running in a sandbox (started with `hf sandbox spawn`).r/Ncbg|],}|jt|t|jd-S))r{rr)r{rrr).0ps r3 zprocess_ls..s3 ` ` `QRAE[^^HQUOO L L ` ` `rQr{rz!Start one with `hf sandbox spawn z -- `.z'Stop one with `hf sandbox process kill z `.)r4 processesr#rrL)r*r+r,r2rrs r3 process_lsrs *  ? ? ?(7%%'' ((((((((((((((( ` `V_ ` ` `DId5!!!! Q LZLLLMMMMM O:OOOPPPPPs 488z*hf sandbox process kill r{z.The pid as printed by `hf sandbox process ls`.c>t|||5}tfd|Dd}|tdd|d|dddn #1swxYwYt jd|dS) z/Stop a background process running in a sandbox.r/c32K|]}|jk |VdSr[)r{)rrr{s r3 zprocess_kill..s)GGa!%3,,,,,,GGrQNzNo process with pid z in sandbox rzProcess stoppedrz)r4nextrrrr#rJ)r*r{r+r,r2r)s ` r3 process_killrs *  ? ? ?7GGGG7#4#4#6#6GGGNN ?P#PP:PPPQQ Q   J *#>>>>>>sAA;;A?A?) NNNNNNNNNNFN)NNNNNN)NNNNN)NN)NFFNN)FNN)G__doc__r\rI contextlibrtypingrrrrrhuggingface_hub._sandboxrrr r r r r rrrrrhuggingface_hub._sandbox_cacherhuggingface_hub.errorsrr _cli_utilsrrrrrrrrrr _frameworkr!r"_outputr#rr$r% sandbox_clipool_cli add_group process_clirm SandboxIdArgr4rUboolrProfloatrvr}rrintrrrrrrrrQr3rs JI %%%%%%++++++++++                             =<<<<<99999999                        )((((((())))))))m!QRRR =b c c c hV,,,m![\\\ k 222hh,_````a C$JsTzhW^N_  TX  #'" )>C>C S4Z/N!O!O!OO P>C  d xjkkk m >C  >C d jkkk m>C >C>C>C!>C >C !>C"  ff)0bcccc#>C( )>C* +>C>C>C>CB  .5?;\` "(b(b(b tCy((0E"F"F"FF G(bsTz66$ BV#W#W#WW X(b  (b  (b   ff[/Z[[[[ (b(b (b (b(b(b(bV  .5EB\`"TTT tCy((0W"X"X"XX YTsTz66$ BV#W#W#WW XT  T  T  T T TTTT* <A# ++ 3&TUUUU V+ 3&YZZZZ [++  +  ++++@  `dhm_d" /4/4#*hh4Z&[&[&[[\/4 D&&/cdddd e/4 4g4Z[[[[ \/4 /4  /4  /4/4/4/4d  bf #  "(Z(Z S4Z/\!]!]!]] ^(Z (Z |)pRl)p)p)pqqq s(Z d FF=a6_````(Z d pqqq s(Z(Z (Z  !(Z(Z(Z(ZV +)=(>??"JJJ J JJJ@?J> 0 1 `e" HH sHH*>???? @H 4g4Z[[[[ \HH  H  HHH H4:#S /:c::::VVCVVVV  [,P+QRR# Q Q Q Q  Q Q Q QSR Q  V'S&TUU# ? ? ? 3&VWWWW X ? ?  ?  ? ? ?VU ? ? ?rQ