}tjYA.UdZddlZddlZddlZddlZddlZddlmZmZddl m Z m Z ddl m Z mZddlmZddlmZmZmZmZddlmZd d lmZiZeeefed <Gd d Z d1dedzddfdZ!d1dedzdefdZ"de#dedzfdZ$GddeZe%ej&GddZ'e deezdeej(fdZ)ddde*ede#dedzdefdZ+ddddddddd ede#d!e#dzd"e#d#ed$ededzd%e*edzd&edzdeefd'Z,ed(Z-ed)Z.d*e#dzd+e*ede fd,Z/ddd-d.ee-ge.fd/ee-d*e#dzd%e*edzde0e.f d0Z1dS)2u Utility helpers to handle progress bars in `huggingface_hub`. Example: 1. Use `huggingface_hub.utils.tqdm` as you would use `tqdm.tqdm` or `tqdm.auto.tqdm`. 2. To disable progress bars, either use `disable_progress_bars()` helper or set the environment variable `HF_HUB_DISABLE_PROGRESS_BARS` to 1. 3. To re-enable progress bars, use `enable_progress_bars()`. 4. To check whether progress bars are disabled, use `are_progress_bars_disabled()`. NOTE: Environment variable `HF_HUB_DISABLE_PROGRESS_BARS` has the priority. Example: ```py >>> from huggingface_hub.utils import are_progress_bars_disabled, disable_progress_bars, enable_progress_bars, tqdm # Disable progress bars globally >>> disable_progress_bars() # Use as normal `tqdm` >>> for _ in tqdm(range(5)): ... pass # Still not showing progress bars, as `disable=False` is overwritten to `True`. >>> for _ in tqdm(range(5), disable=False): ... pass >>> are_progress_bars_disabled() True # Re-enable progress bars globally >>> enable_progress_bars() # Progress bar will be shown ! >>> for _ in tqdm(range(5)): ... pass 100%|███████████████████████████████████████| 5/5 [00:00<00:00, 117817.53it/s] ``` Group-based control: ```python # Disable progress bars for a specific group >>> disable_progress_bars("peft.foo") # Check state of different groups >>> assert not are_progress_bars_disabled("peft")) >>> assert not are_progress_bars_disabled("peft.something") >>> assert are_progress_bars_disabled("peft.foo")) >>> assert are_progress_bars_disabled("peft.foo.bar")) # Enable progress bars for a subgroup >>> enable_progress_bars("peft.foo.bar") # Check if enabling a subgroup affects the parent group >>> assert are_progress_bars_disabled("peft.foo")) >>> assert not are_progress_bars_disabled("peft.foo.bar")) # No progress bar for `name="peft.foo"` >>> for _ in tqdm(range(5), name="peft.foo"): ... pass # Progress bar will be shown for `name="peft.foo.bar"` >>> for _ in tqdm(range(5), name="peft.foo.bar"): ... pass 100%|███████████████████████████████████████| 5/5 [00:00<00:00, 117817.53it/s] ``` N)IterableIterator)ThreadPoolExecutor as_completed)contextmanager nullcontext)Path)CallableContextManagerTypeVarcast)tqdm)HF_HUB_DISABLE_PROGRESS_BARSprogress_bar_statesc:eZdZdZddedzddfdZd dZd dZdS) disable_progress_barsa& Disable progress bars either globally or for a specified group. This function updates the state of progress bars based on a group name. If no group name is provided, all progress bars are disabled. The operation respects the `HF_HUB_DISABLE_PROGRESS_BARS` environment variable's setting. Works as both a regular call and a context manager: disable_progress_bars() # disables until enable_progress_bars() with disable_progress_bars(): # disables for the block, re-enables on exit ... Args: name (`str`, *optional*): The name of the group for which to disable the progress bars. If None, progress bars are disabled globally. Raises: Warning: If the environment variable precludes changes. Nnamereturnc.|_tdurtjdd|_dSt  |_%t dt d<dSfdt D}|D] }t |= dt <dS)NFzlCannot disable progress bars: environment variable `HF_HUB_DISABLE_PROGRESS_BARS=0` is set and has priority._globalcDg|]}|d|S. startswith.0keyrs X/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/huggingface_hub/utils/tqdm.py z2disable_progress_bars.__init__..s4___cCNNVZS]S]S]D^D^_c___)rrwarningswarn_should_reenableare_progress_bars_disabledrclear)selfrkeys_to_removers ` r __init__zdisable_progress_bars.__init__s '5 0 0 M~   %*D ! F$>t$D$D D <  % % ' ' '-2  * * *____-@___N% - -',,(-  % % %r"c|SNr(s r __enter__zdisable_progress_bars.__enter__ r"c@|jrt|jdSdSr,)r%enable_progress_barsr)r(excs r __exit__zdisable_progress_bars.__exit__s-   ,  + + + + + , ,r"r,)rr)rN)__name__ __module__ __qualname____doc__strr*r/r4r-r"r rrmsq*..S4Z.4....(,,,,,,r"rrrctdurtjddS%tdtd<dSfdtD}|D] }t|= dt<dS)a Enable progress bars either globally or for a specified group. This function sets the progress bars to enabled for the specified group or globally if no group is specified. The operation is subject to the `HF_HUB_DISABLE_PROGRESS_BARS` environment setting. Args: name (`str`, *optional*): The name of the group for which to enable the progress bars. If None, progress bars are enabled globally. Raises: Warning: If the environment variable precludes changes. TzkCannot enable progress bars: environment variable `HF_HUB_DISABLE_PROGRESS_BARS=1` is set and has priority.NrcDg|]}|d|Srrrs r r!z(enable_progress_bars..s1[[[#RVzzz@Z@Z[#[[[r")rr#r$rr')rr)rs` r r2r2s $t++ y     |!!###)-I&&&[[[[)<[[[! ) )C#C(($(D!!!r"c"tdurdS|tdd S|rI|tvrt| Sd|ddd}|Itdd S)a Check if progress bars are disabled globally or for a specific group. This function returns whether progress bars are disabled for a given group or globally. It checks the `HF_HUB_DISABLE_PROGRESS_BARS` environment variable first, then the programmatic settings. Args: name (`str`, *optional*): The group name to check; if None, checks the global setting. Returns: `bool`: True if progress bars are disabled, False otherwise. TNrr)rrgetjoinsplitrs r r&r&s$t++t |&**9d;;;; . & & &*400 0xx 3,-- . #&&y$77 77r" log_levelc^|tjkrdStjddkrdSdS)z Determine if tqdm progress bars should be disabled based on logging level and environment settings. see https://github.com/huggingface/huggingface_hub/pull/2000 and https://github.com/huggingface/huggingface_hub/pull/2698. T TQDM_POSITIONz-1FN)loggingNOTSETosgetenv)rBs r is_tqdm_disabledrIs5 GN""t y!!T))u 4r"c6eZdZdZfdZdeddffd ZxZS)rz Class to override `disable` argument in case progress bars are globally disabled. Taken from https://github.com/tqdm/tqdm/issues/619#issuecomment-619639324. c|dd}t|rd|d<tj|i|dS)NrTdisable)popr&superr*)r(argskwargsr __class__s r r*z tqdm.__init__sRzz&$'' %d + + % $F9 $)&)))))r"attrrNc| t|dS#t$r |dkrYdSwxYw)zBFix for https://github.com/huggingface/huggingface_hub/issues/1603_lockN)rN __delattr__AttributeError)r(rRrQs r rUztqdm.__delattr__sV  GG   % % % % %   w s !&;;)r5r6r7r8r*r9rU __classcell__)rQs@r rrsn ***** r"rcBeZdZdZdZdZdZd deezdzddfd Z dS) silent_tqdmz#Fake tqdm object that does nothing.cdSr,r-)r(rOrPs r r*zsilent_tqdm.__init__  r"c|Sr,r-r.s r r/zsilent_tqdm.__enter__ r0r"cdSr,r-)r(exc_type exc_value tracebacks r r4zsilent_tqdm.__exit__r[r"nNrcdSr,r-)r(rbs r updatezsilent_tqdm.updater[r")ra) r5r6r7r8r*r/r4intfloatrdr-r"r rYrYsw--        e d* 4      r"rYpathc#Kt|trt|}|d5}|j}t dd|d|j|jd dtdzd tffd }||_|V ddddS#1swxYwYdS) uQ Open a file as binary and wrap the `read` method to display a progress bar when it's streamed. First implemented in `transformers` in 2019 but removed when switched to git-lfs. Used in `huggingface_hub` to show progress bar when uploading an LFS file to the Hub. See github.com/huggingface/transformers/pull/2078#discussion_r354739608 for implementation details. Note: currently implementation handles only files stored on disk as it is the most common use case. Could be extended to stream any `BinaryIO` object but we might have to debug some corner cases. Example: ```py >>> with tqdm_stream_file("config.json") as f: >>> httpx.put(url, data=f) config.json: 100%|█████████████████████████| 8.19k/8.19k [00:02<00:00, 3.72kB/s] ``` rbBTr)unit unit_scaletotalinitialdescr=sizeNrcb|}t||Sr,)rdlen)rpdataf_readpbars r _inner_readz%tqdm_stream_file.._inner_read8s-6$<z!hf_thread_map..s-``` t8??2t44e```r"zlist[R]r-)listminrG cpu_count setdefaultrrrr enumeraterresultrd BaseExceptioncancelr ) rrrr tqdm_kwargsitemsrresultsrufuture_to_indexfuturers ` @r hf_thread_maprs@ NNE"r|~~2a788 7CJJ///"dI#fs5zz1G   K  $("{iPPPT\`````yY^O_O_``` &77  39==??/0 A    *          7 # ##sOED+1AC65D+6%DD+ E+D/ /E2D/ 3EE Er,)2r8iorErG threadingr#collections.abcrrconcurrent.futuresrr contextlibrrpathlibr typingr r r r tqdm.autorold_tqdm constantsrrdictr9bool__annotations__rr2r&rerIrRLockrYBufferedReaderrrrrrrrrrr-r"r rsBBBH  ........????????22222222::::::::::::&&&&&&444444(*T#t)_)))/,/,/,/,/,/,/,/,d))sTz)T))))@88S4Z848888:  t    84 oio          *4#:*(23D*E****ZUY555h5C5sTz5go55554(,!  :      *X%d{D< GCLL GCLL 7sTz 7d8n 7Yk 7 7 7 7(#(, 5$5$5$!a5$qk5$t 5$ X% 5$ !W5$5$5$5$5$5$r"