Otjy& dZddlZddlmZddlmZddlmZddl m Z dd giZ gd Z Gd d Z eddZdZdZdddd eddddd dZdZdZdddZdS)z, Thin wrappers around `concurrent.futures`. N)contextmanager length_hint)tqdm) TqdmWarningz github.com/ casperdcl) thread_map process_mapinterpreter_mapcJeZdZdZddlmZddlmZdZ d dZ d Z d Z d Z d S)_InterpreterLockz3Reentrant lock backed by a cross-interpreter queue.r) get_ident) monotoniccZddlm}||_||_d|_d|_dS)Nr)RLock) threadingr_queue_lock_owner_depth)selfqueuers U/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/tqdm/contrib/concurrent.py__init__z_InterpreterLock.__init__s:###### UWW   Tcxddlm}|}|dkr|j|}n|j||}|sdS|jr|xjdz c_dS |s|jnc|dkr|jnCtd|||z z }|j|n%#|$r|j YdSwxYw| |_ d|_dS)Nr)EmptyrFT)timeout) rr_timeracquirerr get_nowaitgetmaxreleaserr)rblockingr!rstartacquired remainings rr#z_InterpreterLock.acquiresS  b==z))(33HHz))(G<get (create if necessary) and then restore `tqdm_class`'s lockrN)getattrget_lockset_lockr) tqdm_class lock_namelockold_locks r ensure_lockrEGsz7D11H |0:..00 4D ) )D JJJ    H%%%%%rc dtjd|jd|jdd|d }t |ffS)zGReturn an initializer which bootstraps the parent import path and lock.zimport sys sys.path[:] = z from concurrent import interpreters from importlib import import_module from tqdm.contrib.concurrent import _InterpreterLock tqdm_class = import_module(z) for name in .z: tqdm_class = getattr(tqdm_class, name) tqdm_class.monitor_interval = 0 tqdm_class.set_lock(_InterpreterLock(interpreters.Queue(z))))syspathr7r8splitexec)rA lock_queue_idcodes r_get_interpreter_initrNVs{ X X X '1&; X X ".44S99 X XDQ X X X  $=rc:tfd|DS)z min(map(length_hint, iterables))c3HK|]}t|dxdkVdS)rrNr).0itns r z_min_map_len..hs<HHRk"b.A.A)Aa(G(Gq(G(G(G(GHHr)min) iterablesrSs @r _min_map_lenrWfs& HHHH9HHH H HHrr g) max_workersr! chunksizerBrA smoothingr _initializer _initargsc D| } d| vrt| | d<i}d| vr| d|d<i}dD]}|| vr| |||<d}| drTd| vrP ddlm}n#t $r ddlm}YnwxYw|ptd |pd d z}| d|kr|| d<d }t||| 5}| |j } |f} |d|| | d|5}|dd|i| 5|d _ |j fd}||_ t|j |g| R||d|cdddcdddcdddS#1swxYwY dddn #1swxYwYddddS#1swxYwYdS)a Implementation of `thread_map`, `process_map` and `interpreter_map`. Parameters ---------- max_workers : int timeout : int buffersize : int Requires Python>=3.14. thread_name_prefix : str max_tasks_per_child : int mp_context : str total buffersize)thread_name_prefixmax_tasks_per_child mp_contextNminitersr)process_cpu_count) cpu_count r T)rBrC)rX initializerinitargsrZcH|i|}|fd|S)Nc,Sr1)update)_pbars rz4_executor_map..patchsubmit..sDKKMMr)add_done_callback)argskwargsfut orisubmitrns r patchsubmitz"_executor_map..patchsubmits:#)T4V44C))*A*A*A*ABBBJr)r!rYr;)copyrWpoposrd ImportErrorrerUrEr@dynamic_miniterssubmitlistmap) PoolExecutorfnrXr!rYrBrArZrr[r\rV tqdm_kwargsrr map_kwargs pool_kwargskrzre rough_maxlkexrurtrns @@r _executor_maprks$    Ff&y11wJv#)::l#;#; < K H++ ;;#ZZ]]KN g $:V33 % 9 9 9 9 9 9 9 % % % $ $ $ $ $ $ $ $ % B3rIIKK,<1+A#B#B '?Y & &!*F: #  Z95 A A AYR  %.LI \)k|V_))')) Y,.::i:6:: Yd#/,0D)I ( FBFX"XX,3yXXLVXXYY Y Y Y Y Y Y Y Y Y Y Y Y Y Y YYYYYYYY Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y YYYYYYYYYYYYYYYYYYsr=BBBF7 E=>E% E= F%E) )E=,E) -E=1 F=F FF FFFc0ddlm}t||g|Ri|S)a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ThreadPoolExecutor`. Parameters ---------- max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ThreadPoolExecutor`. thread_name_prefix : str, optional Passed to `concurrent.futures.ThreadPoolExecutor` [default: '']. timeout : int or float, optional Seconds to wait before raising `TimeoutError` if `__next__` is called and the result isn't available. [default: None]. buffersize : int, optional Requires Python>=3.14 [default: None]. tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. smoothing : float, optional Passed to `tqdm_class`; the [default: 0] is average (due to erratic update frequency). lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: '']. r)ThreadPoolExecutor)concurrent.futuresrr)rrVrrs rr r s7.655555 +R K) K K K{ K KKrcddlm}ddlm}|}|d|dt}t||j \}}t||g|Rt|||d|S)aj Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.InterpreterPoolExecutor` (Python 3.14+). Parameters ---------- Same as `thread_map`. Notes ----- `fn`, its arguments, and its return values must be pickleable. Worker progress bars using the same `tqdm_class` share a cross-interpreter write lock. r) interpreters)InterpreterPoolExecutorNrA)rr[r\) concurrentrrr create_queuer.r% tqdm_autorNidrr) rrVrrr lock_queuerArhris rr r s('''''::::::**,,JNN4y99J1*jmLLK  E&/ E E7G 7S7S H E E8C E EErmp_lock)rBcddlm}|r5d|vr1t|}|dkrddlm}|d|zt dt ||g|Rd |i|S) aI Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ProcessPoolExecutor`. Parameters ---------- max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ProcessPoolExecutor`. timeout : int or float, optional Seconds to wait before raising `TimeoutError` if `__next__` is called and the result isn't available. [default: None]. chunksize : int, optional Approximate size of chunks sent to worker processes; passed to `concurrent.futures.ProcessPoolExecutor.map`. [default: 1]. buffersize : int, optional Requires Python>=3.14 [default: None]. max_tasks_per_child : int, optional Maximum number of tasks a worker process can complete before being replaced with a new process; passed to `concurrent.futures.ProcessPoolExecutor`. mp_context : multiprocessing.BaseContext, optional Multiprocessing context to use, e.g. `multiprocessing.get_context('fork')`. lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: mp_lock]. tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. smoothing : float, optional Passed to `tqdm_class`; the [default: 0] is average (due to erratic update frequency). r)ProcessPoolExecutorrYi)warnzIterable length %d > 1000 but `chunksize` is not set. This may seriously degrade multiprocess performance. Set `chunksize=1` or more.r) stacklevelrB)rrrWwarningsrrr)rrBrVrrshortest_iterable_lenrs rr r s:766666 ,[ 33!-Y 7 7 4 ' ' % % % % % % D/1FG , , , , ,b a9 a a a aU` a aar)r<N)r9rH contextlibroperatorrautorrstdr __author____all__rrErNrWrr r r r;rrrsm %%%%%% $$$$$$k] + : : :55555555p & & & &    III /3DAY[Ct$RV9Y9Y9Y9Y9YxLLL6EEE2+4(b(b(b(b(b(b(br