,h> b%SrSSKrSSKrSSKrSSKrSSKrSSKJr SSKJ r SSK J r SSK J r JrJrJrJrJrJrJrJrJrJrJrJrJr SSKJr SSKJrJrJ r J!r!J"r"J#r# S S K$J%r%J&r&J'r'J(r( S S K)J*r*J+r+ \ (aSS K,J-r-J.r. SSK/J0r0 \1r2\\1\ 4r3\\4\4r5\\5\3\2S4r6SS1r7\Rp"\95r:\ "SS55r;\ "SS55rSr?\S\6S\\54Sj5r@\S\SS\\S4Sj5r@\S\\6S\\\5SS44Sj5r@S\6S\14SjrAS\6S\1S\14S jrBS!\1SS4S"jrCS\4S\4S#jrDS\4S\4S$jrES\4SS4S%jrFS&\\4\4S\4S'jrGS(\\4S)\HS\\\1\\+44S*jrIS(\\4S)\HS\\\1\\+44S+jrJS,\4S)\HS\\\1\+44S-jrKS.\\4S\\*4S/jrLS.\\4S\\*4S0jrMS,\4S\\*4S1jrNS2S3S&S4S\\44S5jrO0rP\\\1\\14\QS6'S7\\1S8\\1SS4S9jrRS7\\1S\\14S:jrSS;\S\4S<jrTS=\\1S>\\1S\!4S?jrUg)@zEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager&z text-to-imagezimage-to-imagecz\rSrSr%\\S'\\S'\\\S'\\\\\ 4\S'\\ \S'\\\ 4\S'Sr g ) RequestParametersIurltaskmodeljsondataheadersN) __name__ __module__ __qualname____firstlineno__str__annotations__rrr rContentTr__static_attributes__r0Y/var/www/html/shao/venv/lib/python3.13/site-packages/huggingface_hub/inference/_common.pyr(r(IsE H I C= 5dD) ** 8  #s(^r9r(cB\rSrSr%Sr\\S'\\S'\\S'\\S'Sr g) ModelStatusTa' This Dataclass represents the model status in the HF Inference API. Args: loaded (`bool`): If the model is currently loaded into HF's Inference API. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkr0N) r1r2r3r4__doc__boolr6r5r r8r0r9r:r<r<Ts, L JNr9r<cB[5(d [S5eSSKnU$)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rFs r:_import_aiohttprGus  ! !ijj Nr9cB[5(d [S5eSSKnU$)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrEnumpy)rIs r: _import_numpyrJ~s   cdd Lr9cF[5(d [S5eSSKJn U$)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr%)rrEPILr&r%s r:_import_pil_imagerMs(   `   Lr9contentreturncgNr0rNs r:_open_as_binaryrSs"r9cgrQr0rRs r:rSrSs%(r9c#F# [U[5(aURS5(dURS5(a>[R SU35 [ 5R U5Rv g[U5nUR5(d[SUS35e[U[5(a7[R SU35 URS5nUv SSS5 g[5(aS S K Jn [XR5(a_[R S 5 [R "5nUR#X0R$=(d S S 9 UR'5v gUv g!,(df  g=f7f)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. TODO: handle base64 as input https://http://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rbrr%zConverting PIL Image to bytesPNG)format) isinstancer5 startswithloggerdebugrgetrNrexistsFileNotFoundErroropenrrLr&ioBytesIOsaverZgetvalue)rNfr&buffers r:rSrSsG'3   j ) )W-?-? -J-J LL4WI> ?-##G,44 4 w-~~#$WI.OO  '4   ,WI67 \\$ 1G  g{{ + + LL8 9ZZ\F LL(?%L @//# #  M! sC-F!/F4BF! FF!c[U5n[U[5(aUOUR5n[R "U5R 5sSSS5 $!,(df  g=f)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.N)rSr[bytesreadbase64 b64encodedecode)rNr. data_as_bytess r: _b64_encoderpsH  !T *4 7 7TYY[  .557 " ! !s A A!! A/default_mime_typec[U[5(a.URS5(dURS5(aU$Sn[U[[45(a[R "USS9SnOU[ 5(aFSSKJn [XR5(a&SUR=(d SR53nU=(d Un[U5nS US U3$) NrVrWF)strictrr%zimage/rYdata:z;base64,) r[r5r\r mimetypes guess_typerrLr&rZlowerrp)rNrq mime_typer& encoded_datas r:_as_urlrzs'3W%7%7 %C%CwGYGYZcGdGdI'C;''((?B    g{{ + + '.."9E!@!@!B CDI..Iw'L 9+Xl^ 44r9 encoded_imagec[5nUR"[R"[R "U555$)z/Parse a base64-encoded string into a PIL Image.)rMrbrcrdrl b64decode)r{r&s r: _b64_to_imager~s-  E ::bjj!1!1-!@A BBr9cJ[R"UR55$)aSParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r-loadsrnrRs r:_bytes_to_listr ::gnn& ''r9cJ[R"UR55$)aSParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rrRs r:_bytes_to_dictrrr9cb[5nUR"[R"U55$)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rMrbrcrd)rNr&s r:_bytes_to_imagers$  E ::bjj) **r9responsec\[U[5(a[R"U5$U$rQ)r[rjr-r)rs r:_as_dictr s"#-h#>#>4::h LHLr9bytes_output_as_linesdetailsc#j# UHn[X!5nUcMUv M g![a  gf=f7f)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrr byte_payloadoutputs r: _stream_text_generation_responsers@ .  :<QF  L .    3 "3 3 0303cz# UShvN n[X!5nUcMU7v M!N![a  gf=f g7f)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r:&_async_stream_text_generation_responser%sK 4l :<QF  L    44;9&9; (;;9 6;6;rcURS5(dgUR5S:Xa [S5eURS5n[R "UR S5RS55nURS5b[USURS55e[R"U5nU(dURR$U$ Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rtz/nerror error_type)r\striprrnr-rlstriprstripr__parse_text_generation_errorr"parse_obj_as_instancetokentext)rrpayload json_payloadrs r:rr3s  " "8 , ,.566!!'*G::gnnW5<EcI\I\IaIaIc G$[[. 0C '  s AA$$ A1rrcUS:Xa [U5$US:Xa [U5$US:Xa [U5$US:Xa [U5$[ U5$)N generationincomplete_generation overloaded validation)rrrrr)rrs r:rrsZ\!u%%,,(//\!u%%\!u%%  r9)VrBrlrcr-loggingru contextlibr dataclassesrpathlibrtypingrrrr r r r r rrrrrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesr!r"rFr#r$ PIL.Imager&r5UrlTPathTrjBinaryTr7TASKS_EXPECTING_IMAGES getLoggerr1r]r(r<rGrJrMrSrprzr~rrrrrCrrrrrrrrr6rrrrr0r9r:rsL %!"_^T5  c4i x  %w. /*+;<   8 $    @  " "G" "  ( T](GDM"( ( 'Xh/'Ihw>OQUW[>[4\''T88c85X5#5#5(CCC (E(d((E(d(+U+w+MuUD[)MdM #E? 59  8C=(#=> >?  (/ :>  = }-GH HI 88"&8 eC33458, %  ()  u% -. JJ ()J*O?OTabgTh6GI#T(3-c*B%CHY8C=YVZ[^V_YdhY>8C=>T#Y>I(6  8C= Uh r9