wi= UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZmZmZmZmZmZdd l m!Z!m"Z"m#Z#m$Z$d d l%m&Z&m'Z'e rdd l(m)Z)m*Z*dd l+m,Z,e-Z.ee-e fZ/ee0ee/e.de1e2fZ3ddhZ4ej5e6Z7eGddZ8Gdde0Z9dZ:dZ;dZde3de-de-fdZ?d e-ddfd!Z@de0defd"ZAde0defd#ZBde0ddfd$ZCd%ee0efdefd&ZDd'ee0d(eEdeee-ee'ffd)ZFd'e e0d(eEdee e-e e'ffd*ZGd+e0d(eEdeee-e'ffd,ZHd-ee0dee&fd.ZId-e e0de e&fd/ZJd+e0dee&fd0ZKd1d2d%d3de e0fd4ZLiZMeee-ee-feNd5<d6ee-d7ee-ddfd8ZOd6ee-dee-fd9ZPd:edefd;ZQdZRdS)?zEContains utilities used by both the sync and async inference clients.N) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIODictIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager#z text-to-imagezimage-to-imageceZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<dS)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__rrr r bytesry/var/www/development/aibuddy-work/election-extract/venv/lib/python3.11/site-packages/huggingface_hub/inference/_common.pyr%r%Est HHH III C= 5dD) **** 5/ #s(^r3r%cReZdZUdZeeed<ddedeeffd ZxZ S) MimeBytesa& A bytes object with a mime type. To be returned by `_prepare_payload_open_as_mime_bytes` in subclasses. Example: ```python >>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeNr*ct||}||_t|tr| |j|_|SN)super__new__r7 isinstancer6)clsr*r7obj __class__s r4r;zMimeBytes.__new__`sFggooc4((! dI & & +9+< NCM r3r9) r,r-r.__doc__rr/r0r1r; __classcell__)r?s@r4r6r6Osr  }5Xc]r3r6cHtstdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rDs r4_import_aiohttprEks.  ! !kijjjNNN Nr3cHtstdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrCnumpy)rGs r4 _import_numpyrHts.   ecdddLLL Lr3cLtstdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr")rrCPILr#r"s r4_import_pil_imagerK}sA    `    Lr3contentreturncdSr9r2rLs r4_open_as_mime_bytesrPs9<r3cdSr9r2rOs r4rPrPsBE#r3c~|dSt|trt|St|ttfrtt|St |drt d|}t |drtj |j dnd}t|trtdt||St|tr|ds|d rt d |t|}|jd }|tj |d}t|j|St'|}|st+d |d t|t&rXt d|t|tj |dSt/rddlm}t||jrt dt5j}|jpd}|||t|d|StdtA|d)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r7https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from r"zConverting PIL Image to bytesPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r<r1r6 bytearray memoryviewhasattrloggerdebugrS mimetypes guess_typerTr/ TypeError startswithrgetr+rLrexistsFileNotFoundError read_bytesrrJr#ioBytesIOrXsavegetvaluelowertype)rLr*r7responser#bufferrXs r4rPrPs/ t'5!!"!!!'Iz233)w(((w4 4555||~~=DWf=U=U_I(66q99[_ dC  SQRR R3333'3   j ) ) DW-?-? -J-J D LL>W>> ? ? ?"}}((11H (,,^<>:S:STTT T  uT']] u u u  r3clt|}tj|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rPbase64 b64encodedecode)rL raw_bytess r4 _b64_encoderss,#G,,I  I & & - - / //r3default_mime_typect|tr|dr|St|}|jp|}t j|}d|d|S)N)rVrUdata:rvz;base64,)r<r/rarPr7rorprq)rLrtrrr7 encoded_datas r4_as_urlrxs'3G$6$67W$X$X$G,,I#8'8I#I..5577L 59 4 4l 4 44r3 encoded_imagect}|jtjt j|S)z/Parse a base64-encoded string into a PIL Image.)rKopenrfrgro b64decode)ryr#s r4 _b64_to_imager}s4   E 5:bj!1-!@!@AA B BBr3cNtj|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r)loadsrqrOs r4_bytes_to_listr :gnn&& ' ''r3cNtj|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rrOs r4_bytes_to_dictrrr3cbt}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rKr{rfrg)rLr#s r4_bytes_to_imager s+   E 5:bj)) * **r3rlcXt|trtj|n|Sr9)r<r1r)r)rls r4_as_dictrs&#-h#>#> L4:h   HLr3bytes_output_as_linesdetailsc#hK|D],} t||}n#t$rYdSwxYw||V-dS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrr byte_payloadoutputs r4 _stream_text_generation_responsersk .  :<QQFF    EEE   LLL s  ((cvK|23d{V} t||}n#t$rYdSwxYw||WV36dS)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r4&_async_stream_text_generation_responser's 4l :<QQFF    EEE   LLLL 433s8 --rc|dsdS|dkrtd|d}t j|dd}|d)t|d|dtj |}|s |j j n|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rvz/nerror error_type)rastriprrqr)rlstriprstriprb_parse_text_generation_errorrparse_obj_as_instancetokentext)rrpayload json_payloadrs r4rr5s  " "8 , ,t..5666!!'**G:gnnW55<EEcI\IaIaIcIc G$$[[.. 0 CC Z' s AA A$rrc|dkrt|S|dkrt|S|dkrt|S|dkrt|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r4rrsu\!!u%%%,,,(///\!!u%%%\!!u%%%   r3)Sr@rorfr)loggingr^ dataclassesrpathlibrtypingrrrrr r r r r rrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesrrrDr r! PIL.Imager#r/UrlTPathTr1rYrZContentTTASKS_EXPECTING_IMAGES getLoggerr,r\r%r6rErHrKrPrsrxr}rrrrboolrrrrrrrrr0rrrrr2r3r4rsLKK !!!!!!                            _^^^^^^^^^^^TTTTTTTT 55555555  c4i %w :M N*+;<  8 $ $  8    < >?     (/ :>  = }-GH HI    88"&8 eC33458888, %  ()     u% -.    JJ ()JJJJ*O?OTabgTh6GI#T(3-c*B%CHHHY8C=YVZ[^V_YdhYYYY>8C=>T#Y>>>>I(6  8C= Uh      r3