o i: @s~UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZddlZddlmZmZmZmZmZmZmZddlmZm Z m!Z!d d l"m#Z#m$Z$e rkdd l%m&Z&e'Z(ee'e fZ)ee*ee)e(d e+e,fZ-d dhZ.e/e0Z1eGdddZ2Gddde*Z3ddZ4ddZ5ede-de3fddZ6ededdedfddZ6dee-dee3fddZ6de-de'fddZ7de-de'de'fd d!Z8d"e'dd fd#d$Z9de*de:fd%d&Z;de*ded+ee*eejGd+ejHde e'fd?d@ZIiZJeeZdZUdZeeed<ddedeeffdd ZZ S) MimeBytesa& A bytes object with a mime type. To be returned by `_prepare_payload_open_as_mime_bytes` in subclasses. Example: ```python >>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeNr#cs2t||}||_t|tr|dur|j|_|SN)super__new__r0 isinstancer/)clsr#r0obj __class__r-r.r3Ss zMimeBytes.__new__r1) r%r&r'__doc__r r(r)r,r3 __classcell__r-r-r7r.r/Bs  $r/cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)r ImportErrornumpy)r<r-r-r. _import_numpy^sr=cCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr)rr;PILrrr-r-r._import_pil_imagegs  r?contentreturncCdSr1r-r@r-r-r._open_as_mime_bytesvrDcCrBr1r-rCr-r-r.rDzrEcCs|durdSt|trt|St|ttfrtt|St|drHtd|}t|dr7t |j dnd}t|t rBt dt||dSt|t r|dsW|d r}td |t|}|jd }|durvt |d}t|j|dSt|}|std |d t|trtd|t|t |ddStrddlm}t||jrtdt}|jpd}|j||dt|d|dSt dt |d)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r0https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rzConverting PIL Image to bytesPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r4r,r/ bytearray memoryviewhasattrloggerdebugrF mimetypes guess_typerGr( TypeError startswithrgetr$r@rexistsFileNotFoundError read_bytesrr>rioBytesIOrKsavegetvaluelowertype)r@r#r0responserbufferrKr-r-r.rD~sP               cCst|}t|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rDbase64 b64encodedecode)r@ raw_bytesr-r-r. _b64_encodesredefault_mime_typecCsHt|tr |dr |St|}|jp|}t|}d|d|S)N)rIrHdata:rgz;base64,)r4r(rTrDr0rarbrc)r@rfrdr0 encoded_datar-r-r._as_urls  ri encoded_imagecCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)r?openrYrZra b64decode)rjrr-r-r. _b64_to_imagesrmcCt|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r"loadsrcrCr-r-r._bytes_to_listrqcCrn)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rorCr-r-r._bytes_to_dictrrrscCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )r?rkrYrZ)r@rr-r-r._bytes_to_imagesrtr_cCst|tr t|S|Sr1)r4r,r"rp)r_r-r-r._as_dictsru output_linesdetailsc csD|D]}zt||}Wn tyYdSw|dur|VqdS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrvrwlineoutputr-r-r. _stream_text_generation_responses r~c CsN|2z 3dHW}zt||}Wn tyYdSw|dur#|Vq6dS)z/Used in `AsyncInferenceClient.text_generation`.Nrxr{r-r-r.&_async_stream_text_generation_responses rr|cCsx|dsdS|dkrtd|dd}t|}|ddur/t|d|dt |}|s:|j j S|S)Nrg data: [DONE][DONE] signal received.z/nerror error_type) rTstriprzlstriprstripr"rprU_parse_text_generation_errorrparse_obj_as_instancetokentext)r|rwpayload json_payloadr}r-r-r.rys    rylinesc csB|D]}zt|}Wn tyYdSw|dur|VqdS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputrzrr|r}r-r-r. _stream_chat_completion_response5s  rc CsL|2z3dHW}zt|}Wn tyYdSw|dur"|Vq6dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrr-r-r.&_async_stream_chat_completion_responseBs  rcCsb|dsdS|dkrtdt|d}|ddur,t|d|dt |S)Nrgrrrr) rTrrzr"rprrUrrr)r|rr-r-r.rOs   rclientcCs(|2z 3dHW}|Vq6dSr1) aiter_linesr)rr_r|r-r-r._async_yield_fromcs r#_UNSUPPORTED_TEXT_GENERATION_KWARGSr!unsupported_kwargscCst|g|dSr1)r setdefaultextend)r!rr-r-r.'_set_unsupported_text_generation_kwargs}srcCs t|gSr1)rrU)r!r-r-r.'_get_unsupported_text_generation_kwargss r http_errorcCsl|jdur|zt|ddp|j}|d}|d}Wn ty'|w|dur4t||}|||)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. Nresponse_error_payloadrr)r_getattrr"rU Exceptionr)rrrr exceptionr-r-r.raise_text_generation_errors    rrrcCsH|dkrt|S|dkrt|S|dkrt|S|dkr t|St|S)N generationincomplete_generation overloaded validation)rrrrr)rrr-r-r.rsr)Pr9rarYr"loggingrQ dataclassesrpathlibrtypingrrrrrr r r r r httpxhuggingface_hub.errorsrrrrrrrutilsrrr_generated.typesrr PIL.Imagerr(UrlTPathTr,rLrMContentTTASKS_EXPECTING_IMAGES getLoggerr%rOrr/r=r?rDrerirmr+rqr*rsrtruboolr~rryrrr AsyncClientResponserrr)rrrrr-r-r-r.s  0$      B            "