o iB@sddlZddlZddlmZddlmZddlmZddl m Z m Z ddl m Z ddlmZmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(ddl)m*Z*ddl+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddl9m:Z:e;ejGd"d#d#Z?dS)$N)JSONDecodeError)core)ApiError)AsyncClientWrapperSyncClientWrapper)serialize_datetime)AsyncHttpResponse HttpResponse)jsonable_encoder)RequestOptions)construct_type)BadRequestError)ClientClosedRequestError)ForbiddenError)GatewayTimeoutError)InternalServerError)InvalidTokenError) NotFoundError)NotImplementedError)ServiceUnavailableError)TooManyRequestsError)UnauthorizedError)UnprocessableEntityError) DatasetType)DatasetValidationStatus)DatasetsCreateResponse)DatasetsGetResponse)DatasetsGetUsageResponse)DatasetsListResponse.c@eZdZdefddZdddddddddejedejej dejej d eje d eje d eje d eje d e efddZddddddedddededejdejedejedejejeejefdejejeejefdejedejedejejd eje d e efddZddd eje d e efddZddd ed eje d e efd!d"Zddd ed eje d e ejeejejffd#d$ZdS)%RawDatasetsClientclient_wrappercC ||_dSN_client_wrapperselfr#r*`/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/cohere/datasets/raw_client.py__init__' zRawDatasetsClient.__init__N dataset_typebeforeafterlimitoffsetvalidation_statusrequest_optionsr/r0r1r2r3r4r5returnc Cs|jjjdd||durt|nd|durt|nd|||d|d}zd|jkr/dkrDnntttt| d} t || d WS|jd krdt t |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkr&tt |j ttjtjttjtj| dd |jdkrGtt |j ttjtjttjtj| dd |jdkrhtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd | } Wntyt|jt |j |jdwt|jt |j | d)ad List datasets that have been created. Parameters ---------- dataset_type : typing.Optional[str] optional filter by dataset type before : typing.Optional[dt.datetime] optional filter before a date after : typing.Optional[dt.datetime] optional filter after a date limit : typing.Optional[float] optional limit to number of results offset : typing.Optional[float] optional offset to start of results validation_status : typing.Optional[DatasetValidationStatus] optional filter by validation status request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[DatasetsListResponse] A successful response. v1/datasetsGETN datasetTyper0r1r2r3validationStatusmethodparamsr5,type_object_responsedataheadersbody status_coderIrJ)r' httpx_clientrequestrrWtypingcastr r jsonr rdictrIOptionalAnyrrrrrrrrrrrrrtext r)r/r0r1r2r3r4r5 _response_data_response_jsonr*r*r+list*s>*                                      zRawDatasetsClient.listkeep_original_fileskip_malformed_input keep_fieldsoptional_fieldstext_separator csv_delimiter eval_datar5nametyperFrgrhrirjrkrlrmc  Cs|jjjdd|||||||| did|i| durd| ini| tdd} zd | jkr1d krFnntttt| d } t | | d WS| jd krft t | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkr(tt | j ttjtjttjtj| d d| jdkrItt | j ttjtjttjtj| d d| jdkrjtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| }Wntyt| jt | j | jdwt| jt | j |d)a Create a dataset by uploading a file. See ['Dataset Creation'](https://docs.cohere.com/docs/datasets#dataset-creation) for more information. Parameters ---------- name : str The name of the uploaded dataset. type : DatasetType The dataset type, which is used to validate the data. The only valid type is `embed-input` used in conjunction with the Embed Jobs API. data : core.File See core.File for more documentation keep_original_file : typing.Optional[bool] Indicates if the original file should be stored. skip_malformed_input : typing.Optional[bool] Indicates whether rows with malformed input should be dropped (instead of failing the validation check). Dropped rows will be returned in the warnings field. keep_fields : typing.Optional[typing.Union[str, typing.Sequence[str]]] List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `keep_fields` are missing from the uploaded file, Dataset validation will fail. optional_fields : typing.Optional[typing.Union[str, typing.Sequence[str]]] List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, Datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `optional_fields` are missing from the uploaded file, Dataset validation will pass. text_separator : typing.Optional[str] Raw .txt uploads will be split into entries using the text_separator value. csv_delimiter : typing.Optional[str] The delimiter used for .csv uploads. eval_data : typing.Optional[core.File] See core.File for more documentation request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[DatasetsCreateResponse] A successful response. r7POSTrnrorgrhrirjrkrlrFNrmTr=r>rFfilesr5omitforce_multipartr?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYOMITrWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`r)rnrorFrgrhrirjrkrlrmr5rbrcrdr*r*r+createsP:                                      zRawDatasetsClient.creater5c Cs|jjjdd|d}zd|jkrdkr,nntttt|d}t ||dWS|jdkrLt t |j ttj tjttj tj|dd |jd krltt |j ttj tjttj tj|dd |jd krtt |j ttj tjttj tj|dd |jd krtt |j ttj tjttj tj|dd |jd krtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkr tt |j ttj tjttj tj|dd |jdkr.tt |j ttj tjttj tj|dd |jdkrOtt |j ttj tjttj tj|dd |jdkrptt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |}Wntyt|jt |j |jdwt|jt |j |d)a View the dataset storage usage for your Organization. Each Organization can have up to 10GB of storage across all their users. Parameters ---------- request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[DatasetsGetUsageResponse] A successful response. v1/datasets/usager8r=r5r?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYrWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`r)r5rbrcrdr*r*r+ get_usages0                                     zRawDatasetsClient.get_usageidc Cs|jjjdt|d|d}zd|jkrdkr1nntttt| d}t ||dWS|jdkrQt t |j ttjtjttjtj| dd |jd krqtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkr3tt |j ttjtjttjtj| dd |jdkrTtt |j ttjtjttjtj| dd |jdkrutt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd | }Wntyt|jt |j |jdwt|jt |j |d)a Retrieve a dataset by ID. See ['Datasets'](https://docs.cohere.com/docs/datasets) for more information. Parameters ---------- id : str request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[DatasetsGetResponse] A successful response. v1/datasets/r8r{r?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYr rWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`r)r~r5rbrcrdr*r*r+gets0                                      zRawDatasetsClient.getc Cs|jjjdt|d|d}zd|jkrdkrCnn%ttjttj tj ft tjttj tj f| d}t ||dWS|jdkrctt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkr%tt|jttj tj t tj tj | dd |jdkrFtt|jttj tj t tj tj | dd |jdkrgtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd | }Wntyt|jt|j|jdwt|jt|j|d)a Delete a dataset by ID. Datasets are automatically deleted after 30 days, but they can also be deleted manually. Parameters ---------- id : str request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- HttpResponse[typing.Dict[str, typing.Optional[typing.Any]]] A successful response. rDELETEr{r?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYr rWrZr[Dictstrr^r_r r\r rr]rIrrrrrrrrrrrrrr`rr*r*r+delete)s0                                      zRawDatasetsClient.delete) __name__ __module__ __qualname__rr,rZr^rdtdatetimefloatrr r r rervrrFileboolUnionSequencerrxrr}rrrr_rr*r*r*r+r"&    Q      e * ,r"c@r!)%AsyncRawDatasetsClientr#cCr$r%r&r(r*r*r+r,r-zAsyncRawDatasetsClient.__init__Nr.r/r0r1r2r3r4r5r6c s|jjjdd||durt|nd|durt|nd|||d|dIdH}zd|jkr3dkrHnntttt| d} t || d WS|jd krht t |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkr tt |j ttjtjttjtj| dd |jdkr*tt |j ttjtjttjtj| dd |jdkrKtt |j ttjtjttjtj| dd |jdkrltt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd | } Wntyt|jt |j |jdwt|jt |j | d)ai List datasets that have been created. Parameters ---------- dataset_type : typing.Optional[str] optional filter by dataset type before : typing.Optional[dt.datetime] optional filter before a date after : typing.Optional[dt.datetime] optional filter after a date limit : typing.Optional[float] optional limit to number of results offset : typing.Optional[float] optional offset to start of results validation_status : typing.Optional[DatasetValidationStatus] optional filter by validation status request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[DatasetsListResponse] A successful response. r7r8Nr9r<r?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYrrWrZr[r r r\r rr]rIr^r_rrrrrrrrrrrrrr`rar*r*r+res@*                                       zAsyncRawDatasetsClient.listrfrnrorFrgrhrirjrkrlrmc  s|jjjdd|||||||| did|i| durd| ini| tddIdH} zd | jkr5d krJnntttt| d } t | | d WS| jd krjt t | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkr tt | j ttjtjttjtj| d d| jdkr,tt | j ttjtjttjtj| d d| jdkrMtt | j ttjtjttjtj| d d| jdkrntt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| jdkrtt | j ttjtjttjtj| d d| }Wntyt| jt | j | jdwt| jt | j |d)a Create a dataset by uploading a file. See ['Dataset Creation'](https://docs.cohere.com/docs/datasets#dataset-creation) for more information. Parameters ---------- name : str The name of the uploaded dataset. type : DatasetType The dataset type, which is used to validate the data. The only valid type is `embed-input` used in conjunction with the Embed Jobs API. data : core.File See core.File for more documentation keep_original_file : typing.Optional[bool] Indicates if the original file should be stored. skip_malformed_input : typing.Optional[bool] Indicates whether rows with malformed input should be dropped (instead of failing the validation check). Dropped rows will be returned in the warnings field. keep_fields : typing.Optional[typing.Union[str, typing.Sequence[str]]] List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `keep_fields` are missing from the uploaded file, Dataset validation will fail. optional_fields : typing.Optional[typing.Union[str, typing.Sequence[str]]] List of names of fields that will be persisted in the Dataset. By default the Dataset will retain only the required fields indicated in the [schema for the corresponding Dataset type](https://docs.cohere.com/docs/datasets#dataset-types). For example, Datasets of type `embed-input` will drop all fields other than the required `text` field. If any of the fields in `optional_fields` are missing from the uploaded file, Dataset validation will pass. text_separator : typing.Optional[str] Raw .txt uploads will be split into entries using the text_separator value. csv_delimiter : typing.Optional[str] The delimiter used for .csv uploads. eval_data : typing.Optional[core.File] See core.File for more documentation request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[DatasetsCreateResponse] A successful response. r7rprqrFNrmTrrr?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYrvrWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`rwr*r*r+rxsR:                                       zAsyncRawDatasetsClient.createryc s|jjjdd|dIdH}zd|jkrdkr0nntttt|d}t ||dWS|jd krPt t |j ttj tjttj tj|dd |jd krptt |j ttj tjttj tj|dd |jd krtt |j ttj tjttj tj|dd |jd krtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkr2tt |j ttj tjttj tj|dd |jdkrStt |j ttj tjttj tj|dd |jdkrttt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |jdkrtt |j ttj tjttj tj|dd |}Wntyt|jt |j |jdwt|jt |j |d)a View the dataset storage usage for your Organization. Each Organization can have up to 10GB of storage across all their users. Parameters ---------- request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[DatasetsGetUsageResponse] A successful response. rzr8r{Nr?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYrWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`r|r*r*r+r}s2                                      z AsyncRawDatasetsClient.get_usager~c s|jjjdt|d|dIdH}zd|jkr dkr5nntttt| d}t ||dWS|jd krUt t |j ttjtjttjtj| dd |jd krutt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jd krtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkr7tt |j ttjtjttjtj| dd |jdkrXtt |j ttjtjttjtj| dd |jdkrytt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd |jdkrtt |j ttjtjttjtj| dd | }Wntyt|jt |j |jdwt|jt |j |d)a Retrieve a dataset by ID. See ['Datasets'](https://docs.cohere.com/docs/datasets) for more information. Parameters ---------- id : str request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[DatasetsGetResponse] A successful response. rr8r{Nr?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYr rWrZr[rr r\r rr]rIr^r_rrrrrrrrrrrrrr`rr*r*r+r-s2                                       zAsyncRawDatasetsClient.getc s|jjjdt|d|dIdH}zd|jkr dkrGnn%ttjttj tj ft tjttj tj f| d}t ||dWS|jd krgtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jd krtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkr)tt|jttj tj t tj tj | dd |jdkrJtt|jttj tj t tj tj | dd |jdkrktt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd |jdkrtt|jttj tj t tj tj | dd | }Wntyt|jt|j|jdwt|jt|j|d)a Delete a dataset by ID. Datasets are automatically deleted after 30 days, but they can also be deleted manually. Parameters ---------- id : str request_options : typing.Optional[RequestOptions] Request-specific configuration. Returns ------- AsyncHttpResponse[typing.Dict[str, typing.Optional[typing.Any]]] A successful response. rrr{Nr?r@rArDrGrHrKrLrMrNrOrPrQrRrSrTrUrV)r'rXrYr rWrZr[rrr^r_r r\r rr]rIrrrrrrrrrrrrrr`rr*r*r+rs2                                       zAsyncRawDatasetsClient.delete) rrrrr,rZr^rrrrrr r r rervrrrrrrrrxrr}rrrr_rr*r*r*r+rrr)@rrrZ json.decoderrrcore.api_errorrcore.client_wrapperrrcore.datetime_utilsrcore.http_responser r core.jsonable_encoderr core.request_optionsr core.unchecked_base_modelr errors.bad_request_errorr"errors.client_closed_request_errorrerrors.forbidden_errorrerrors.gateway_timeout_errorrerrors.internal_server_errorrerrors.invalid_token_errorrerrors.not_found_errorrerrors.not_implemented_errorr errors.service_unavailable_errorrerrors.too_many_requests_errorrerrors.unauthorized_errorr!errors.unprocessable_entity_errorrtypes.dataset_typertypes.dataset_validation_statusrtypes.datasets_create_responsertypes.datasets_get_responser!types.datasets_get_usage_responsertypes.datasets_list_responser r[r_rvr"rr*r*r*r+sN                         5