o RWjf@sddlmZddlmZddlmZddlZddlmZddl m Z m Z m Z m Z mZmZmZddlmZmZmZdd lmZdd lmZmZdd lmZmZd d lmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%m&Z&ddl'm(Z(m)Z)ddl*m+Z+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddgZ9GdddeZ:GdddeZ;GdddZGd!d"d"Z?dS)#) annotations)Optional)LiteralN)_legacy_response)BodyOmitQueryHeadersNotGivenomit not_given) path_templatemaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper) OutputItemsAsyncOutputItemsOutputItemsWithRawResponseAsyncOutputItemsWithRawResponse OutputItemsWithStreamingResponse%AsyncOutputItemsWithStreamingResponse)SyncCursorPageAsyncCursorPage)run_list_paramsrun_create_params)AsyncPaginatormake_request_options)Metadata)RunListResponse)RunCancelResponse)RunCreateResponse)RunDeleteResponse)RunRetrieveResponseRuns AsyncRunsc @eZdZdZed7ddZed8ddZed9d d Zeed d d e d d:dd Z d d d e d!d;d$d%Z eeeed d d e d&dd5d6Zd S)?r),Manage and run evals in the OpenAI platform.returnrcC t|jSr,)r_clientselfr3o/home/esfera/Documents/content_generation/venv/lib/python3.10/site-packages/openai/resources/evals/runs/runs.py output_items( zRuns.output_itemsRunsWithRawResponsecCt|Sa This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )r7r1r3r3r4with_raw_response-zRuns.with_raw_responseRunsWithStreamingResponsecCr8z An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )r<r1r3r3r4with_streaming_response7zRuns.with_streaming_responseNmetadataname extra_headers extra_query extra_bodytimeouteval_idstr data_sourcerun_create_params.DataSourcerAOptional[Metadata] | OmitrB str | OmitrCHeaders | NonerD Query | NonerE Body | NonerF'float | httpx.Timeout | None | NotGivenr&c CsN|s td||jtd|dt|||dtjt||||ddidtdS)  Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation. Args: data_source: Details about the run's data source. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the run. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/{eval_id}/runsrGrIrArB bearer_authTrCrDrErFsecuritybodyoptionscast_to) ValueError_postrrr RunCreateParamsr"r& r2rGrIrArBrCrDrErFr3r3r4create@s(' z Runs.createrCrDrErFrun_idr(c CP|s td||std||jtd||dt||||ddidtdS) P Get an evaluation run by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rR5Expected a non-empty value for `run_id` but received /evals/{eval_id}/runs/{run_id}rGrcrVTrWr[r\r]_getrr"r(r2rcrGrCrDrErFr3r3r4retrieve} z Runs.retrieveafterlimitorderstatusrCrDrErFrprq int | OmitrrLiteral['asc', 'desc'] | OmitrsJLiteral['queued', 'in_progress', 'completed', 'canceled', 'failed'] | OmitSyncCursorPage[RunListResponse]c CV|s td||jtd|dttt|||| t||||dtjddidtdS a Get a list of runs for an evaluation. Args: after: Identifier for the last run from the previous pagination request. limit: Number of runs to retrieve. order: Sort order for runs by timestamp. Use `asc` for ascending order or `desc` for descending order. Defaults to `asc`. status: Filter runs by status. One of `queued` | `in_progress` | `failed` | `completed` | `canceled`. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrSrT)rprqrrrsrVT)rCrDrErFqueryrX)pager[model) r] _get_api_listrrr$r"rr RunListParams r2rGrprqrrrsrCrDrErFr3r3r4list,%  z Runs.listr'c Crd) G Delete an eval run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrfrgrhrVTrWrir]_deleterr"r'rlr3r3r4deleternz Runs.deleter%c Crd) U Cancel an ongoing evaluation run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrfrgrhrVTrWrir]r^rr"r%rlr3r3r4cancel rnz Runs.cancel)r-r)r-r7)r-r<rGrHrIrJrArKrBrLrCrMrDrNrErOrFrPr-r&rcrHrGrHrCrMrDrNrErOrFrPr-r()rGrHrprLrqrtrrrursrvrCrMrDrNrErOrFrPr-rwrcrHrGrHrCrMrDrNrErOrFrPr-r'rcrHrGrHrCrMrDrNrErOrFrPr-r%__name__ __module__ __qualname____doc__rr5r:r>r r rarmrrrr3r3r3r4r)%N    D,D/c @r+)?r*r,r-rcCr.r/)rr0r1r3r3r4r56r6zAsyncRuns.output_itemsAsyncRunsWithRawResponsecCr8r9)rr1r3r3r4r:;r;zAsyncRuns.with_raw_responseAsyncRunsWithStreamingResponsecCr8r=)rr1r3r3r4r>Er?z!AsyncRuns.with_streaming_responseNr@rGrHrIrJrArKrBrLrCrMrDrNrErOrFrPr&c s\|s td||jtd|dt|||dtjIdHt||||ddidtd IdHS) rQrRrSrTrUNrVTrWrY)r]r^rrr r_r"r&r`r3r3r4raNs*'  zAsyncRuns.createrbrcr(c X|s td||std||jtd||dt||||ddidtdId HS) rerRrfrgrhrVTrWriNrjrlr3r3r4rm   zAsyncRuns.retrieverorprqrtrrrursrvAAsyncPaginator[RunListResponse, AsyncCursorPage[RunListResponse]]c Crxry) r]r}rrr$r"rrr~rr3r3r4rrzAsyncRuns.listr'c r) rrRrfrgrhrVTrWriNrrlr3r3r4rrzAsyncRuns.deleter%c r) rrRrfrgrhrVTrWriNrrlr3r3r4rrzAsyncRuns.cancel)r-r)r-r)r-rrr)rGrHrprLrqrtrrrursrvrCrMrDrNrErOrFrPr-rrrrr3r3r3r4r*3rc@$eZdZd ddZed dd Zd S) r7runsr)r-NonecCP||_t|j|_t|j|_t|j|_t|j|_t|j|_dSN)_runsrto_raw_response_wrapperrarmrrrr2rr3r3r4__init__B  zRunsWithRawResponse.__init__rcC t|jjSr/)rrr5r1r3r3r4r5U z RunsWithRawResponse.output_itemsNrr)r-r)r-rrrrrrr5r3r3r3r4r7A r7c@r) rrr*r-rcCrr)rrasync_to_raw_response_wrapperrarmrrrrr3r3r4r\rz!AsyncRunsWithRawResponse.__init__rcCrr/)rrr5r1r3r3r4r5orz%AsyncRunsWithRawResponse.output_itemsNrr*r-r)r-rrr3r3r3r4r[rrc@r) r<rr)r-rcCF||_t|j|_t|j|_t|j|_t|j|_t|j|_dSr)rrrarmrrrrr3r3r4rv  z"RunsWithStreamingResponse.__init__rcCrr/)rrr5r1r3r3r4r5rz&RunsWithStreamingResponse.output_itemsNr)r-rrr3r3r3r4r<urr<c@r) rrr*r-rcCrr)rrrarmrrrrr3r3r4rrz'AsyncRunsWithStreamingResponse.__init__rcCrr/)rrr5r1r3r3r4r5rz+AsyncRunsWithStreamingResponse.output_itemsNr)r-rrr3r3r3r4rrr)@ __future__rtypingrtyping_extensionsrhttpxr_typesrrr r r r r _utilsrrr_compatr _resourcerr _responserrr5rrrrrr paginationrr types.evalsrr _base_clientr!r"types.shared_params.metadatar#types.evals.run_list_responser$types.evals.run_cancel_responser%types.evals.run_create_responser&types.evals.run_delete_responser'!types.evals.run_retrieve_responser(__all__r)r*r7rr<rr3r3r3r4s>    $