o i@sdZddlmZddlZddlZddlmZmZddl m Z m Z m Z ddl mZmZddlmZmZmZddlmZdd lmZmZdd lmZmZmZmZmZddlZdd lm Z m!Z!d d l"m#Z#d dl$m%Z%d dl&m'Z'm(Z(d dl)m*Z*d dl+m,Z,d dl-m.Z.d dl/m0Z0d dl1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>m?Z?m@Z@mAZAmBZBd dlCmDZDd dlEmFZFmGZGmHZHd dlImJZJmKZKd dlLmMZMmNZNd dlOmPZPd dlQmRZRe dedZS edddGd d!d!ZTGd"d#d#eZUeGd$d%d%eZVdaW did(d)ZXedjd-d.ZYeKfdkd3d4ZZdd5d6d7dld>d?Z[edmdld@dAZ\edBe]e^Z_GdCdDdDe!ee_Z`e EdndodMdNZae EdndpdQdNZa R EdqdrdUdNZaedsdWdXZbdtd]d^ZcdudadbZddvdgdhZedS)wzLogic related to making requests to an LLM. The aim here is to make a common interface for different LLMs, so that the rest of the code can be agnostic to the specific LLM being used. ) annotationsN)ABCabstractmethod) AsyncIteratorCallableIterator)asynccontextmanagercontextmanager) dataclassfieldreplace)datetime)cachecached_property)AnyGenericLiteralTypeVaroverload) TypeAliasType TypedDict)_utils)JsonSchemaTransformer)OutputObjectDefinitionPromptedOutputSchema)ModelResponsePartsManager) RunContext)AbstractBuiltinTool) UserError)BaseToolCallPart BinaryImageFilePartFileUrlFinalResultEvent FinishReason ModelMessage ModelRequest ModelResponseModelResponsePartModelResponseStreamEvent PartEndEventPartStartEventTextPart ThinkingPart ToolCallPartVideoUrl) OutputMode)DEFAULT_PROFILE ModelProfileModelProfileSpec)Providerinfer_provider) ModelSettingsmerge_model_settings)ToolDefinition) RequestUsageKnownModelName)z#anthropic:claude-3-5-haiku-20241022z!anthropic:claude-3-5-haiku-latestz$anthropic:claude-3-5-sonnet-20240620z$anthropic:claude-3-5-sonnet-20241022z"anthropic:claude-3-5-sonnet-latestz$anthropic:claude-3-7-sonnet-20250219z"anthropic:claude-3-7-sonnet-latestz!anthropic:claude-3-haiku-20240307z anthropic:claude-3-opus-20240229zanthropic:claude-3-opus-latestz anthropic:claude-4-opus-20250514z"anthropic:claude-4-sonnet-20250514zanthropic:claude-haiku-4-5z#anthropic:claude-haiku-4-5-20251001zanthropic:claude-opus-4-0z"anthropic:claude-opus-4-1-20250805z anthropic:claude-opus-4-20250514zanthropic:claude-sonnet-4-0z"anthropic:claude-sonnet-4-20250514zanthropic:claude-sonnet-4-5z$anthropic:claude-sonnet-4-5-20250929z$bedrock:amazon.titan-text-express-v1z!bedrock:amazon.titan-text-lite-v1zbedrock:amazon.titan-tg1-largez0bedrock:anthropic.claude-3-5-haiku-20241022-v1:0z1bedrock:anthropic.claude-3-5-sonnet-20240620-v1:0z1bedrock:anthropic.claude-3-5-sonnet-20241022-v2:0z1bedrock:anthropic.claude-3-7-sonnet-20250219-v1:0z.bedrock:anthropic.claude-3-haiku-20240307-v1:0z-bedrock:anthropic.claude-3-opus-20240229-v1:0z/bedrock:anthropic.claude-3-sonnet-20240229-v1:0z0bedrock:anthropic.claude-haiku-4-5-20251001-v1:0z#bedrock:anthropic.claude-instant-v1z-bedrock:anthropic.claude-opus-4-20250514-v1:0z/bedrock:anthropic.claude-sonnet-4-20250514-v1:0z1bedrock:anthropic.claude-sonnet-4-5-20250929-v1:0zbedrock:anthropic.claude-v2zbedrock:anthropic.claude-v2:1z%bedrock:cohere.command-light-text-v14z"bedrock:cohere.command-r-plus-v1:0zbedrock:cohere.command-r-v1:0zbedrock:cohere.command-text-v14z3bedrock:eu.anthropic.claude-haiku-4-5-20251001-v1:0z2bedrock:eu.anthropic.claude-sonnet-4-20250514-v1:0z4bedrock:eu.anthropic.claude-sonnet-4-5-20250929-v1:0z(bedrock:meta.llama3-1-405b-instruct-v1:0z'bedrock:meta.llama3-1-70b-instruct-v1:0z&bedrock:meta.llama3-1-8b-instruct-v1:0z%bedrock:meta.llama3-70b-instruct-v1:0z$bedrock:meta.llama3-8b-instruct-v1:0z(bedrock:mistral.mistral-7b-instruct-v0:2z'bedrock:mistral.mistral-large-2402-v1:0z'bedrock:mistral.mistral-large-2407-v1:0z*bedrock:mistral.mixtral-8x7b-instruct-v0:1z bedrock:us.amazon.nova-lite-v1:0z!bedrock:us.amazon.nova-micro-v1:0zbedrock:us.amazon.nova-pro-v1:0z3bedrock:us.anthropic.claude-3-5-haiku-20241022-v1:0z4bedrock:us.anthropic.claude-3-5-sonnet-20240620-v1:0z4bedrock:us.anthropic.claude-3-5-sonnet-20241022-v2:0z4bedrock:us.anthropic.claude-3-7-sonnet-20250219-v1:0z1bedrock:us.anthropic.claude-3-haiku-20240307-v1:0z0bedrock:us.anthropic.claude-3-opus-20240229-v1:0z2bedrock:us.anthropic.claude-3-sonnet-20240229-v1:0z3bedrock:us.anthropic.claude-haiku-4-5-20251001-v1:0z0bedrock:us.anthropic.claude-opus-4-20250514-v1:0z2bedrock:us.anthropic.claude-sonnet-4-20250514-v1:0z4bedrock:us.anthropic.claude-sonnet-4-5-20250929-v1:0z*bedrock:us.meta.llama3-1-70b-instruct-v1:0z)bedrock:us.meta.llama3-1-8b-instruct-v1:0z*bedrock:us.meta.llama3-2-11b-instruct-v1:0z)bedrock:us.meta.llama3-2-1b-instruct-v1:0z)bedrock:us.meta.llama3-2-3b-instruct-v1:0z*bedrock:us.meta.llama3-2-90b-instruct-v1:0z*bedrock:us.meta.llama3-3-70b-instruct-v1:0zcerebras:gpt-oss-120bzcerebras:llama-3.3-70bzcerebras:llama3.1-8bz'cerebras:qwen-3-235b-a22b-instruct-2507z'cerebras:qwen-3-235b-a22b-thinking-2507zcerebras:qwen-3-32bzcerebras:zai-glm-4.6zcohere:c4ai-aya-expanse-32bzcohere:c4ai-aya-expanse-8bzcohere:command-nightlyzcohere:command-r-08-2024zcohere:command-r-plus-08-2024zcohere:command-r7b-12-2024zdeepseek:deepseek-chatzdeepseek:deepseek-reasonerzgoogle-gla:gemini-2.0-flashz google-gla:gemini-2.0-flash-litezgoogle-gla:gemini-2.5-flashz google-gla:gemini-2.5-flash-litez0google-gla:gemini-2.5-flash-lite-preview-09-2025z+google-gla:gemini-2.5-flash-preview-09-2025zgoogle-gla:gemini-2.5-prozgoogle-gla:gemini-flash-latestz#google-gla:gemini-flash-lite-latestzgoogle-vertex:gemini-2.0-flashz#google-vertex:gemini-2.0-flash-litezgoogle-vertex:gemini-2.5-flashz#google-vertex:gemini-2.5-flash-litez3google-vertex:gemini-2.5-flash-lite-preview-09-2025z.google-vertex:gemini-2.5-flash-preview-09-2025zgoogle-vertex:gemini-2.5-proz!google-vertex:gemini-flash-latestz&google-vertex:gemini-flash-lite-latestzgrok:grok-2-image-1212zgrok:grok-2-vision-1212z grok:grok-3zgrok:grok-3-fastzgrok:grok-3-minizgrok:grok-3-mini-fastz grok:grok-4zgrok:grok-4-0709z"groq:deepseek-r1-distill-llama-70bz!groq:deepseek-r1-distill-qwen-32bzgroq:distil-whisper-large-v3-enzgroq:gemma2-9b-itzgroq:llama-3.1-8b-instantz!groq:llama-3.2-11b-vision-previewzgroq:llama-3.2-1b-previewzgroq:llama-3.2-3b-previewz!groq:llama-3.2-90b-vision-previewzgroq:llama-3.3-70b-specdeczgroq:llama-3.3-70b-versatilezgroq:llama-guard-3-8bzgroq:llama3-70b-8192zgroq:llama3-8b-8192zgroq:mistral-saba-24bz groq:moonshotai/kimi-k2-instructzgroq:playai-ttszgroq:playai-tts-arabiczgroq:qwen-2.5-32bzgroq:qwen-2.5-coder-32bzgroq:qwen-qwq-32bzgroq:whisper-large-v3zgroq:whisper-large-v3-turbozheroku:amazon-rerank-1-0zheroku:claude-3-5-haikuzheroku:claude-3-5-sonnet-latestzheroku:claude-3-7-sonnetzheroku:claude-3-haikuzheroku:claude-4-5-haikuzheroku:claude-4-5-sonnetzheroku:claude-4-sonnetzheroku:cohere-rerank-3-5zheroku:gpt-oss-120bzheroku:nova-litezheroku:nova-prozhuggingface:Qwen/QwQ-32Bz%huggingface:Qwen/Qwen2.5-72B-Instructz huggingface:Qwen/Qwen3-235B-A22Bzhuggingface:Qwen/Qwen3-32Bz#huggingface:deepseek-ai/DeepSeek-R1z-huggingface:meta-llama/Llama-3.3-70B-Instructz9huggingface:meta-llama/Llama-4-Maverick-17B-128E-Instructz5huggingface:meta-llama/Llama-4-Scout-17B-16E-Instructzmistral:codestral-latestzmistral:mistral-large-latestz!mistral:mistral-moderation-latestzmistral:mistral-small-latestzmoonshotai:kimi-k2-0711-previewzmoonshotai:kimi-latestz moonshotai:kimi-thinking-previewzmoonshotai:moonshot-v1-128kz*moonshotai:moonshot-v1-128k-vision-previewzmoonshotai:moonshot-v1-32kz)moonshotai:moonshot-v1-32k-vision-previewzmoonshotai:moonshot-v1-8kz(moonshotai:moonshot-v1-8k-vision-previewzopenai:chatgpt-4o-latestzopenai:codex-mini-latestzopenai:computer-use-previewz&openai:computer-use-preview-2025-03-11zopenai:gpt-3.5-turbozopenai:gpt-3.5-turbo-0125zopenai:gpt-3.5-turbo-0301zopenai:gpt-3.5-turbo-0613zopenai:gpt-3.5-turbo-1106zopenai:gpt-3.5-turbo-16kzopenai:gpt-3.5-turbo-16k-0613z openai:gpt-4zopenai:gpt-4-0125-previewzopenai:gpt-4-0314zopenai:gpt-4-0613zopenai:gpt-4-1106-previewzopenai:gpt-4-32kzopenai:gpt-4-32k-0314zopenai:gpt-4-32k-0613zopenai:gpt-4-turbozopenai:gpt-4-turbo-2024-04-09zopenai:gpt-4-turbo-previewzopenai:gpt-4-vision-previewzopenai:gpt-4.1zopenai:gpt-4.1-2025-04-14zopenai:gpt-4.1-minizopenai:gpt-4.1-mini-2025-04-14zopenai:gpt-4.1-nanozopenai:gpt-4.1-nano-2025-04-14z openai:gpt-4ozopenai:gpt-4o-2024-05-13zopenai:gpt-4o-2024-08-06zopenai:gpt-4o-2024-11-20zopenai:gpt-4o-audio-previewz&openai:gpt-4o-audio-preview-2024-10-01z&openai:gpt-4o-audio-preview-2024-12-17z&openai:gpt-4o-audio-preview-2025-06-03zopenai:gpt-4o-minizopenai:gpt-4o-mini-2024-07-18z openai:gpt-4o-mini-audio-previewz+openai:gpt-4o-mini-audio-preview-2024-12-17z!openai:gpt-4o-mini-search-previewz,openai:gpt-4o-mini-search-preview-2025-03-11zopenai:gpt-4o-search-previewz'openai:gpt-4o-search-preview-2025-03-11z openai:gpt-5zopenai:gpt-5-2025-08-07zopenai:gpt-5-chat-latestzopenai:gpt-5-codexzopenai:gpt-5-minizopenai:gpt-5-mini-2025-08-07zopenai:gpt-5-nanozopenai:gpt-5-nano-2025-08-07zopenai:gpt-5-prozopenai:gpt-5-pro-2025-10-06zopenai:gpt-5.1zopenai:gpt-5.1-2025-11-13zopenai:gpt-5.1-chat-latestzopenai:gpt-5.1-codexzopenai:gpt-5.1-miniz openai:o1zopenai:o1-2024-12-17zopenai:o1-minizopenai:o1-mini-2024-09-12zopenai:o1-previewzopenai:o1-preview-2024-09-12z openai:o1-prozopenai:o1-pro-2025-03-19z openai:o3zopenai:o3-2025-04-16zopenai:o3-deep-researchz"openai:o3-deep-research-2025-06-26zopenai:o3-minizopenai:o3-mini-2025-01-31z openai:o3-prozopenai:o3-pro-2025-06-10zopenai:o4-minizopenai:o4-mini-2025-04-16zopenai:o4-mini-deep-researchz'openai:o4-mini-deep-research-2025-06-26testFT)reprkw_onlyc@seZdZUdZeedZded<eedZded<dZ ded <d Z d ed <eedZ ded <d Z ded<dZ ded<dZded<edddZedddZejZd S)ModelRequestParameterszcConfiguration for an agent's request to a model, specifically related to tools and output handling.)default_factoryzlist[ToolDefinition]function_toolszlist[AbstractBuiltinTool] builtin_toolstextr1 output_modeNzOutputObjectDefinition | None output_object output_tools str | Noneprompted_output_templateTboolallow_text_outputFallow_image_outputreturndict[str, ToolDefinition]cCsddg|j|jDS)NcSi|]}|j|qS)name).0tool_defrOrOa/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/pydantic_ai/models/__init__.py Oz4ModelRequestParameters.tool_defs..rArFselfrOrOrS tool_defsMsz ModelRequestParameters.tool_defscCs*|jdkr|jr|jrt|j|jSdS)Nprompted)rDrHrErbuild_instructionsrWrOrOrSprompted_output_instructionsQsz3ModelRequestParameters.prompted_output_instructions)rLrMrLrG)__name__ __module__ __qualname____doc__r listrA__annotations__rBrDrErFrHrJrKrrYr\rdataclasses_no_defaults_repr__repr__rOrOrOrSr??s         r?c@seZdZUdZdZded<dZded<dddd3d d Zed4ddZ e d5ddZ d6ddZ e d7d8ddZd9d d!Zd:d#d$Zee d;d&d'Zedd1d2ZdS)?ModelzAbstract class for a model.NModelProfileSpec | None_profileModelSettings | None _settings)settingsprofilerkrlrLNonecCs||_||_dS)zInitialize the model with optional settings and profile. Args: settings: Model-specific settings that will be used as defaults for this model. profile: The model profile to use. N)rjrh)rXrkrlrOrOrS__init__`s zModel.__init__cC|jS)zGet the model settings.)rjrWrOrOrSrkoszModel.settingsmessageslist[ModelMessage]model_settingsmodel_request_parametersr?r(cst)zMake a request to the model.NotImplementedErrorrXrprrrsrOrOrSrequesttsz Model.requestr:cstd|jj)z0Make a request to the model for counting tokens.z8Token counting ahead of the request is not supported by ru __class__r^rvrOrOrS count_tokens~szModel.count_tokens run_contextRunContext[Any] | NoneAsyncIterator[StreamedResponse]cCstd|jj)zz6Model.customize_request_parameters..crrOrrrrOrSrrrVrE)rljson_schema_transformerr rArFrE_customize_output_object)rXrsrErOrrScustomize_request_parameterss  z"Model.customize_request_parameters3tuple[ModelSettings | None, ModelRequestParameters]cCs(t|j|}||}|j}rt|tdd|Dd}|jdkr1|jj }t|||dvd}|j r?|jdkr?t|gd}|j rM|jdvrMt|d d }|j r[|jd kr[t|d d }|jd krk|j skt||jj d }|jd krx|jj sxtd|jdkr|jjstd|jr|jjstd||fS)a)Prepare request inputs before they are passed to the provider. This merges the given `model_settings` with the model's own `settings` attribute and ensures `customize_request_parameters` is applied to the resolved [`ModelRequestParameters`][pydantic_ai.models.ModelRequestParameters]. Subclasses can override this method if they need to customize the preparation flow further, but most implementations should simply call `self.prepare_request(...)` at the start of their `request` (and related) methods. cSrNrO) unique_id)rQtoolrOrOrSrTrUz)Model.prepare_request..)rBauto)nativerZ)rDrJr)rFNrrZ)rHrz8Native structured output is not supported by this model.z+Tool output is not supported by this model.z,Image output is not supported by this model.)r8rkrrBr rbvaluesrDrldefault_structured_output_moderFrErHsupports_json_schema_outputrsupports_toolsrKsupports_image_output)rXrrrsparamsrBrDrOrOrSprepare_requests:      zModel.prepare_requeststrcCt)zThe model name.rtrWrOrOrS model_namezModel.model_namer3cCs(|j}t|r ||j}|durtS|S)zThe model profile.N)rhcallablerr2)rXrhrOrOrSrls  z Model.profilecCr)a+The model provider, ex: openai. Use to populate the `gen_ai.system` OpenTelemetry semantic convention attribute, so should use well-known values listed in https://opentelemetry.io/docs/specs/semconv/attributes-registry/gen-ai/#gen-ai-system when applicable. rtrWrOrOrSsystems z Model.systemrGcCsdS)z0The base URL for the provider API, if available.NrOrWrOrOrSbase_urlszModel.base_urlModelRequestParameters | NonecCsd}g}t|D]}t|tr&||t|dkrn |jdur&|j}nq|durFt|dkrF|d}|d}tdd|jDrF|j}|rZ|j}rZ|rXd ||g}|S|}|S)aGet instructions from the first ModelRequest found when iterating messages in reverse. In the case that a "mock" request was generated to include a tool-return part for a result tool, we want to use the instructions from the second-to-most-recent request (which should correspond to the original request that generated the response that resulted in the tool-return part). Nrrcss$|] }|jdkp |jdkVqdS)z tool-returnz retry-promptN) part_kind)rQprOrOrS .s"z*Model._get_instructions..z ) reversed isinstancer'appendlen instructionsallpartsr\join)rprsrlast_two_requestsmessagemost_recent_requestsecond_most_recent_requestoutput_instructionsrOrOrS_get_instructionss,      zModel._get_instructions)rkrirlrgrLrm)rLri)rprqrrrirsr?rLr()rprqrrrirsr?rLr:N) rprqrrrirsr?r{r|rLr})rsr?rLr?)rrrirsr?rLrrLr)rLr3r])rprqrsrrLrG)r^r_r`rarhrcrjrnpropertyrkrrwrzrr~rrrrrlrr staticmethodrrOrOrOrSrfZs<         6   rfc@seZdZUdZded<edddZded<edddZd ed <edddZd ed <edddZ d ed<ee ddZ ded<edddZ ded<ee ddZded<d)ddZed)ddZd*ddZd+dd Zeed,d"d#Zeed-d$d%Zeed.d'd(ZdS)/StreamedResponsez2Streamed response from an LLM when calling a tool.r?rsNF)defaultinitFinalResultEvent | Nonefinal_result_eventrGprovider_response_idzdict[str, Any] | Noneprovider_detailszFinishReason | None finish_reason)r@rr_parts_managerz.AsyncIterator[ModelResponseStreamEvent] | None_event_iteratorr:_usagerL'AsyncIterator[ModelResponseStreamEvent]cs>jdurd fdd }d fdd }||_jS) axStream the response as an async iterable of [`ModelResponseStreamEvent`][pydantic_ai.messages.ModelResponseStreamEvent]s. This proxies the `_event_iterator()` and emits all events, while also checking for matches on the result schema and emitting a [`FinalResultEvent`][pydantic_ai.messages.FinalResultEvent] if/when the first match is found. NiteratorrrLcs^|2z3dHW}|Vt|j}dur|_|Vnq6|2z 3dHW}|Vq"6dSr)_get_final_result_eventrsr)reventrrWrOrSiterator_with_final_eventSs z=StreamedResponse.__aiter__..iterator_with_final_eventcszdddfdd }|2z!3dHW}t|tr,r*||j}|r%|Vjj|_||Vq6|}|r;|VdSdS) N next_partModelResponsePart | NonerLPartEndEvent | NonecsNsdSj}j|}t|ttBtBsdSt|||r#|jdSddS)N)indexpartnext_part_kind) rr get_partsrr-r.r r+r)rrr)last_start_eventrXrOrSpart_end_eventiszRStreamedResponse.__aiter__..iterator_with_part_end..part_end_eventr)rrrLr)rr,rrprevious_part_kind)rrr end_eventrW)rrSiterator_with_part_endds"     z:StreamedResponse.__aiter__..iterator_with_part_end)rrrLr)r_get_event_iterator)rXrrrOrWrS __aiter__Js %zStreamedResponse.__aiter__cCst)ayReturn an async iterator of [`ModelResponseStreamEvent`][pydantic_ai.messages.ModelResponseStreamEvent]s. This method should be implemented by subclasses to translate the vendor-specific stream of events into pydantic_ai-format events. It should use the `_parts_manager` to handle deltas, and should update the `_usage` attributes as it goes. rtrWrOrOrSrs z$StreamedResponse._get_event_iteratorr(c Cs.t|j|j|j||j|j|j|j dS)zlBuild a [`ModelResponse`][pydantic_ai.messages.ModelResponse] from the data received from the stream so far.)rr timestampusage provider_namerrr) r(rrrrrrrrrrWrOrOrSgetszStreamedResponse.getcCro)zeGet the usage of the response so far. This will not be the final usage until the stream is exhausted.)rrWrOrOrSrszStreamedResponse.usagercCr)z#Get the model name of the response.rtrWrOrOrSrrzStreamedResponse.model_namecCr)zGet the provider name.rtrWrOrOrSrrzStreamedResponse.provider_namer cCr)z"Get the timestamp of the response.rtrWrOrOrSrrzStreamedResponse.timestamp)rLr)rLr()rLr:rr])rLr )r^r_r`rarcr rrrrrrrr:rrrrrrrrrrrOrOrOrSr:s0  B  rrLrmcCststddS)adCheck if model requests are allowed. If you're defining your own models that have costs or latency associated with their use, you should call this in [`Model.request`][pydantic_ai.models.Model.request] and [`Model.request_stream`][pydantic_ai.models.Model.request_stream]. Raises: RuntimeError: If model requests are not allowed. zCModel requests are not allowed, since ALLOW_MODEL_REQUESTS is FalseN)ALLOW_MODEL_REQUESTS RuntimeErrorrOrOrOrScheck_allow_model_requestss rallow_model_requestsrIIterator[None]ccs"t}|azdVW|adS|aw)zContext manager to temporarily override [`ALLOW_MODEL_REQUESTS`][pydantic_ai.models.ALLOW_MODEL_REQUESTS]. Args: allow_model_requests: Whether to allow model requests within the context. N)r)r old_valuerOrOrSoverride_allow_model_requestss rmodelModel | KnownModelName | strprovider_factoryCallable[[str], Provider[Any]]c CsZt|tr|S|dkrddlm}|Sz |jddd\}}Wn@ty_d}|}|dr2d}n|d r:d }n|d rAd }|durVtd |d|d|dt nt d|Ynw|dkrltdt d}||}|}|drddl m }| d}||}|dvrd}n|dvrd}|dkrddlm}|||dS|dkrddlm} | ||dS|dkrddlm} | ||dS|d krdd!lm} | ||dS|d"krdd#lm} | ||dS|d$krdd%lm} | ||dS|d krdd&lm}|||dS|d'krdd(lm}|||dS|d)kr&dd*lm}|||dSt d|)+akInfer the model from the name. Args: model: Model name to instantiate, in the format of `provider:model`. Use the string "test" to instantiate TestModel. provider_factory: Function that instantiates a provider object. The provider name is passed into the function parameter. Defaults to `provider.infer_provider`. r<r) TestModel:)maxsplitN)gpto1o3openaiclaude anthropicgemini google-glazLSpecifying a model name without a provider prefix is deprecated. Instead of z, use 'z'.zUnknown model: vertexaizHThe 'vertexai' provider name is deprecated. Use 'google-vertex' instead. google-vertexzgateway/r)normalize_gateway_provider)razuredeepseekcerebras fireworksgithubgrokheroku moonshotaiollama openroutertogethervercellitellmnebiusovhcloudz openai-chat)rrgoogle)OpenAIChatModel)providerzopenai-responses)OpenAIResponsesModel) GoogleModelgroq) GroqModelcohere) CohereModelmistral) MistralModel)AnthropicModelbedrock)BedrockConverseModel huggingface)HuggingFaceModel)rrfr<rsplit ValueError startswithwarningswarnDeprecationWarningrproviders.gatewayr removeprefixrrrrrrrrrr r rr r r rr)rrrrrr model_kindrrrrrrr r r rrOrOrS infer_models                              rXrtimeoutconnectrrGrintrhttpx.AsyncClientcCs.t|||d}|jrtt|||d}|S)a`Cached HTTPX async client that creates a separate client for each provider. The client is cached based on the provider parameter. If provider is None, it's used for non-provider specific requests (like downloading images). Multiple agents and calls can share the same client when they use the same provider. Each client will get its own transport with its own connection pool. The default pool size is defined by `httpx.DEFAULT_LIMITS`. There are good reasons why in production you should use a `httpx.AsyncClient` as an async context manager as described in [encode/httpx#2026](https://github.com/encode/httpx/pull/2026), but when experimenting or showing examples, it's very useful not to. The default timeouts match those of OpenAI, see . r)_cached_async_http_client is_closed cache_clear)rrrclientrOrOrScached_async_http_clientYs r%cCstjtj||ddtidS)N)rrz User-Agent)rheaders)httpx AsyncClientTimeoutget_user_agentrrOrOrSr!rs r!DataTc@s$eZdZUdZded< ded<dS)DownloadedItemz!The downloaded data and its type.r+datar data_typeN)r^r_r`rarcrOrOrOrSr,}s r,mimeitemr# data_formatLiteral['bytes'] type_formatLiteral['mime', 'extension']DownloadedItem[bytes]cdSrrOr0r1r3rOrOrS download_itemr8'Literal['base64', 'base64_uri', 'text']DownloadedItem[str]cr6rrOr7rOrOrSr8r9bytes0Literal['bytes', 'base64', 'base64_uri', 'text']+DownloadedItem[str] | DownloadedItem[bytes]c s |jdr tdt|tr|jrtdt}|j|jddIdH}||j d}r>| dd }|d kr>d}|pB|j }|}|d krL|j }|j }|d vrot|d }|dkrgd|d|}tt||dS|dkr~tt|d |dStt||dS)aDownload an item by URL and return the content as a bytes object or a (base64-encoded) string. Args: item: The item to download. data_format: The format to return the content in: - `bytes`: The raw bytes of the content. - `base64`: The base64-encoded content. - `base64_uri`: The base64-encoded content as a data URI. - `text`: The content as a string. type_format: The format to return the media type in: - `mime`: The media type as a MIME type. - `extension`: The media type as an extension. Raises: UserError: If the URL points to a YouTube video or its protocol is gs://. zgs://z3Downloading from protocol "gs://" is not supported.z,Downloading YouTube videos is not supported.T)follow_redirectsNz content-type;rzapplication/octet-stream extension)base64 base64_urizutf-8rCzdata:z;base64,)r-r.rC)urlrrrr0 is_youtuber%rraise_for_statusr&r media_typeformatcontentrB b64encodedecoder,rr<) r0r1r3r$response content_typerGr.r-rOrOrSr8s2  rcCsddlm}d|S)z.Get the user agent string for the HTTP client.r __version__z pydantic-ai/)rOrNrOrOrSr*s  r*rtype[JsonSchemaTransformer]rr9cC<||j|jd}|}t|||jdur|jdS|jdS)Nstrict)parameters_json_schemarT)rUrTwalkr is_strict_compatible)rrschema_transformerrUrOrOrSrrorcCrR)NrS) json_schemarT)r[rTrVr rW)rrZrXr[rOrOrSrrYrer*rrcCst|trH|j}t|tr|jst|tr$|jr$t|jtr$t dddSt|t rJ|j |j }rL|jdkr?t |j |jdS|jrNt dddSdSdSdSdS)zeReturn an appropriate FinalResultEvent if `e` corresponds to a part that will produce a final result.N) tool_name tool_call_idoutput)rr,rr-rJr"rKrIr!r$r/rYrr]kindr^defer)r\rnew_partrRrOrOrSrs$     r)rLrm)rrIrLr)rrrrrLrf)rrGrrrrrLr )rr)r/)r0r#r1r2r3r4rLr5)r0r#r1r:r3r4rLr;)r<r/)r0r#r1r=r3r4rLr>r)rrQrr9)rrQrZr)r\r*rr?rLr)fra __future__r _annotationsrBrabcrrcollections.abcrrr contextlibrr dataclassesr r r r functoolsrrtypingrrrrrr'typing_extensionsrrrPr _json_schemar_outputrrrr _run_contextrrBr exceptionsrrpr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r_r1profilesr2r3r4 providersr5r6rkr7r8toolsr9rr:r;r?rfrrrrrr%r!rr<r+r,r8r*rrrrOrOrOrSs        L    a   s    5