o i<@s$UddlmZddlZddlZddlZddlZddlmZddlm Z m Z ddl m Z m Z mZmZmZddlmZmZddlmZddlmZdd lmZmZdd lmZmZmZmZmZm Z dd l!m"Z"dd l#m$Z$m%Z%dd l&m'Z(ddl)m*Z*ddl+m,Z,ddl-m.Z.m/Z/m0Z0m1Z1ddl2m3Z3ddl4m5Z5m6Z6ddl7m8Z8m9Z9ddl:m;Z;mZ>m?Z?m@Z@mAZBmCZCmDZDmEZFddl@mGZGddlHmIZImJZJddlKmLZLddlMmNZNmOZOmPZPmQZQmRZRmSZSmTZTmUZUerddlVmWZWdZXe$dZYe$dZZe[dZ\edZ] e$d Z^e$d!Z_ee`eBjage`eBjafZbee`eBjage e`eBjafZceeQe^e`eBjage`eBjafZdeeQe^e`eBjage e`eBjafZeebecBede^Beee^BZf ejgd"d#Gd$d%d%Zhejgd"d#Gd&d'd'ee^eIfZiGd(d)d)e5eheie^efeDjje<fZkdd.d/ZlejgGd0d1d1eke^e`s zGraphAgentState.rUrun_idNmax_result_retrieserrorBaseException | Nonemodel_settingsModelSettings | NonereturnNonecCs|jd7_|j|krv|jrUt|jd}tjrU|jdkrU|jrUt|jd}tjrUz|Wn!t yT|rC|p?i dnd}t d|durN|nddwd|d }|rqt|t j rk|jdurk|j}t ||t |dS) Nr(length max_tokenszModel token limit (zprovider defaultz) exceeded while emitting a tool call, resulting in incomplete arguments. Increase max tokens or simplify tool call arguments to fit within limit.zExceeded maximum retries (z) for output validation)rRrO isinstance _messages ModelResponse finish_reasonparts ToolCallPart args_as_dict Exceptiongetr+IncompleteToolCallUnexpectedModelBehavior __cause__)selfr\r]r_model_response tool_callremessagerXrXrYincrement_retriesbs4       z!GraphAgentState.increment_retries)NN)r\rQr]r^r_r`rarb)__name__ __module__ __qualname____doc__ dataclassesrlistrO__annotations___usageRunUsager/rRrSr[rvrXrXrXrYr=Xs   r=c@seZdZUdZded<ded<ded<ded <d ed <d ed <ded<ded<ded<ded<ded<ded<ejddZded<ded<ded <d!ed"<d#S)$r>z.Dependencies/config passed to the agent graph.rI user_deps,str | Sequence[_messages.UserContent] | NonepromptrQnew_message_indexz models.Modelmodelr`r__usage.UsageLimits usage_limitsr\ EndStrategy end_strategyz4Callable[[RunContext[DepsT]], Awaitable[str | None]]get_instructionsz!_output.OutputSchema[OutputDataT] output_schemaz1list[_output.OutputValidator[DepsT, OutputDataT]]output_validators!Sequence[HistoryProcessor[DepsT]]history_processorsF)reprzlist[AbstractBuiltinTool] builtin_toolsToolManager[DepsT] tool_managerrtracerzInstrumentationSettings | Noneinstrumentation_settingsN)rwrxryrzr}r{rrrXrXrXrYr>s$  r>c@seZdZdZdS) AgentNodezThe base class for all agent nodes. Using subclass of `BaseNode` for all nodes reduces the amount of boilerplate of generics everywhere N)rwrxryrzrXrXrXrYrsrnodeeBaseNode[GraphAgentState, GraphAgentDeps[T, Any], result.FinalResult[S]] | End[result.FinalResult[S]]raTypeGuard[AgentNode[T, S]]cCs t|tS)aCheck if the provided node is an instance of `AgentNode`. Usage: if is_agent_node(node): # `node` is an AgentNode ... This method preserves the generic parameters on the narrowed type, unlike `isinstance(node, AgentNode)`. )rfr)rrXrXrY is_agent_nodes rc@seZdZUdZded<ded<dZded<dZd ed <eje d Z d ed <eje d Z ded<eje d Z d ed<ejed Zded<d'ddZd(ddZd)d"d#Zd*d%d&ZeZdS)+r?z7The node that handles the user prompt and instructions.r user_promptzdataclasses.KW_ONLY_NzDeferredToolResults | Nonedeferred_tool_results str | None instructionsrLz.list[_system_prompt.SystemPromptRunner[DepsT]]instructions_functionsztuple[str, ...]system_promptssystem_prompt_functionsz3dict[str, _system_prompt.SystemPromptRunner[DepsT]]system_prompt_dynamic_functionsctxDGraphRunContext[GraphAgentState, GraphAgentDeps[DepsT, NodeRunEndT]]raHModelRequestNode[DepsT, NodeRunEndT] | CallToolsNode[DepsT, NodeRunEndT]c s,zt}Wn tyg}Yn w|jrg}n|j}d|_t|jj|dd<||j_t||j_ |j durB| |j ||IdHSd}|r|d}rt |t jr|jdur|t j|jd}dd|jD}|rt|dkrz|dj|j_n:g}|D]}t |jtr||jq~||jq~||j_nt |t jr|jdurtttf|S|jrtdt|} |r||| IdH|r||g| IdHn#g} |s| | | IdH|jdur| t !|jt j| d}|j"| IdH|_#|s |js |j#s td t$ttf|d S) NTrcrjcSsg|] }t|tjr|qSrX)rfrgUserPromptPart).0partrXrXrY sz&UserPromptNode.run..r(rZCannot provide a new user prompt when the message history contains unprocessed tool calls.z9No message history, user prompt, or instructions provided)request)%get_captured_run_messages LookupErrorusedr,_clean_message_historystaterOlendepsrr_handle_deferred_tool_resultsrfrg ModelRequestrpoprjcontentrrUappendextendrhrArIr' tool_callsr+ UserErrorrB_reevaluate_dynamic_prompts _sys_partsrrrr@) rrr ctx_messagesr, next_message last_messageuser_prompt_partscombined_contentr run_contextrjrXrXrYrunsj           zUserPromptNode.runr6r,rN!CallToolsNode[DepsT, NodeRunEndT]cs^|stdd}d}t|D]}t|tjr|}qt|tjr%|}nq|s-td|js5td|jdur?tdd}i}|j D]\}} | durTt } n| dur[t } | ||<qH|j } rtt} | D]\}} t| | s{t| } | ||<qm|r|jD]} t| tjtjBr| j|vrtd| jdd || j<qtttf||d S) NzBTool call results were provided, but the message history is empty.z\Tool call results were provided, but the message history does not contain a `ModelResponse`.zeTool call results were provided, but the message history does not contain any unprocessed tool calls.rTFz Tool call z: was already executed and its result cannot be overridden.skip)tool_call_results)r+rreversedrfrgrrhrr approvalsitemsr8r:callsrr4 ToolReturnrjToolReturnPartRetryPromptPart tool_call_idrArIr')rrrr,rlast_model_requestlast_model_responserurrapprovalrcall_result_typesr.rrXrXrYrs`              z,UserPromptNode._handle_deferred_tool_resultsrRunContext[DepsT]rbcs|jrF|D]A}t|tjrEg}|jD])}t|tjr7|jr7|j|j}r7||IdH}tj||jd}| |q||jkrE||_qdSdS)zvReevaluate any `SystemPromptPart` with dynamic_ref in the provided messages by running the associated runner function.N dynamic_ref) rrfrgrrjSystemPromptPartrrnrr)rrr,rmsgreevaluated_message_partsrrunnerupdated_part_contentrXrXrYrPs$    z*UserPromptNode._reevaluate_dynamic_prompts list[_messages.ModelRequestPart]csbdd|jD}|jD]"}||IdH}|jr&|tj||jjdq |t|q |S)z0Build the initial messages for the conversation.cSsg|]}t|qSrX)rgr)rprXrXrYrjsz-UserPromptNode._sys_parts..Nr) rrrdynamicrrgrfunctionry)rrrr,sys_prompt_runnerrrXrXrYrhs zUserPromptNode._sys_parts)rrrar)rr6r,rNrrrar)r,rNrrrarb)rrrar)rwrxryrzr}rrr{rr|rtuplerrdictrrrrrr__repr__rXrXrXrYr?s"     N ;  r?rrmodels.ModelRequestParametersc s~|jj}t|tjr|jnd}g}g}|jjjD]}|jdkr&| |q| |qt j ||jj |j ||j||j|jdS)z&Build tools and create an agent model.Noutput)function_toolsr output_mode output_tools output_objectprompted_output_templateallow_text_outputallow_image_output)rrrfr)PromptedOutputSchematemplater tool_defskindrr-ModelRequestParametersrmode object_def allows_text allows_image)rrrrrtool_defrXrXrY_prepare_request_parametersvs(   rc@seZdZUdZded<eddddZded<eddddZd ed <dddZe dddZ dddZ d ddZ d!ddZ eZdS)"r@z[The node that makes a request to the model using the last message in state.message_history.z_messages.ModelRequestrFN)rinitdefaultz(CallToolsNode[DepsT, NodeRunEndT] | None_resultbool _did_streamrrrarcs2|jdur |jS|jrtd||IdHS)Nz.You must finish streaming before calling run())rrr+ AgentRunError _make_requestrrrrXrXrYrs   zModelRequestNode.run:GraphRunContext[GraphAgentState, GraphAgentDeps[DepsT, T]]+AsyncIterator[result.AgentStream[DepsT, T]]c Cs|jrJd||IdH\}}}}|jj||||4IdH>}d|_|jjjd7_tj t t f||jj ||jj t||jj|jjd}|V|2z3dHW}qN6WdIdHn 1IdHsfwY|} ||| |jdus|JdS)Nz,stream() should only be called once per nodeTr()_raw_stream_response_output_schema_model_request_parameters_output_validators_run_ctx _usage_limits _tool_manager)r_prepare_requestrrrequest_streamrr/requestsr. AgentStreamrIrErrrBrrrn_finish_handlingr) rrrr_model_request_parametersrOrstreamed_response agent_streamrrsrXrXrYstreams4   ( zModelRequestNode.streamcs`|jdur |jS||IdH\}}}}|jj|||IdH}|jjjd7_|||SNr() rrrrrrr/r r )rrrr_r rOrrsrXrXrYrs  zModelRequestNode._make_requestktuple[ModelSettings | None, models.ModelRequestParameters, list[_messages.ModelMessage], RunContext[DepsT]]c s|jjp|jj|j_|jj|j|jjd7_t|}|jj |IdH|j_|jjdd}t ||jj |IdH}||jjdd<|jj t |t |8_ t|}t|IdH}|jj}|jj}|jjjrt|}|jj|||IdH}|||jj|||||fSr)rr[rrOrrSrBrr for_run_step_process_message_historyrrrrrr_r/rcount_tokens_before_requestrr count_tokensincrcheck_before_request) rrrroriginal_historyrOr r_r/ counted_usagerXrXrYrs(   z!ModelRequestNode._prepare_requestresponse_messages.ModelResponsecCsX|jp|jj|_|jj|j|jjr|jj|jj|jj|t ||_ |j SrT) r[rr/rrr check_tokensrOrrAr)rrrrrXrXrYr s z!ModelRequestNode._finish_handling)rrrar)rrrar)rrrar)rrrrrar)rwrxryrzr}rrrrr rrrr rrrXrXrXrYr@s    (r@c@seZdZUdZded<dZded<eddddZd ed <eddddZd ed <d.ddZ e d/ddZ d0ddZ d1ddZ d2d!d"Zd3d%d&Zd4d,d-ZeZdS)5rAzcThe node that processes a model response, and decides whether to end the run or make a new request.rrsN6dict[str, DeferredToolResult | Literal['skip']] | NonerF)rrrz3AsyncIterator[_messages.HandleResponseEvent] | None_events_iteratorzRModelRequestNode[DepsT, NodeRunEndT] | End[result.FinalResult[NodeRunEndT]] | None _next_noderrraKModelRequestNode[DepsT, NodeRunEndT] | End[result.FinalResult[NodeRunEndT]]c sX||4IdH WdIdHn 1IdHswY|jdus)Jd|jS)Nz6the stream should set `self._next_node` before it ends)rr rrXrXrYr!s (zCallToolsNode.run;AsyncIterator[AsyncIterator[_messages.HandleResponseEvent]]cCs*||}|V|2z3dHW}q 6dS)z]Process the model response and yield events for the start and end of each function tool call.N) _run_stream)rrrr_eventrXrXrYr)s  zCallToolsNode.stream,AsyncIterator[_messages.HandleResponseEvent]csNjdurjjdfdd }|_j2z 3dHW}|Vq6dS)Nrar%c sjjsyj}rPtjjD]?}t|tjrOd}|jD]}t|tj r+||j 7}qt|tj r3d}q|rOz ||IdH_ WdStyNYqwqjjjjjjdt}j|IdH}tttftjg|d_ dSd}g}g}jjD]N}t|tj r||j 7}qt|tjr||qt|tjr||j qt|tj rd}t|Vqt|tjrt|Vqt|tjrqt |qzwg}|r!|2z 3dHW} | Vq6WdSj"r|dn|dj#rt$dd|Dd} r%| IdH_ WdS|dj}r9|r3 ||IdH_ WdS|&d d tj'd d (|d d} t| ty} z1jjjj| jjdt}j|IdH}tttftj| j)g|d_ WYd} ~ dSd} ~ ww)Nr_rjrz$include your response in a tool callz call a toolcss |] }t|tjr|VqdSrT)rfrg BinaryImage)rfilerXrXrY szACallToolsNode._run_stream.._run_stream..zreturn an imagerz return textzPlease z or .rr]r_)*rsrjtext_processorrrrOrfrgrhTextPartrBuiltinToolCallPart_handle_text_responser r0rvrr\r_rBrr@rIr'rrkrFilePartBuiltinToolCallEventBuiltinToolReturnPartBuiltinToolResultEvent ThinkingPartr_handle_tool_callstoolsetrnext_handle_image_responseinsertrjoin tool_retry) r/rutextrrrrfiles alternativeseventimagemerrrrrXrYr#=s                         z.CallToolsNode._run_stream.._run_stream)rar%)rrr)rrrr#rBrXrFrYr#5s izCallToolsNode._run_streamrlist[_messages.ToolCallPart]c Cst|}|jj|IdH|j_g}tdd}t|jj||jd|||d2z 3dHW}|Vq&6|rA|d}|||||_dS|j |IdH}t t t ft j||d|_dS)Nr(maxlen)rrr final_resultr output_partsoutput_final_resultrr()rBrrrrprocess_tool_callsr_handle_final_resultr rr@rIr'rgr) rrrrrrKrLrBrJrrXrXrYr8s.      z CallToolsNode._handle_tool_callsr?rUr/(_output.BaseOutputProcessor[NodeRunEndT]csPt|}|||IdH}|jjD] }|||IdH}q||t|gSrT)rBprocessrrvalidaterNr. FinalResult)rrrr?r/r result_data validatorrXrXrYr2s  z#CallToolsNode._handle_text_responserC_messages.BinaryImagecs tt|}||t|gSrT)rr'rNr.rR)rrrrCrSrXrXrYr;s z$CallToolsNode._handle_image_responserJresult.FinalResult[NodeRunEndT]tool_responsesr$End[result.FinalResult[NodeRunEndT]]cCs,|jj}|r|tj||jjdt|S)N)rjr[)rrOrrgrr[r&)rrrrJrWr,rXrXrYrNsz"CallToolsNode._handle_final_result)rrrar!)rrrar")rrrar%)rrrrGrar%)rrr?rUr/rOrar!)rrrCrUrar!)rrrJrVrWrrarX)rwrxryrzr}rrrr rr rr#r8r2r;rNrrrXrXrXrYrAs"     v !  rAc@s$eZdZUdZded<d dd Zd S) SetFinalResultz^A node that immediately ends the graph run after a streaming response produced a final result.rVrJrrrarXcs t|jSrT)r&rJrrXrXrYrs zSetFinalResult.runN)rrrarX)rwrxryrzr}rrXrXrXrYrYs rYoz%process_tool_calls..zMTool call results need to be provided for all deferred tool calls. Expected: z, got: cSsi|] \}}|dkr||qS)rrX)rcall_idr.rXrXrY wsz&process_tool_calls..csg|] }|jvr|qSrXrfrgcalls_to_run_resultsrXrYrxz&process_tool_calls..)rrrrr/rrKoutput_deferred_callszA deferred tool call was present, but `DeferredToolRequests` is not among output types. To resolve this, add `DeferredToolRequests` to the list of output types for this agent.)rr))rr| get_tool_defrcrrrrgrFunctionToolCallEventFunctionToolResultEvent handle_callr+rprrvrr\r_r0r>r.rRrrsetkeysrr _call_toolsrr/rrfrr)DeferredToolRequestsrallows_deferred_toolsrr')rrrrJrrKrLtool_calls_by_kindrhrrrrSrE calls_to_runresult_tool_call_idstool_call_ids_to_rundeferred_callsrBrdeferred_tool_requestsrXrmrYrMs                  rMdict[str, DeferredToolResult]rrr/rPrrrpEdict[Literal['external', 'unapproved'], list[_messages.ToolCallPart]]c siii|jdurt|}|jt|7_|||D]} t| Vq |jddd|Ddt|dt|dkr@dndd d jdfdd } |rvt |D]\} } | t |  | j | IdH} rt| Vq[n5fdd|D} | }|rt j|t jdIdH\}}|D]}| |} | || dIdH} r| Vq|sWdn1swY|fddtD|fddtDtD] }||||qdS)Nz running toolscSsg|]}|jqSrX)rcrgrXrXrYrrjz_call_tools..zrunning z toolr(r&s)toolsz logfire.msg) attributes coro_or_taskAwaitable[tuple[_messages.ToolReturnPart | _messages.RetryPromptPart, str | Sequence[_messages.UserContent] | None]] | Task[tuple[_messages.ToolReturnPart | _messages.RetryPromptPart, str | Sequence[_messages.UserContent] | None]]indexrQra$_messages.HandleResponseEvent | Nonecszt|r |IdHn|\}}Wntjy"d|<YdStjy0d|<YdSw||<|r?tj|d|<tj||dS)Nrdrer-) inspect isawaitabler.r+ CallDeferredApprovalRequiredrgrrs)rr tool_parttool_user_content)deferred_calls_by_indextool_parts_by_indexuser_parts_by_indexrXrYhandle_call_or_results  z*_call_tools..handle_call_or_resultc s,g|]}tjt||j|jdqS))name)asyncio create_task _call_toolrnrrcrg)rrrXrYrs) return_when)rrcg|]}|qSrXrXrk)rrXrYrcrrXrXr)rrXrYrr)rrrrQrar)tool_calls_limitrrrcheck_before_tool_callrgrrstart_as_current_spanshould_call_sequentially enumeraterrnrrwaitFIRST_COMPLETEDrrsortedr)rrrrr/rrKrpprojected_usagerhrrrBtaskspendingdonetaskrrX)rrrrrrYrwsZ    "   ? rwrt_messages.ToolCallParttool_call_resultDeferredToolResult | Noneituple[_messages.ToolReturnPart | _messages.RetryPromptPart, str | Sequence[_messages.UserContent] | None]c sDzh|dur||IdH}nYt|tr,|jdur!tj||jd}|j|ddIdH}n.zThe `return_value` of tool zS contains invalid nested `MultiModalContent` objects. Please use `content` instead.)rcrrmetadata)rtrfr8 override_argsr{rr:rgrrcrurr+ ModelRetryrr0r>rr|rrrr identifierrrrranyrr)rrtr tool_resultrDrE tool_returnresult_is_listcontents return_values user_contentsrr return_partrXrXrYr s              rc@s"eZdZUded<dZded<dS) _RunMessagesrNr,FrrN)rwrxryr}rrXrXrXrYr_s rvarzContextVar[_RunMessages]_messages_ctx_var&Iterator[list[_messages.ModelMessage]]c cstd}g}ztj}Wntytt|}Ynwz|VW|dur-t|dSdS|dur9t|ww)aTContext manager to access the messages used in a [`run`][pydantic_ai.agent.AbstractAgent.run], [`run_sync`][pydantic_ai.agent.AbstractAgent.run_sync], or [`run_stream`][pydantic_ai.agent.AbstractAgent.run_stream] call. Useful when a run may raise an exception, see [model errors](../agents.md#model-errors) for more information. Examples: ```python from pydantic_ai import Agent, capture_run_messages agent = Agent('test') with capture_run_messages() as messages: try: result = agent.run_sync('foobar') except Exception: print(messages) raise ``` !!! note If you call `run`, `run_sync`, or `run_stream` more than once within a single `capture_run_messages` context, `messages` will represent the messages exchanged during the first call only. N)rrnr,rrurreset)tokenr,rXrXrYrChs  rCcCstSrT)rrnrXrXrXrYrsrrr deps_type type[DepsT] output_typeOutputSpec[OutputT]sGraph[GraphAgentState, GraphAgentDeps[DepsT, OutputT], UserPromptNode[DepsT, OutputT], result.FinalResult[OutputT]]c Cst|pdttttftttftjtdd}|| |j  tttf| tttf| t ttf| tttf| tttf|jddS)zDBuild the execution [Graph][pydantic_graph.Graph] for a given agent.AgentF)r state_typer input_typerauto_instrument)validate_graph_structure)r%r=r>rIrJr?r.rRadd edge_from start_nodetorr@rArYbuild)rrrgrXrXrYbuild_agent_graphs$      rr,rN processorsrrcs|D]B}t|}t|r%|r|||IdH}qtt|}||IdH}q|r8ttt|}t|||IdH}qtt|}t||IdH}qt|dkrQt dt |dt j s^t d|S)z9Process message history through a sequence of processors.Nrz"Processed history cannot be empty.rcz1Processed history must end with a `ModelRequest`.) is_takes_ctxrr_HistoryProcessorAsync_HistoryProcessorSyncWithCtxrIr _HistoryProcessorSyncrr+rrfrgr)r,rr processor takes_ctxasync_processorsync_processor_with_ctxsync_processorrXrXrYrs$     rcCs.g}|D]}t|dkr|dnd}t|tjrR|rLt|tjrL|jr,|jr,|j|jkrLg|j|j}|jdddtj||jpD|jd}||d<q||qt|tjr|rt|tjr|j dur|j dur|j dur|j dur|j dur|j durt |g|j|jd}||d<q||q|S) zKClean the message history by merging consecutive messages of the same type.rrcNcSst|tjtjBr dSdS)Nrr()rfrgrr)xrXrXrYrZroz(_clean_message_history..)keyr(r) rrfrgrrrjsortrrhprovider_response_id provider_name model_namer)r,clean_messagesrurrjmerged_messagerXrXrYrsN                r)rrrar)rrrar)rrZrar)rrrrGrrrJr_rrrKrrLr`rar%)rrrrGrrrrr/rPrrrKrrprrar%)rrrtrrrrar)rar)rar)rrrrrrrar)r,rNrrrrrarN)r,rNrarN)~ __future__r _annotationsrr{rrVr collectionsrrcollections.abcrrrr r contextlibr r contextvarsr copyrrrtypingrrrrrropentelemetry.tracertyping_extensionsrrpydantic_ai._function_schemarrpydantic_ai._instrumentationrpydantic_ai._tool_managerrpydantic_ai._utilsrrrr pydantic_ai.builtin_toolsr!pydantic_graphr"r#pydantic_graph.betar$r%pydantic_graph.nodesr&r'r&r)r*r+r,rgr-r.r/r~r0rr1r2settingsr3rr4r5r6r7r8r9r:r;models.instrumentedr<__all__rErFtypeNoneTyperrIrJr| ModelMessagerrr_HistoryProcessorAsyncWithCtxrD dataclassr=r>rRrrr?rr@rArYrBrMrwrrrr}rCrrrrrXrXrXrYs         $  (     ((  B^    \T  )