o iG@sUdZddlmZddlmZddlmZmZddlZ ddl Z ddl m Z ddl mZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZmZddlmZmZmZddl m!Z!ddl"m#Z#ddl$m%Z%m&Z&m'Z'ddl(m)Z)m*Z*ddl+m,Z,e,e-dZ.ee/d<dZ0dZ1dZ2dZ3GdddeZ4GdddeZ5GdddeZ6Gd d!d!e6Z7Gd"d#d#e6Z8Gd$d%d%e6Z9Gd&d'd'e6Z:Gd(d)d)e6Z;Gd*d+d+e6Zd0e?e@efdBd1e@fd2d3ZAdS)4z"A middleware for response caching.)Sequence)Logger)Any TypedDictN)PydanticAdapter) AsyncKeyValue) MemoryStore)LimitSizeWrapper)StatisticsWrapper)KVStoreCollectionStatistics)ReadResourceContents) BaseModelField) NotRequiredSelfoverride)Prompt)Resource)CallNext MiddlewareMiddlewareContext)Tool ToolResult) get_logger)nameloggerii,i __global__c@seZdZUdZeeBed<dZedBed<defddZ e de e defd d Z e de edee fd d Ze de e deefd dZdS)CachableReadResourceContentsz6A wrapper for ReadResourceContents that can be cached.contentN mime_typereturncCs t|SN)lenmodel_dump_jsonselfr&g/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/fastmcp/server/middleware/caching.pyget_size,s z%CachableReadResourceContents.get_sizevaluescCstdd|DS)Ncss|]}|VqdSr!)r(.0itemr&r&r' 1sz9CachableReadResourceContents.get_sizes..)sumclsr)r&r&r' get_sizes/z&CachableReadResourceContents.get_sizescsfdd|DS)Ncsg|] }|j|jdqSrrr4r*r0r&r' 5sz5CachableReadResourceContents.wrap..r&r/r&r5r'wrap3r2z!CachableReadResourceContents.wrapcCsdd|DS)NcSsg|] }t|j|jdqSr3)r rrr*r&r&r'r69sz7CachableReadResourceContents.unwrap..r&r/r&r&r'unwrap7sz#CachableReadResourceContents.unwrap)__name__ __module__ __qualname____doc__strbytes__annotations__rintr( classmethodrrr1r listr7r8r&r&r&r'r&s   rc@sjeZdZUeejjed<ee e fdBed<ee e fdBed<e de de fddZde fd d ZdS) CachableToolResultrNstructured_contentmetavaluer cCs||j|j|jdSNrrDrErH)r0rFr&r&r'r7Ds zCachableToolResult.wrapcCst|j|j|jdSrG)rrrDrEr$r&r&r'r8Ls zCachableToolResult.unwrap)r9r:r;rBmcptypes ContentBlockr?dictr=rrArrr7r8r&r&r&r'rC?s rCc@s*eZdZUdZeeed<eeed<dS)SharedMethodSettingsz!Shared config for a cache method.ttlenabledN)r9r:r;r<rr@r?boolr&r&r&r'rMTs  rMc@eZdZdZdS)ListToolsSettings/Configuration options for Tool-related caching.Nr9r:r;r<r&r&r&r'rR[rRc@rQ)ListResourcesSettings3Configuration options for Resource-related caching.NrTr&r&r&r'rV_rUrVc@rQ)ListPromptsSettings1Configuration options for Prompt-related caching.NrTr&r&r&r'rXcrUrXc@s2eZdZUdZeeeed<eeeed<dS)CallToolSettingsrSincluded_toolsexcluded_toolsN)r9r:r;r<rrBr=r?r&r&r&r'rZgs rZc@rQ)ReadResourceSettingsrWNrTr&r&r&r'r]nrUr]c@rQ)GetPromptSettingsrYNrTr&r&r&r'r^rrUr^c@seZdZUeddZedBed<eddZedBed<eddZedBed<eddZ edBed<eddZ edBed<eddZ edBed<dS) ResponseCachingStatisticsN)default list_toolslist_resources list_prompts read_resource get_prompt call_tool) r9r:r;rrar r?rbrcrdrerfr&r&r&r'r_vs r_c@seZdZdZdddddddefdedBdedBdedBdedBde dBde dBd e dBd e fd d Z ed eejjdeejjeefdeefddZed eejjdeejjeefdeefddZed eejjdeejjeefdeefddZed eejjdeejjefdefddZed eejj deejj ee!fdee!fddZ"ed eejj#deejj#ejj$fdejj$fddZ%de&de'fddZ(de)fdd Z*dS)!ResponseCachingMiddlewareaThe response caching middleware offers a simple way to cache responses to mcp methods. The Middleware supports cache invalidation via notifications from the server. The Middleware implements TTL-based caching but cache implementations may offer additional features like LRU eviction, size limits, and more. When items are retrieved from the cache they will no longer be the original objects, but rather no-op objects this means that response caching may not be compatible with other middleware that expects original subclasses. Notes: - Caches `tools/call`, `resources/read`, `prompts/get`, `tools/list`, `resources/list`, and `prompts/list` requests. - Cache keys are derived from method name and arguments. N cache_storagelist_tools_settingslist_resources_settingslist_prompts_settingsread_resource_settingsget_prompt_settingscall_tool_settings max_item_sizec Cs|pt|_t|j|dd|_t|jd|_|pt|_|p t|_ |p&t |_ |p,t |_ |p2t|_|p8t|_t|jttdd|_t|jttdd|_t|jttdd|_t|jttdd|_t|jtjjd d|_t|jt d d|_!d S) aInitialize the response caching middleware. Args: cache_storage: The cache backend to use. If None, an in-memory cache is used. list_tools_settings: The settings for the list tools method. If None, the default settings are used (5 minute TTL). list_resources_settings: The settings for the list resources method. If None, the default settings are used (5 minute TTL). list_prompts_settings: The settings for the list prompts method. If None, the default settings are used (5 minute TTL). read_resource_settings: The settings for the read resource method. If None, the default settings are used (1 hour TTL). get_prompt_settings: The settings for the get prompt method. If None, the default settings are used (1 hour TTL). call_tool_settings: The settings for the call tool method. If None, the default settings are used (1 hour TTL). max_item_size: The maximum size of items eligible for caching. Defaults to 1MB. F) key_valuemax_sizeraise_on_too_large)rp tools/list)rppydantic_modeldefault_collectionresources/list prompts/listresources/read prompts/get tools/callN)"r_backendr _size_limiterr _statsrR_list_tools_settingsrV_list_resources_settingsrX_list_prompts_settingsr]_read_resource_settingsr^_get_prompt_settingsrZ_call_tool_settingsrrBr_list_tools_cacher_list_resources_cacher_list_prompts_cacher_read_resource_cacherIrJGetPromptResult_get_prompt_cacherC_call_tool_cache) r%rhrirjrkrlrmrnror&r&r'__init__sb   z"ResponseCachingMiddleware.__init__context call_nextr c|jddur||IdHS|jjtdIdH}r|S||dIdH}dd|D}|jjt||jdtd IdH|S) zList tools from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOFNkeyrc S8g|]}t|j|j|j|j|j|j|j|j|j d qS)) rtitle description parameters output_schema annotationsrEtagsrO) rrrrrrrrErrO)r+toolr&r&r'r6 z;ResponseCachingMiddleware.on_list_tools..rNrrFrN)r~getr GLOBAL_KEYputFIVE_MINUTES_IN_SECONDS)r%rr cached_valuetoolscachable_toolsr&r&r' on_list_tools   z'ResponseCachingMiddleware.on_list_toolscr) zList resources from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOFNrrc Sr)) rrrrrErrrOuri) rrrrrrErrrOr)r+resourcer&r&r'r6!rz?ResponseCachingMiddleware.on_list_resources..rNr)rrrrrr)r%rrr resourcescachable_resourcesr&r&r'on_list_resourcesrz+ResponseCachingMiddleware.on_list_resourcescr) zList prompts from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOFNrrc Ss0g|]}t|j|j|j|j|j|j|jdqS))rrrrrErO arguments)rrrrrrErOr)r+promptr&r&r'r6Is z=ResponseCachingMiddleware.on_list_prompts..rNr)rrrrrr)r%rrrpromptscachable_promptsr&r&r'on_list_prompts8s    z)ResponseCachingMiddleware.on_list_promptscs|jj}|jddus|j|ds||dIdHS|dt|jj}|jj|dIdH}r6|S||dIdH}t j |d}|jj |||jd t d IdH|S) zCall a tool from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOF) tool_namerN:r)rFrNr) messagerrr_matches_tool_cache_settings_get_arguments_strrrr8rCr7rONE_HOUR_IN_SECONDS)r%rrr cache_keyr tool_resultcachable_tool_resultr&r&r' on_call_tool^s.   z&ResponseCachingMiddleware.on_call_toolcs|jddur||dIdHSt|jj}|jj|dIdH}r)tj|dS||dIdH}tj|d}|jj |||jdt dIdHtj|dS) zRead a resource from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOFrNr)r)rNr) rrr=rrrrr8r7rrr%rrrrrFr&r&r'on_read_resources      z*ResponseCachingMiddleware.on_read_resourcecs|jddur||dIdHS|jjdt|jjd}|jj|dIdH}r-|S||dIdH}|jj|||jdtd IdH|S) zGet a prompt from the cache, if caching is enabled, and the result is in the cache. Otherwise, otherwise call the next middleware and store the result in the cache if caching is enabled.rOFrNrrrrNr) rrrrrrrrrrr&r&r' on_get_prompts   z'ResponseCachingMiddleware.on_get_promptrcCs<|jd}r||vrdS|jd}r||vrdSdS)zsN             "U