o i"@sdZddlmZddlmZmZmZddlmZm Z m Z m Z m Z m Z ddlmZmZer2ddlmZGdddeZGd d d e eeeefBZd S) z`This module provides the EvaluatorSpec class for specifying evaluators in a serializable format.) annotations) TYPE_CHECKINGAnycast) BaseModel RootModelValidationErrorfield_validatormodel_serializermodel_validator)SerializationInfoSerializerFunctionWrapHandler)ModelWrapValidatorHandlerc@sneZdZUdZded< ded< eddd Zedd d Zed de dddZ e d ddddZ dS) EvaluatorSpecaThe specification of an evaluator to be run. This class is used to represent evaluators in a serializable format, supporting various short forms for convenience when defining evaluators in YAML or JSON dataset files. In particular, each of the following forms is supported for specifying an evaluator with name `MyEvaluator`: * `'MyEvaluator'` - Just the (string) name of the Evaluator subclass is used if its `__init__` takes no arguments * `{'MyEvaluator': first_arg}` - A single argument is passed as the first positional argument to `MyEvaluator.__init__` * `{'MyEvaluator': {k1: v1, k2: v2}}` - Multiple kwargs are passed to `MyEvaluator.__init__` strname"None | tuple[Any] | dict[str, Any] argumentsreturntuple[Any, ...]cCst|jtr |jSdS)zGet the positional arguments for the evaluator. Returns: A tuple of positional arguments if arguments is a tuple, otherwise an empty tuple. ) isinstancertupleselfrrd/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/pydantic_evals/evaluators/spec.pyargs, zEvaluatorSpec.argsdict[str, Any]cCst|jtr |jSiS)zGet the keyword arguments for the evaluator. Returns: A dictionary of keyword arguments if arguments is a dict, otherwise an empty dict. )rrdictrrrrkwargs7rzEvaluatorSpec.kwargswrap)modevaluerhandler(ModelWrapValidatorHandler[EvaluatorSpec]c Cs^z||}|WSty.}zzt|}Wn ty|w|WYd}~Sd}~ww)aDeserialize an EvaluatorSpec from various formats. This validator handles the various short forms of evaluator specifications, converting them to a consistent EvaluatorSpec instance. Args: value: The value to deserialize. handler: The validator handler. Returns: The deserialized EvaluatorSpec. Raises: ValidationError: If the value cannot be deserialized. N)r_SerializedEvaluatorSpecmodel_validateto_evaluator_spec)clsr#r$resultexc deserializedrrr deserializeBs zEvaluatorSpec.deserializer infor cCsXt|jtr(|jdr(|jdur|jSt|jtr"|j|jdiS|j|jiS||S)aoSerialize using the appropriate short-form if possible. Returns: The serialized evaluator specification, using the shortest form possible: - Just the name if there are no arguments - {name: first_arg} if there's a single positional argument - {name: {kwargs}} if there are multiple (keyword) arguments use_short_formNr)rcontextrgetrrr)rr$r.rrr serialize^s   zEvaluatorSpec.serializeN)rr)rr)r#rr$r%rr)r$r r.r rr) __name__ __module__ __qualname____doc____annotations__propertyrr r classmethodr-r r2rrrrrs     rc@sLeZdZdZededddZedd d Zedd dZ dddZ dS)r&zInternal class for handling the serialized form of an EvaluatorSpec. This is an auxiliary class used to serialize/deserialize instances of EvaluatorSpec from their serialized representation in YAML or JSON. rootr#str | dict[str, Any]rrcCs4t|tr|St|dkrtdt||S)a Enforce that the root value has exactly one key (the evaluator name) when it is a dict. Args: value: The value to validate. Returns: The validated value. Raises: ValueError: If the value is a dict with multiple keys. zFExpected a single key containing the Evaluator class name, found keys )rrlen ValueErrorlistkeys)r)r#rrrenforce_one_keyzs  z(_SerializedEvaluatorSpec.enforce_one_keyrcCs$t|jtr |jStt|jS)zyGet the name of the evaluator from the serialized form. Returns: The name of the evaluator. )rr:rnextiterr@rrrr_names z_SerializedEvaluatorSpec._namercCsht|jtrdStt|j}t|tr.t|}t dd|Dr.t ttt f|St t |fS)zGet the arguments for the evaluator from the serialized form. Returns: The arguments for the evaluator, which can be None (no arguments), a tuple (one positional arguments), or a dict (multiple keyword arguments). Ncss|]}t|tVqdS)N)rr).0krrr sz1_SerializedEvaluatorSpec._args..) rr:rrBrCvaluesrr?r@allrr)rr#r@rrr_argss    z_SerializedEvaluatorSpec._argsrcCst|j|jdS)zsConvert this serialized form to an EvaluatorSpec. Returns: An EvaluatorSpec instance. )rr)rrDrJrrrrr(sz*_SerializedEvaluatorSpec.to_evaluator_specN)r#r;rr)rr)rr)rr) r3r4r5r6r r9rAr8rDrJr(rrrrr&ss  r&N)r6 __future__rtypingrrrpydanticrrrr r r pydantic_core.core_schemar r rrrrr&rrrrs   $\