o v&i@sdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddl m Z ddlmZmZe e jZdd d ZdddZdddZdddZdddZdS)z"Better tokenizing for coverage.py.) annotationsN)Iterable)env)TLineNoTSourceTokenLinestoks TokenInfosreturnc csd}d}d}|D]|\}}\}}\}} } ||krk|ri|drid} |dr)d} n#|tjkrA|dr>|d|r>d} nd} n tjjrL|tjkrLd} | rit| d d d } t d d|| f|| d f|V| }|t j t j fvru|}t ||||f|| f| V|}q dS)aBReturn all physical tokens, even line continuations. tokenize.generate_tokens() doesn't return a token for the backslash that continues lines. This wrapper provides those tokens so that we can re-create a faithful representation of the original source. Returns the same values as generate_tokens() Nz\ T\Fz \  i)endswithtokenSTRINGrstripr PYBEHAVIORfstring_syntaxFSTRING_MIDDLElensplittokenize TokenInfoNEWLINENL) r last_line last_lineno last_ttextttypettextslinenoscolelinenoecolltextinject_backslashccolr*Y/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/coverage/phystokens.py _phys_tokenssD     r,sourcestr set[TLineNo]cCsvt}tt|D]-}t|tjr'||j|jD] }||j jqq t j dkr8t|tj r8||jq |S)zCHelper for finding lines with soft keywords, like match/case lines.) ) setastwalkparse isinstanceMatchaddlinenocasespatternsys version_info TypeAlias)r-soft_key_linesnodecaser*r*r+find_soft_key_lines]s    rBrccstjtjtjtjh}g}d}|ddd}t|}t |}t |D]\}}\}} \} } } d} t d|D]} | dkrG|Vg}d}d}n| dkrNd}n||vrUd}nxt jjrn|tjkrn| d d d d } | t| } | r| |kr|d d| |fd} tj|ddd}|tjkrt|rd}n)t|rt|dkrd}nt|dkr|ddd krd}nd}|r||vrd}||| fd}d} q7|r| }q$|r|VdSdS)aGenerate a series of lines, one for each line in `source`. Each line is a list of pairs, each pair is a token:: [('key', 'def'), ('ws', ' '), ('nam', 'hello'), ('op', '('), ... ] Each pair has a token class, and the token text. If you concatenate all the token texts, and then join them with newlines, you should have your original `source` back, with two differences: trailing white space is not preserved, and a final line with no newline is indistinguishable from a final line with a newline. rz r Tz( )Fr {z{{}z}}ws xxNr0keyr)rINDENTDEDENTrrr expandtabsreplacegenerate_tokensrBr,rerrrrrrappendtok_namegetlowerNAMEkeyword iskeyword issoftkeyword)r- ws_tokenslinecoltokgenr?r!r"sliner$_r& mark_startpartmark_end tok_classis_start_of_liner*r*r+source_token_linesls\        rctextcCst|j}t|S)zA helper around `tokenize.generate_tokens`. Originally this was used to cache the results, but it didn't seem to make reporting go faster, and caused issues with using too much memory. )ioStringIOreadlinerrN)rdrgr*r*r+rNs  rNbytescCst|dj}t|dS)zDetermine the encoding for `source`, according to PEP 263. `source` is a byte string: the text of the program. Returns a string, the name of the encoding. Tr)iter splitlines__next__rdetect_encoding)r-rgr*r*r+source_encodingsrm)rrr r)r-r.r r/)r-r.r r)rdr.r r)r-rhr r.)__doc__ __future__rr3rerUrOr<rrcollections.abcrcoveragercoverage.typesrrrrr,rBrcrNrmr*r*r*r+s$      F  E