o iv@s6dZddlZddlmZmZddlZddlmZddlm Z m Z ddl m Z m Z mZmZmZmZmZeeZejddddddddf d e d eeejd d fd edede deeeeejdd fdeeeeejdd fdedeeeejdd fdeeejdd fdeeejdd fddfddZdS)z7Contains command to upload a large folder with the CLI.N) AnnotatedOptional)logging)ANSIdisable_progress_bars) PrivateOpt RepoIdArgRepoType RepoTypeOpt RevisionOptTokenOpt get_hf_apiFrepo_id local_pathz#Local path to the folder to upload.)help repo_typerevisionprivateincludez'Glob patterns to match files to upload.excludez.Glob patterns to exclude from files to upload.token num_workersz:Number of workers to use to hash, upload and commit files. no_reportz)Whether to disable regular status report.no_barsz!Whether to disable progress bars.returnc Cshtj|s tjdddttd|d| rtt |d} | j |||j |||||| d dS) zDUpload a large folder to the Hub. Recommended for resumable uploads.z+Large upload is only supported for folders.r) param_hintaYou are about to upload a large folder to the Hub using `hf upload-large-folder`. This is a new feature so feedback is very welcome! A few things to keep in mind: - Repository limits still apply: https://huggingface.co/docs/hub/repositories-recommendations - Do not start several processes in parallel. - You can interrupt and resume the process at any time. The script will pick up where it left off except for partially uploaded files that would have to be entirely reuploaded. - Do not upload the same folder to several repositories. If you need to do so, you must delete the `./.cache/huggingface/` folder first. Some temporary metadata will be stored under `a/.cache/huggingface`. - You must not modify those files manually. - You must not delete the `./.cache/huggingface/` folder while a process is running. - You can delete the `./.cache/huggingface/` folder to reinitialize the upload state when process is not running. Files will have to be hashed and preuploaded again, except for already committed files. If the process output is too verbose, you can disable the progress bars with `--no-bars`. You can also entirely disable the status report with `--no-report`. For more details, run `hf upload-large-folder --help` or check the documentation at https://huggingface.co/docs/huggingface_hub/guides/upload#upload-a-large-folder.)r) r folder_pathrrrallow_patternsignore_patternsr print_reportN) ospathisdirtyper BadParameterprintryellowrrupload_large_foldervalue) rrrrrrrrrrrapir+m/var/www/html/karishye-ai-python/venv/lib/python3.10/site-packages/huggingface_hub/cli/upload_large_folder.pyr(s. ,   r()__doc__r!typingrrr$huggingface_hubrhuggingface_hub.utilsrr _cli_utilsrr r r r r r get_logger__name__loggermodelstrArgumentlistOptionintboolr(r+r+r+r,s $      $*