Yjj 2%SSKrSSKrSSKrSSKJr SSKJrJr SSKJ r SSK J r SSK J r Jr SSKJr SSKJr SS KJrJr SS KJrJrJr SS KJrJr SSKrSSKrSS KJrJ r J!r! SS K"J#r# SSK$J%r% SSK&J'r' SSK(J)r)J*r* SSK+J,r,J-r-J.r.J/r/J0r0 SSK1J2r2J3r3 SSK4J5r5J6r6J7r7J8r8J9r9J:r:J;r; SSKr>J?r?J@r@ SSKAJBrB \ "SS55rC\ "SS\C55rD\ "SS\C55rE\F"\R5rH\\IS'"SS\H5rJ"S S!\R\JS"9rK"S#S$\RR5rN"S%S&\RR5rOS'\PS(\P4S)jrQS*\PS(\P4S+jrRS,\PS-\SS-S(\4S.jrTS/\KS,\PS0\PS1\US2\P4 S3jrVS4rW\K"5rXg)5N)deque)IterableIterator) ExitStack)deepcopy) dataclassfield)datetime)chain)Path PurePosixPath)AnyNoReturnUnion)quoteunquote)_DEFAULT_CALLBACK NoOpCallback TqdmCallback) apply_config) isfilelike) constants)CommitOperationCopyCommitOperationDelete)BucketNotFoundErrorEntryNotFoundErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundError) hf_hub_urlhttp_get)SPECIAL_REFS_REVISION_REGEX BucketFile BucketFolderHfApiLastCommitInfoRepoFile RepoFolder)HFValidationErrorhf_raise_for_status http_backoffhttp_stream_backoff)md5c<\rSrSr%Sr\\S'\\S'S\4SjrSrg) HfFileSystemResolvedPath$z_Top level Data structure containing information about a resolved Hugging Face file system path.rootpathreturncVURSUR3RS5$)N/)r2r3rstripselfs o/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/huggingface_hub/hf_file_system.py unresolve"HfFileSystemResolvedPath.unresolve+s&))Adii[)0055N) __name__ __module__ __qualname____firstlineno____doc__str__annotations__r;__static_attributes__r>r=r:r0r0$si I I636r=r0c\rSrSr%Sr\\S'\\S'\\S'\\S'\"SS9r\\S '\"SS9r \\S '\"S SS 9r \S -\S 'Sr Sr g )"HfFileSystemResolvedRepositoryPath/zLData structure containing information about a resolved path in a repository. repo_typerepo_idrevision path_in_repoFinitr2r3N)defaultrepr _raw_revisioncl[RRURS5UR-nUR (aUSUR 3UlODUR[R:wa US[UR53UlOXlURUl g)N@) rREPO_TYPES_URL_PREFIXESgetrJrKrRr2rLDEFAULT_REVISION safe_revisionrMr3)r9 repo_paths r: __post_init__0HfFileSystemResolvedRepositoryPath.__post_init__=s5599$.."MPTP\P\\   $+Qt'9'9&:;DI ]]i88 8$+Q}T]]'C&DEDI!I%% r=)r3r2) r?r@rArBrCrDrEr r2r3rRr[rFr>r=r:rHrH/sTVN LM5!D#!5!D#!!&d ?M3:?&r=rHc@\rSrSr%Sr\\S'\"SS9r\\S'Sr Sr g ) HfFileSystemResolvedBucketPathHzHData structure containing information about a resolved path in a bucket. bucket_idFrNr2c,SUR-Ulg)Nzbuckets/)r`r2r8s r:r[,HfFileSystemResolvedBucketPath.__post_init__Os/ r=)r2N) r?r@rArBrCrDrEr r2r[rFr>r=r:r^r^HsRN5!D#!0r=r^ _cached_basec2^\rSrSrSrU4SjrSrSrU=r$)_CachedWa Metaclass for caching HfFileSystem instances according to the args. This creates an additional reference to the filesystem, which prevents the filesystem from being garbage collected when all *user* references go away. A call to the :meth:`AbstractFileSystem.clear_instance_cache` must *also* be made for a filesystem instance to be garbage collected. This is a slightly modified version of `fsspec.spec._Cached` to improve it. In particular in `_tokenize` the pid isn't taken into account for the `fs_token` used to identify cached instances. The `fs_token` logic is also robust to defaults values and the order of the args. Finally new instances reuse the states from sister instances in the main thread. c4>[TU]"U0UD6 0UlgN)super__init___cache)clsargskwargs __class__s r:rj_Cached.__init__gs $)&) r=c[X5nURSS5nUR"U[R"5/UQ70UD6nUR"U[R "5R /UQ70UD6nU(d5UR(a$X@R;aX@l URU$[R"U/UQ70UD6nU(dbUR(aQXPR;aBURUR5nUR5Hup[XhU 5 M XFlXlX&lUR(aU(dX@l X`RU'U$)Nskip_instance_cacheF)rpop _tokenize threading get_ident main_threadidentcachablerk_latesttype__call___get_instance_stateitemssetattr _fs_token_ storage_argsstorage_options) rlrmrnskipfs_tokenfs_token_main_threadobjinstance_stateattr state_values r:r|_Cached.__call__os*c*zz/7==i&9&9&;MdMfM"}}S)2G2G2I2O2OaRVaZ`a ZZ)?"K::h' '--5d5f5CCLL-AZZ-O!$,@!A!U!U!W)7)=)=)?%DC{3*@%N# "( ||D& '* 8$Jr=r>) r?r@rArBrCrjr|rF __classcell__ros@r:rereWs r=rec^\rSrSrSrSrSrSSSSS.S\S-S\\-S-S \ S-S \S-4U4S jjjr \ S \ S \4Sj5r S\S\S\S-S \ \\S-44SjrS\S \ \\S-44SjrS8S\S\S-S \\-4SjjrS8S\S-S S4SjjrS9S\S\S \ S-S\S-S \S4 SjjrS8S\S\S-S S4SjjrS:S\S\S\ S-S\S-S S4 SjjrS;S\S\S \S\S-S \\\\\4-4 S!jjrSS\S \S\S-S \\\44S-jjr)S.r*S/r+S0r,S\S \4S1jr-\.S4S?U4S2jjjr/\0S35r1S4r2S5r3S6r4S7r5U=r6$)@ HfFileSystema Access a remote Hugging Face Hub repository as if were a local file system. > [!WARNING] > [`HfFileSystem`] provides fsspec compatibility, which is useful for libraries that require it (e.g., reading > Hugging Face datasets directly with `pandas`). However, it introduces additional overhead due to this compatibility > layer. For better performance and reliability, it's recommended to use `HfApi` methods when possible. The file system supports paths for the `hf://` protocol, which follows those URL schemes: * Models, Datasets and Spaces repositories: ``` hf://[@]/ hf://datasets/[@]/ hf://spaces/[@]/ ``` * Buckets (generic storage): ``` hf://buckets// ``` Note: when using the [`HfFileSystem`] directly, passing the `hf://` protocol prefix is optional in paths. Args: endpoint (`str`, *optional*): Endpoint of the Hub. Defaults to . token (`bool` or `str`, *optional*): A valid user access token (string). Defaults to the locally saved token, which is the recommended method for authentication (see https://huggingface.co/docs/huggingface_hub/quick-start#authentication). To disable authentication, pass `False`. block_size (`int`, *optional*): Block size for reading and writing files. expand_info (`bool`, *optional*): Whether to expand the information of the files. **storage_options (`dict`, *optional*): Additional options for the filesystem. See [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.__init__). Usage: ```python >>> from huggingface_hub import hffs >>> # List files >>> hffs.glob("my-username/my-model/*.bin") ['my-username/my-model/pytorch_model.bin'] >>> hffs.ls("datasets/my-username/my-dataset", detail=False) ['datasets/my-username/my-dataset/.gitattributes', 'datasets/my-username/my-dataset/README.md', 'datasets/my-username/my-dataset/data.json'] >>> # Read/write files >>> with hffs.open("my-username/my-model/pytorch_model.bin") as f: ... data = f.read() >>> with hffs.open("my-username/my-model/pytorch_model.bin", "wb") as f: ... f.write(data) ``` Specify a token for authentication: ```python >>> from huggingface_hub import HfFileSystem >>> hffs = HfFileSystem(token=token) ``` rThfN)endpointtoken block_size expand_inforrrrc>[TU]"U0UD6 U=(d [RUlX l[ XS9UlX0lX@l 0Ul 0Ul 0Ul g)N)rr) rirjrENDPOINTrrr&_apirr_repo_and_revision_exists_cache_bucket_exists_cachedircache)r9rrrrrmrros r:rjHfFileSystem.__init__sb $2/2 6I$6$6  89 $&rt,NP!:< r=threading_identr4c0URS5=(d [RUS'URS5US'[U5Vs0sHoDX4_M nnXX#4n[ [ U5R 55nUR5$s snf)zDeterministic token for cachingrr)rWrrsortedr.rDencode hexdigest)rlrrmrnkey tokenize_argshs r:rtHfFileSystem._tokenizes$ZZ 3Iy7I7Iz **W-w.4Vn=nsv{"n=t< M"))+ ,{{} >s BrJrKrLcXU4UR;aLURRX#U[RS9 SURXU4'SURXS4'URXU4$![ [ 4a0nSU4URXU4'SU4URXS4'SnANLSnAf[a.nSU4URXU4'SURXS4'SnANSnAff=f)N)rLrJtimeoutTNF)rr repo_inforHF_HUB_ETAG_TIMEOUTrr*r )r9rJrKrLes r:_repo_and_revision_exist%HfFileSystem._repo_and_revision_exists  )1U1U U ^ ##)YMjMj$Xb44i(5STS]44i$5OP33Y4RSS,->? \W\^_W_44i(5STSXZ[S[44i$5OP( ^W\^_W_44i(5STS]44i$5OP ^s#)A00C&&B++ C&8$C!!C&r`cXR;a+URRU5 SURU'URU$![anSU4URU'SnAN/SnAff=f)NrF)rr bucket_infor)r9r`rs r:_bucket_existsHfFileSystem._bucket_exists sr 55 5 B %%i08B)))4((33 ' @7._align_revision_in_path_with_revision*sQ##/4D4P$78H7IIijrist-- O,Or=z)**7>>?OPE(X$ 9N-N'B'F'FrK['\'c'cdg'h +0;;=(9I9O9OPSUV9W6(,#%L@IYAZ\de/3/L/LYai/j,'.)$4#' ),$**S/"12E)F&.1hhtzz#qr7J.K+,0JJsOA,>)14$**S/!":M1N.0: /3/L/LYai/j,'.!#(?AR'STT";'E 595R5RS\go5p2/61$<-d8GLd{,0JJsA,>)@IYAZ\de#' )-)F)Fy[c)d & #Q*)*\]]'389S9S1 FV  r=cU(d5URR5 URR5 gURU5nUR 5nU(a6URR US5 UR U5nU(aM6UR(d[U[5(aqURR URURS4S5 URR URURUR4S5 gURR URS5 gg)a3 Clear the cache for a given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.invalidate_cache). Args: path (`str`, *optional*): Path to clear from cache. If not provided, clear the entire cache. N)rclearrrr;rs_parentr3rrHrJrKrLrr`)r9r3 resolved_paths r:invalidate_cacheHfFileSystem.invalidate_cache|s MM   !  0 0 6 6 8 --d3M **,D !!$-||D)$ !%%m-OPP88<<&00-2G2GNPT88<<&00-2G2GI_I_`bf--11-2I2I4P&r=mode)HfFileSystemFileHfFileSystemStreamFilec UbUO URnUbX5S'SU;a [S5eUS:Xa[X4X$S.UD6$[X4X$S.UD6$)Nraz/Appending to remote files is not yet supported.r)rrL)rrrr)r9r3rrrLrns r:_openHfFileSystem._opensh$.#9Zt  !#-< $;%&WX X ?)$]4]V\] ]#DWTWPVW Wr=c URXS9n[U[5(a0URR UR UR /S9 OoURRURURURURURURS5URS5S9 URUR5S9 g)NrLdeletecommit_messagecommit_description)rMrKrrJrLrrr3)rrr^rbatch_bucket_filesr`r3 delete_filerMrKrrJrLrWrr;)r9r3rLrnrs r:_rmHfFileSystem._rms))$)B m%C D D II ( ()@)@-J\J\I] ( ^ II ! !*77%--jj'11&//%zz*:;#)::.B#C "  =#:#:#<=r= recursivemaxdepthc TURXS9nURXX4S9n[U[5(agUVs/sH5oR U5(aMURU5R PM7 nnUR RURUS9 OUVs/sH5oR U5(aMURU5R PM7 n nU V s/sH n [U S9PM n n SWS3n X(aSOS- n XbS US3OS- n UR RURURURU URURS U 5URS 5S 9 UR!UR#5S9 g s snfs snfs sn f)ad Delete files from a repository. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.rm). > [!WARNING] > Note: When possible, use `HfApi.delete_file()` for better performance. Args: path (`str`): Path to delete. recursive (`bool`, *optional*): If True, delete directory and all its contents. Defaults to False. maxdepth (`int`, *optional*): Maximum number of subdirectories to visit when deleting recursively. revision (`str`, *optional*): The git revision to delete from. r)rrrLr)rMzDelete  z recursively rTNz up to depth rr)rKrJr operationsrLrrr)r expand_pathrr^isdirr3rrr`r create_commitrKrJrrLrWrr;) r9r3rrrLrnrpathsr paths_in_reporMrrs r:rmHfFileSystem.rms6))$)B   X a m%C D D?D]utJJW[L\2d''-22uF] II ( ()@)@ ( PFKdedS]S]^bSc9T..t499eMd_lm_l|/\J_lJm&tfA.N  nr AN 

[!WARNING] > Note: When possible, use `HfApi.list_repo_tree()` for better performance. Args: path (`str`): Path to the directory. detail (`bool`, *optional*): If True, returns a list of dictionaries containing file information. If False, returns a list of file paths. Defaults to True. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `list[Union[str, dict[str, Any]]]`: List of file paths (if detail=False) or list of file information dictionaries (if detail=True). r)rrLNnamer)rr;_ls_treerr3rrlen) r9r3rrrLrnroutos r:lsHfFileSystem.lss4))$)B &&( 2--SgSFSCs:c":cV9c"::" 2 %%%dD1 mmDLL$6ee^de%  !7cvY$%61c7C73x1}%dD1 2#;sMAC6'C3<$B! C3! B0-C3/B00C37 CC #C32C3c | UbUOURb UROSnURXS9nUR5nURnU(aUOSn/n XR;GaU(GdURUn U R U 5 /n U(aSn [ U V s/sHoSS:XdM X4PM sn 5nU(aUR5upUbX::a}USUR;aU RUS5 OUURUSn U R U 5 UR U V s/sHn U SS:XdMU S-U 4PM sn 5 U(aM/nU(aA[U[5(a,U Vs/sHnUSbM URUS5PM! nnU(aU (dU(Ga_U(GaW[RRU U-5nURS 5(dUU:XdU[!U U5;aUR#S 5OURU5nUb"U[%U5SR'S 5nUU-nU Vs/sH#nUSR)US -5(aM!UPM% n n[+UR5H:nUR)US -5(dMURR-US5 M< URR-US5 U R UR/UUS UUUS 95 U $[U[05(a&UR3UR4URUS 9nOFUR6R9UR:URUUUR<UR>S 9nUGHun US -U R-n[U [@5(aHUU RBSU RDU RFU RHU RJU RLS.nO[U [N5(a2UU RBSU RHU RPU RRS.nOC[U [T5(aUSSU RVU RJS.nOUSSU RRS.nURUS5nURRYU/5RU5 U[%U5SR'S 5n UbX::dGMdU RU5 GMx U $s sn fs sn fs snfs snf)NFrrrr{ directoryr last_commitr6T)rrrLrr)prefixr)rexpandrLrJfilersizer{blob_idlfsxet_hashrsecurity)rrr{r mtime uploaded_atrrrr{tree_idr)rrr{r)-rrr;r2rextendrpopleftappendrrHrosr3 commonprefixendswithr r7rr startswithlistrsrr^_list_bucket_tree_with_foldersr`rlist_repo_treerKrLrJr(rr r r rr r$r rr)r setdefault)r9r3rrrLrrr root_pathrcached_path_infosdirs_not_in_dircachedepth path_info dirs_to_visitdir_infodirs_not_expandedr common_prefix common_pathcommon_path_depth cached_pathtree cache_pathcache_path_info parent_paths r:rHfFileSystem._ls_trees'2KTM]M]Mi9I9Iot ))$)B &&(!&& (8a ==  $ d 3  JJ( )#%  %9Jo9JIX^N_cnNn'e'9Jo! $&3&;&;&=OE'5+<#F+4==@0778HI04 hv>N0O-JJ'89)006G!"5F '0'8K'G%;UQY $:5F!"$m !# z-9[\\FI$fcQ}M]% T/ T/ T4T4+ T9T9rcURRXUS9n0nU(aSURS5-OSn/nUHnURU5 U(dM[ [ UR 5R5SU*S- Hn [S[U 5URS9n U R U;a!URU 5 XU R 'MRU RcMaXZR n U RbU RU R:dMU RU l M M U(d[SUS US 35eU$) z# URXRS5S9R5n[TU]"U/UQ70UD6ShvN gN7f)a Return all files below the given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.walk). Args: path (`str`): Root path to list files from. Returns: `Iterator[tuple[str, list[str], list[str]]]`: An iterator of (path, list of directory names, list of file names) tuples. rLrN)rrWr;riwalk)r9r3rmrnros r:r:HfFileSystem.walksI   :0F GQQS7<6t6v666sAAA Ac >URXRS5S9R5n[TU]"U4SU0UD6$)a( Find files by glob-matching. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.glob). Args: path (`str`): Path pattern to match. Returns: `list[str]`: List of paths matching the pattern. rLrr)rrWr;riglob)r9r3rrnros r:r=HfFileSystem.globsC   :0F GQQSw|D>8>v>>r=withdirsc PUbUS:a [S5eURXS9nUR5nUR"U4SXRS.UD6n U(dU V s/sHoSS:wdM U PM n n O$UR"U40UD6n U SS:XaU /U -OU n U V s0sHoSU _M n n [U 5n U(dU $U V s0sHoX_M sn $s sn fs sn f![ a; UR"U4S U0UD6SS :XaU00n N`0n Nd![ a 0n Nsf=ff=fs sn f) aE List all files below path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.find). Args: path (`str`): Root path to list files from. maxdepth (`int`, *optional*): Maximum depth to descend into subdirectories. withdirs (`bool`, *optional*): Include directory paths in the output. Defaults to False. detail (`bool`, *optional*): If True, returns a dict mapping paths to file information. Defaults to False. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `Union[list[str], dict[str, dict[str, Any]]]`: List of paths or dict of file information. rzmaxdepth must be at least 1rT)rrrr{rrrLr)rrr;rinforFileNotFoundErrorr)r9r3rr?rrrLrnrrrr namesrs r:findHfFileSystem.finds]@  HqL:; ;))$)B &&( .--cgc\bcC"%B#Q6k)Aq#B!IId5f5 +4V+< +KykC'QT),-AV9a<C-s L056#)O6 6C .!"  99T?H??G6Q*CC$   *7sGC C&CCD# D & D D  DD DD path1path2c 4URXS9nURX#S9n[U[5(d[U[5(a [S5eURUR:H=(a UR UR :HnU(aSUSU3nUR RUR URURURSU5URSS5[URURURS9/S 9 OURUS URS9n U R5n S S S 5 SUSU3nUR RW URUR URURURURSU5URS5S 9 UR!UR#5S 9 UR!UR#5S 9 g !,(df  N=f)aB Copy a file within or between repositories. > [!WARNING] > Note: When possible, use `HfApi.upload_file()` for better performance. Args: path1 (`str`): Source path to copy from. path2 (`str`): Destination path to copy to. revision (`str`, *optional*): The git revision to copy from. rz)Copy from/to buckets is not available yetzCopy z to rrrT)src_path_in_reporM src_revision)rKrJrLrrrrbNpath_or_fileobjrMrKrrJrLrrr)rrr^rrJrKrrrLrWrrMopenread upload_filerrr;) r9rFrGrLrnresolved_path1resolved_path2 same_reporfcontents r:cp_fileHfFileSystem.cp_file.s **5*D**5*D n&D E E :J J &&QR R  $ $(@(@ @ u^E[E[_m_u_uEu  $UG4w7N II # #&..(22'00%zz*:NK#)::.BB#G')7)D)D%3%@%@%3%<%< $ 5$1H1HIQ&&(J$UG4w7N II ! ! '+88&..jj(22'00%zz*:NK#)::.B#C "  >#;#;#=> >#;#;#=>JIs <H  Hc UR"U400UESS0ED6nSU;a$USc[SUS35eUSR$SU;aUS(aUS$SU;aUS(aUS$[SUS US 35e) a+ Get the last modified time of a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.modified). Args: path (`str`): Path to the file. Returns: `datetime`: Last modified time of the file. rTrz9'modified' is not implemented for repository paths like 'r.r rz'Cannot determined 'modified' for path 'z ' (info: ))rArdate)r9r3rnrAs r:modifiedHfFileSystem.modifiedjsyyA!@F!@M4!@A D M"*),efjekkl*mnn &++ + _g= d "tM': & &%(OPTvU^_c^dde&fg gr=c &URXS9nUR5nURSURb UROS5nUR(dUSSS.n[ U[ 5(aSUS'[ U[ 5(asU(alURRURURURS 9S n0UES[URURURS 9S .EnGOw[ U[ 5(acUR#U5n UR%XS 9 UR&U V s/sHoSU:XdM U PM n n U (d [)US5 U SnGOSnUR#U5n U(d XR&;aUR%U 5 XR&;aAUR&U V s/sHoSU:XdM U PM n n U (d [)US5 U SnU(dUbU(GacU(Ga[USGcTURR+URUR,UURURS9n U (d [)US5 U Sn [ URURURSUR.S9R5n[ U [05(aXUS-U R-U R2SU R4U R6U R8U R:U R<S.nO,US-U R-SSU R>U R:S.nU(dSVs0sHoX_M nnUceU$s sn fs sn fs snf)a Get information about a file or directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.info). > [!WARNING] > Note: When possible, use `HfApi.get_paths_info()` or `HfApi.repo_info()` for better performance > (or `HfApi.get_bucket_paths_info()` or `HfApi.bucket_info()` for buckets) Args: path (`str`): Path to get info for. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to get info from. Returns: `dict[str, Any]`: Dictionary containing file information (type, size, commit info, etc.). rrNFrr)rrr{r)rJrL)oidtitlerZ)rr)rr)rrLrJrT)rMrRr6rrr) rr;rWrr3rrHrlist_repo_commitsrKrJrLr' commit_idr` created_atr^rrrrget_paths_inforMrRr(rr r r rr r)r9r3rrLrnrrrrr+rout1 paths_infor rks r:rAHfFileSystem.infos^,))$)B &&(jj t/?/?/K4++QV !!#C -)KLL%)M"-)KLLQ\"ii99!))]5L5LWdWmWm: ##1'119J9JQ\QgQg$ 'E F F,,t,K GGKG 1#}}[9O9!vY$=NA9DO%dD1q'CC,,t,K;mm#C $mm+#'==#=S#=a6dAR#=S)$51g#++##mBTB\!YY55!))!..&*33+55 6 ")$5&qM >!++!))!**!#"/"="=  )+ i22 )C).. @ ) &#,#4#4(}}$-$6$6'0'<'<$-$6$6 C!*C).. @ ! +#,#4#4'0'<'< C#.FG.Fcf9.FCG qPTTHs NN N (N -Nc URSS5(aURU5 UR"U40UD6 g![a gf=f)aq Check if a file exists. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.exists). > [!WARNING] > Note: When possible, use `HfApi.file_exists()` for better performance. Args: path (`str`): Path to check. Returns: `bool`: True if file exists, False otherwise. rFT)rWrrAOSError)r9r3rns r:existsHfFileSystem.existssL  zz)U++%%d+ IId %f %  s;> A  A cRURU5SS:H$![a gf=f)a) Check if a path is a directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isdir). Args: path (`str`): Path to check. Returns: `bool`: True if path is a directory, False otherwise. r{rFrArjr9r3s r:rHfFileSystem.isdir s1 99T?6*k9 9    &&cRURU5SS:H$![a gf=f)a  Check if a path is a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isfile). Args: path (`str`): Path to check. Returns: `bool`: True if path is a file, False otherwise. r{rFrnros r:isfileHfFileSystem.isfiles1 99T?6*f4 4  rqcURU5n[U[5(a2URSURS[ UR 53nO?[URURURURURS9nURU5(aURSSS5nU$)z Get the HTTP URL of the given path. Args: path (`str`): Path to get URL for. Returns: `str`: HTTP URL to access the file or directory on the Hub. z /buckets/z /resolve/)rJrLrz/tree/r)rrr^rr`rr3r!rKrMrJrLrreplace)r9r3rurls r:rwHfFileSystem.url.s))$/ m%C D D]]O9]-D-D,EYuUbUgUgOhNijC%%**'11&// C ::d  ++k8Q7C r=c >URS5n[UR55S1- n[U[[ 45(a[ U5S:a[T U] "X4X4S.UD6$[U5(aUnO,URU5(a[R"USS9 g[U[[45(a2[R"[RR!U5SS9 SnUc[#US5nSnUR%5n UR'XS 9n UR)XS 9S n UR+U 5 [-UR/U R155UUU SUR2R55[U[ 5(a UR6OSS 9 UR9U 5 U(aUR;5 gg!U(aUR;5 ff=f) a Copy single remote file to local. > [!WARNING] > Note: When possible, use `HfApi.hf_hub_download()` or `HfApi.download_bucket_files` for better performance. Args: rpath (`str`): Remote path to download from. lpath (`str`): Local path to download to. callback (`Callback`, *optional*): Optional callback to track download progress. Defaults to no callback. outfile (`IO`, *optional*): Optional file-like object to write to. If provided, `lpath` is ignored. rLr)callbackoutfileT)exist_okNFwbrr)rw temp_filedisplayed_filename expected_size resume_sizeheaders _tqdm_bar)rWsetkeysrrrrriget_filerrrmakedirsrDr r3dirnamerNtellrrAset_sizer"rwr;r_build_hf_headerstqdmseekclose) r9rpathlpathrzr{rnrLunhandled_kwargs close_file initial_posresolve_remote_pathrros r:rHfFileSystem.get_fileHs$::j)v{{}- <(\<$@AASIYEZ]^E^7#E_8_X^_ _ e  G ZZ   KK - ec4[ ) ) KK. > ?5$'GJlln #///I % ;FC -( HH0::<=!#(+ 335+5h +M+M(--SW  LL % z s A6GG8c[S5e)zA context within which files are committed together upon exit Requires the file class to implement `.commit()` and `.discard()` for the normal and exception cases. (Transactional commits are not supported.rr8s r: transactionHfFileSystem.transactions""LMMr=c[S5e)z@Begin write transaction for deferring files, non-context versionrrr8s r:start_transactionHfFileSystem.start_transactions""LMMr=cp[[U5URURUR 544$rh) make_instancer{rrr}r8s r: __reduce__HfFileSystem.__reduce__s9 J      $ $ &    r=c[UR5[UR5[UR5S.$)N)rrr)rrrrr8s r:r} HfFileSystem._get_instance_states4 //78\8\/]$,T-F-F$G  r=)rrrrrrrrrh)rKNN)FNN)TFN)FFNNN)NFFFN)FNr4N)7r?r@rArBrC root_markerprotocolrDboolintrj classmethodrttuple ExceptionrrrHr^rrrrrrrdictrrrrr$r%rrr:r=rDrVr r[rArkrrsrwrrpropertyrrrr}rFrrs@r:rrs|@DKH $#'!%#' <*<czD < $J < D[ <<2    TT'*T69DjT tY%% &T&44dI>sTz>t>& ## 0>0>0>* 0> * 0> 0>f]a););!%);7;);ORUYz); cDcN" #);\ ##'#KKK K * K D[ K*KZ&&&)&6:& *|+ ,&P77(5d3iQUVYQZAZ;[2\7 ??d ?S ??& $#;7;7*;7 ;7  ;7  ;7*;7 cT#tCH~-. .;7z:?S:?:?d :?X\:?xhShxh2lltlsTzl_cdgildl_ml\2$$4/@< < |NNN    r=r) metaclassc^\rSrSrSS\S\S\S-4U4SjjjrU4SjrS\S \S \ 4S jr SS jr SS \ S S4Sjjr SU4SjjrS \4SjrSrU=r$)riNfsr3rLc >URX#S9Ul[TU]"XRR 540UD6 U g![a+nSURSS5;a[US35UeeSnAff=f)NrwrrTB. Make sure the repository and revision exist before writing data.)rrrBrWrirjr;)r9rr3rLrnrros r:rjHfFileSystemFile.__init__s !#!ID  //99;FvF ! fjj,,'c\]   sA A8 &A33A8cD>[US5(dg[TU] 5$Nr)hasattrri__del__r9ros r:rHfFileSystemFile.__del__s t_-- w  r=startendr4cSSUSUS- 30URRR5EnUR5n[ SXC[ R S9n[U5 UR$)Nrangebytes=-rGETrr) rrrrwr,rHF_HUB_DOWNLOAD_TIMEOUTr+rU)r9rrrrwrs r: _fetch_rangeHfFileSystemFile._fetch_rangesk veWAcAgY/ ggll,,. hhj i>_>_ `Ayyr=c8[R"SSS9Ulg)Nzhffs-F)rr)tempfileNamedTemporaryFiler~r8s r:_initiate_upload!HfFileSystemFile._initiate_uploads!44GERr=finalc NURRS5 URR5nURR U5 U(GaURR 5 [ UR[5(adURRRURRURRURR4/S9 OURRRURRURR URR"URR$URR&URR(UR*R-S5UR*R-S5S9 [.R0"URR5 URR3URR55S9 gg)Nr)addrrrLr)bufferrrOr~writerrrr^rrrr`rr3rPrMrKrrJrLrnrWrremoverr;)r9rblocks r: _upload_chunkHfFileSystemFile._upload_chunks    " U#  NN "$,,.LMM //&&008K8KTM_M_MdMd7e6f0 (($(NN$7$7!%!3!3!@!@ ..66''--"00::!//88#';;??3C#D'+{{7K'L)  IIdnn)) * GG $ $''113 % % r=cT>URS:XaxUbUS:XaoURS:Xa_URRURSSS9nUR 5nU=R[ U5- slUsSSS5 $[TU]U5$!,(df  N=f)zRead remote file. If `length` is not provided or is -1, the entire file is downloaded and read. On POSIX systems the file is loaded in memory directly. Otherwise, the file is downloaded to a temporary file and read from there. rKNr^r)r)rlocrrNr3rOrri)r9lengthrTrros r:rOHfFileSystemFile.reads 99 &.FbLdhhRSmdii!<ffhCH$=<w|F## =US:wa[SU35eUS:wa[SU35eSU;a[SUS35eURX$S9UlURR 5SS .Ul[T U] "XRR 54X5US .UD6 SUl U [5Ul SUl [5Ulg![a/nSUR S S 5;a[US 35UeSnANSnAff=f)Nrz:HfFileSystemStreamFile only supports block_size=0 but got nonez?HfFileSystemStreamFile only supports cache_type='none' but got rz;HfFileSystemStreamFile only supports reading but got mode='r.rrrTr)rrrrr)rrrrBrWr;detailsrirjresponser _exit_stack_stream_iterator bytearray_stream_buffer) r9rr3rrLrrrnrros r:rjHfFileSystemStreamFile.__init__s1 ?YZdYefg g  ^_i^jkl l $;Z[_Z``abc c !#!ID !% 2 2 < < >M   "",,. 59]g kq 04  $;8<'k! fjj,,'c\]- sC D %DD rwhencec^US:XaUS:XagXR:XaUS:Xag[S5e)NrrzCannot seek streaming HF file)rr)r9rrs r:rHfFileSystemStreamFile.seeks0 !8!  ((?v{ 899r=rcURcUR5 SnURb URcgURURU5nU=R[ U5- slU$![ aD URbURR5 U(aeUR5 SnOf=fM)zRead the remote file. If the file is already open, we reuse the connection. Otherwise, open a new connection and read from it. If reading the stream fails, we retry with a new connection. FTr=)r_open_connectionr_read_from_streamrrrr)r9r retried_oncers r:rOHfFileSystemStreamFile.reads ==  ! ! #  $==(D,A,A,I,,T-B-BFKCH$  $==,MM'')%%'#  $sA9;A99A CCiteratorr4cUS:XagUS:aT[UR5nURR5 UHnURU5 M [ U5$U[ UR5::a)[ URSU5nURSU2 U$[UR5nURR5 UHdnU[ U5- nU[ U5:aURU5 M3URUSU5 URRXFS5 O [ U5$)zRead up to `length` bytes from stream buffer and stream. If length < 0, read until EOF. If EOF is reached before length, fewer bytes may be returned. rr=N)rrrrrr)r9rrbufchunkresultneeds r:r(HfFileSystemStreamFile._read_from_stream:s# Q; A:D//0C    % % '! 5!":  S,,- -4..w78F##GVG,M++, !!#ECH$Dc%j  5! 5$<(##**5<8Szr=cLURRUR5$rhrr8s r:rwHfFileSystemStreamFile.url\rr=cx>[US5(dgURR5 [TU]5$r)rrrrirrs r:rHfFileSystemStreamFile.__del___s2t_--   w  r=c[URURURURUR R 44$rh)reopenrr3r blocksizecacherr8s r:r!HfFileSystemStreamFile.__reduce__fs0DIIt~~tzzWWWr=c @URR5 SUlUR5nURR R 5nURS:aSURS3US'URR[SUU[RS95Ul [UR5 URR#5Ulg![a,nURR S:Xa SUl SnAgeSnAff=f) z%Open a connection to the remote file.NrrrRangerri)rrrrwrrrrr enter_contextr-rrrr+r status_code iter_bytes)r9rwrrs r:r'HfFileSystemStreamFile._open_connectionis !!# $hhj'',,002 88ar=r:r*s . ('''' JJ&#C0vvv\\' 66 6 &)A& &0 0%=0 0223 c32l2jY 6,,Y x H&v{{77H&VR;V[[==R;j]C]C]##**)d*:*x*R|R3RcRsRPSR~r=