Yj6'n SrSSKJr SSKrSSKJr SSKJr SSKJ r J r J r SSK J r \ "S S 9r\ "S S 9r\\\R""S S 94r\\S-\R&"S S 94r\\S-\R&"S S 94r\R-SSS/S9SUS\S\ SS4Sjj5r\R-SS/S9SSSSSSSSS.S\S\\\R&"SS 94S\\\R&"SS 94S\\\R&"S S 94S!\\\R&"S"S 94S#\\\R&"S$S 94S%\\\R&"S&S 94S'\\\R&"S(S 94S\S)\\S-\R&"S*S 94S\ S+\\\R&"S,S 94S-\\\R&"S.S 94S/\\S-\R&"S0S 94S1\\S-\R&"S2S 94S3\\S-\R&"S4S 94SS4"S5jj5r\R-SS6/S9SVS\\\R&"SS 94S\S\\S-\R&"S7S 94S\S\ SS4 S8jj5rSWS\ SS4S9jjr\R-SS:/S9"\5 \R-S;SS?9 \R-S@/S9SUS\S\S\ SS4SAjj5r\R-SB/S9SXS\S\S\\S-\R&"SS 94S\\S-\R&"S S 94S!\\S-\R&"S"S 94S#\\S-\R&"S$S 94S\\S-\R&"SCS 94SD\\S-\R&"SES 94S)\\S-\R&"S*S 94S+\\S-\R&"S,S 94S-\\S-\R&"S.S 94S/\\S-\R&"S0S 94S1\\S-\R&"S2S 94S3\\S-\R&"S4S 94S\ SS4 SFjj5r\R-SG/S9SYS\S\SH\\ \R&"SISJS 94S\ SS4 SKjj5r!\R-SL/S9SUS\S\S\ SS4SMjj5r"\R-SN/S9SYS\S\SO\\ \R&"SPSQS 94S\ SS4 SRjj5r#\R-SS/S9SUS\S\S\ SS4STjj5r$g)Zz2CLI commands for Hugging Face Inference Endpoints.) AnnotatedN)InferenceEndpointScalingMetric)HfHubHTTPError)TokenOpt get_hf_api typer_factory)outz(Manage Hugging Face Inference Endpoints.)helpz.Interact with the Inference Endpoints catalog.zEndpoint name.z_The namespace associated with the Inference Endpoint. Defaults to the current user's namespace.z list | lszhf endpoints lsz"hf endpoints ls --namespace my-org)examples namespacetokenreturnc@[US9nURXS9n/nUGHnURnURS05nURS05n URS05n URS 05n URURS S 5[U [5(aU RS S 5OS [U[5(aURS S 5OS [U [5(aU RSS 5OS [U [5(aU RSS 5OS [U [5(aU RSS 5OS [U [5(aU RSS 5OS [U [5(aU RSS 5OS S.5 GM [R"US S9 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)z6Lists all Inference Endpoints for the given namespace.r)r rzListing failed: codeNstatusmodelcomputeprovidername repositorystatetask framework instanceTypevendorregion)rrrrrinstancerr )id_key)rlist_inference_endpointsrr errortyperExitresponse status_coderawgetappend isinstancedicttable) r rapi endpointsr$resultsendpointr)rrrrs x/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/huggingface_hub/cli/inference_endpoints.pylsr4$s 5 !CE0090R Gll2&$'')R(77:r*+8B5$8O8O<4UW5?5M5M&**Wb1SU1;E41H1H &"-b;EeT;R;RUYY{B7XZ?I'SW?X?XGKK;^`8B8T8R8R(,,x4XZ8B8T8R8R(,,x4XZ  $IIgf%/ E $UG,-jjenn889uDEsG HAHHdeployzChf endpoints deploy my-endpoint --repo gpt2 --framework pytorch ...)rr )r rr min_replica max_replicascale_to_zero_timeoutscaling_metricscaling_thresholdrrepozeThe name of the model repository associated with the Inference Endpoint (e.g. 'openai/gpt-oss-120b').rz@The machine learning framework used for the model (e.g. 'vllm'). acceleratorz?The hardware accelerator to be used for inference (e.g. 'cpu'). instance_sizezNThe size or type of the instance to be used for hosting the model (e.g. 'x4'). instance_typezYThe cloud instance type where the Inference Endpoint will be deployed (e.g. 'intel-icl').r zTThe cloud region in which the Inference Endpoint will be created (e.g. 'us-east-1').rzVThe cloud provider or vendor where the Inference Endpoint will be hosted (e.g. 'aws').rzCThe task on which to deploy the model (e.g. 'text-classification').r6zVThe minimum number of replicas (instances) to keep running for the Inference Endpoint.r7zRThe maximum number of replicas (instances) to scale to for the Inference Endpoint.r8zFThe duration in minutes before an inactive endpoint is scaled to zero.r9z!The metric reference for scaling.r:zeThe scaling metric threshold used to trigger a scale up. Ignored when scaling metric is not provided.c[U S9nURUUUUUUUUUU U U U UUU S9n[R"UR5 g)z3Deploy an Inference Endpoint from a Hub repository.r)rrrr<r=r>r rr rrr6r7r9r:r8N)rcreate_inference_endpointr r-r))rr;rr<r=r>r rr rrr6r7r8r9r:r/r2s r3r5r5Gsfl 5 !C,, ## %+3!-H$HHX\\zChf endpoints catalog deploy --repo meta-llama/Llama-3.2-1B-InstructzPThe hardware accelerator to be used for inference (e.g. 'cpu', 'gpu', 'neuron').c&[US9nURUUUUUS9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)z4Deploy an Inference Endpoint from the Model Catalog.r)repo_idrr<r rzDeployment failed: rN) r&create_inference_endpoint_from_catalogrr r$r%r&r'r(r-r))r;rr<r rr/r2r$s r3deploy_from_catalogrEs& 5 !C E==# > HHX\\ E 'w/0jjenn889uDEs? B AB  Bc[US9nURUS9n[R"SU05 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)zList available Catalog models.rzCatalog fetch failed: rNmodels) rlist_inference_catalogrr r$r%r&r'r(r-)rr/rGr$s r3 list_catalogrIs} 5 !CE++%+8 HHh  E *5'23jjenn889uDEs3 BAA??Bzhf endpoints catalog lsz list-catalogT)rhiddencatalogrz!hf endpoints describe my-endpointc [US9nURXUS9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)z+Get information about an existing endpoint.rrr rzFetch failed: rN) rget_inference_endpointrr r$r%r&r'r(r-r)rr rr/r2r$s r3describerQs~ 5 !CE--4TY-Z HHX\\ E N5'*+jjenn889uDE< B ABB z/hf endpoints update my-endpoint --min-replica 2zBThe machine learning framework used for the model (e.g. 'custom').revisionzrThe specific model revision to deploy on the Inference Endpoint (e.g. '6c0e6080953db56375760c0471a8c5f2929baf11').c:[US9nURUUUUUUUUUU U U U U US9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)zUpdate an existing endpoint.r)rr rrrSrr<r=r>r6r7r8r9r:rzUpdate failed: rN) rupdate_inference_endpointrr r$r%r&r'r(r-r))rr r;r<r=r>rrSrr6r7r8r9r:rr/r2r$s r3updaterVs^ 5 !CE00#''##"7)/1 (HHX\\ E OE7+,jjenn889uDEsA BABBzhf endpoints delete my-endpointyesz--yeszSkip confirmation prompts.cD[R"SUS3US9 [US9nURXUS9 [R"S US 3US 9 g![aGn[R "SU35 [ R"URRS9UeSnAff=f) z)Delete an Inference Endpoint permanently.zDelete endpoint 'z'?)rWrrNzDelete failed: rNz Deleted 'z'.rL) r confirmrdelete_inference_endpointrr$r%r&r'r(result)rr rWrr/r$s r3deleter\dsKK#D6,#6 5 !CE %%4E%R JJ4&#$/ E OE7+,jjenn889uDEsA BABBzhf endpoints pause my-endpointc [US9nURXUS9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)zPause an Inference Endpoint.rrNzPause failed: rN) rpause_inference_endpointrr r$r%r&r'r(r-r)rPs r3pauser_{s~ 5 !CE//TV[/\ HHX\\ E N5'*+jjenn889uDErRzhf endpoints resume my-endpointfail_if_already_runningz--fail-if-already-runningzWIf `True`, the method will raise an error if the Inference Endpoint is already running.c.[US9nURUUUU(+S9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)zResume an Inference Endpoint.r)rr r running_okzResume failed: rN) rresume_inference_endpointrr r$r%r&r'r(r-r))rr r`rr/r2r$s r3resumerds 5 !C E0022 1 HHX\\ E OE7+,jjenn889uDEsA B ABBz&hf endpoints scale-to-zero my-endpointc [US9nURXUS9n[R"UR5 g![aGn[R"SU35 [ R "URRS9UeSnAff=f)z$Scale an Inference Endpoint to zero.rrNzScale To Zero failed: rN) r scale_to_zero_inference_endpointrr r$r%r&r'r(r-r)rPs r3 scale_to_zerorgs 5 !CE77T^c7d HHX\\ E *5'23jjenn889uDErR)NN)NNNN)N)NNNNNNNNNNNNNN)NFN)%__doc__typingrr%$huggingface_hub._inference_endpointsrhuggingface_hub.errorsr _cli_utilsrrr _outputr ie_cli catalog_appstrArgumentNameArgOptionNameOpt NamespaceOptcommandr4intfloatr5rErI add_typerrQrVboolr\r_rdrgrAr3r|s. 8 O1;; F G!QR   NN()+  $J LL&')  $J LL n  '8:^&_`"&& & &a&DX)n(op\#  eh h   x   h  S  h  R  h(  a  )h4  l  5h@   g   AhL   i   MhZ[h\  d  V   ]hh ihj  i  khv  e  whB% d  Y  ChN&- 4  OhZ!   x  [hf ghqhV (.s-tu "   x     d  c     !vF !  !  ! 0I/JKLYN40>9-=>?#       @  KLM# Wd dd  d  x   d d  R  d d  a  d* d  l  +d6 d  U  7dB d  F  CdN  d  V   OdZ d  i  [df d  e  gdr% d  Y  sd~&- 4  dJ!   x  KdV WdX YdNdN;<=# 0 00   W#?@ B 0 0 0>0,:;<#       =  ;<=#  '  'j    >6BCD#       E rA