Yj5L%SSKJr SSKJrJr SSKJr SSKJr SSK J r J r SSK J r SSKJrJrJr \R$"\5r0S0_S 0_S 0_S 0_S 0_S 0_S0_S0_S0_S0_S0_S0_S0_S0_S0_S0_S0_00S.Er\\\\\44\S'\S\\\4S\\\44Sj5r\S\\S\\4Sj5rS\\\4\\-S\\\4\\-4Sjr"S S!5r"S"S#\5r"S$S%\5r"S&S'\5r\"S(S)9S*\S\S+4S,j5rS-\S.\S\4S/jr g()0) lru_cache)Anyoverload) constants)InferenceProviderMapping) MimeBytesRequestParameters)ChatCompletionInputMessage)build_hf_headers get_tokenloggingcerebrascohereclarifai deepinfrazfal-aiz fireworks-aigroqz hf-inference hyperbolicnebiusnscalenvidiaovhcloud replicate sambanovascalewaytogether) wavespeedzzai-org!HARDCODED_MODEL_INFERENCE_MAPPINGobjreturncgNrs }/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/huggingface_hub/inference/_providers/_common.py filter_noner%/s8;cgr!r"r#s r$r%r%1s.1r&c[U[5(aL0nUR5H4up#UcM [U[[45(a [ U5nX1U'M6 U$[U[5(a9UVs/sH+n[U[[45(a [ U5OUPM- sn$[ S[ U535es snf)NzExpected dict or list, got ) isinstancedictitemslistr% ValueErrortype)rcleanedkvs r$r%r%5s#t"$IIKDAy!dD\**NAJ  #tNQRc*Qt "="= A1DcRR 249+> ??Ss;2Cc\rSrSrSrS\S\S\SS4SjrSS .S \S \\\4S \S \S-S\S-S\\\4S-S\ 4Sjjr S"S\ \-S\ S-S\4Sjjr S\S-S\4Sjr S \S-S\4SjrS \\\4S\\\4S-S\S-S\\\44SjrS \S\S\\\44SjrS\S\S\4SjrS\S\4SjrS\S\S\4SjrS \S \S\S\S-4SjrS \S \S\S\S-S\S-4 S jrS!rg)#TaskProviderHelperFz.Base class for task-specific provider helpers.providerbase_urltaskrNc(XlX0lX lgr!)r5r7r6)selfr5r6r7s r$__init__TaskProviderHelper.__init__Is   r&) extra_payloadinputs parametersheadersmodelapi_keyr<c URU5nURU5nURX55nURXWR5nUR XUS9n U b[ U [U=(d 055n URXXv5n U bU b [S5eU cU c [S5eURX9U 5n [UURURU U U S9$)z Prepare the request to be sent to the provider. Each step (api_key, model, headers, url, payload) can be customized in subclasses. )provider_mapping_infoz8Both payload and data cannot be set in the same request.z2Either payload or data must be set in the request.)urlr7r@jsondatar?) _prepare_api_key_prepare_mapping_info_prepare_headers _prepare_url provider_id_prepare_payload_as_dictrecursive_merger%_prepare_payload_as_bytesr-_normalize_headersr r7) r9r=r>r?r@rAr<rCrDpayloadrFnormalized_headerss r$prepare_request"TaskProviderHelper.prepare_requestNs ''0!% : :5 A''9)J)JK//Zo/p  %g{=;NB/OPG--fBWg  4#3WX X ?t|QR R"44WtL '33&   r&responserequest_paramscU$)zr Return the response in the expected format. Override this method in subclasses for customized response handling.r")r9rTrUs r$ get_responseTaskProviderHelper.get_responses r&cXUc [5nUc[SURS35eU$)zRReturn the API key to use for the request. Usually not overwritten in subclasses.z)You must provide an api_key to work with z$ API or log in with `hf auth login`.)r r-r5r9rAs r$rG#TaskProviderHelper._prepare_api_keys: ?kG ?;DMM?Jno r&c Uc[SURS35e[RUR05RU5(a[URU$Sn[ U5H!nURUR:XdMUn O Uc[SUSURS35eUR UR :wa6[SUSUR SURSUR S3 5eUR S :Xa&[RSUS URS 35 UR S :Xa&[RS USURS35 U$)zZReturn the mapped model ID to use for the request. Usually not overwritten in subclasses.Nz+Please provide an HF model ID supported by .zModel z is not supported by provider z is not supported for task z and provider z. Supported task: stagingz! is in staging mode for provider z. Meant for test purposes only.errorz,Our latest automated health check on model 'z' for provider 'z<' did not complete successfully. Inference call might fail.) r-r5rget!_fetch_inference_provider_mappingr7statusloggerwarning)r9r@provider_mappingmappings r$rH(TaskProviderHelper._prepare_mapping_infos =J4==/YZ[\ \ - 0 0 C G G N N4T]]CEJ J8?G4==0#* @  #veW,J4==/YZ[\ \  DII -:499+^TXTaTaSbc##3#8#8"9<   " "i / NN@Ono   " "g - NN>ugEUVZVcVcUde--  r&rPrFcUR5VVs0sHupEUcM UR5U_M nnnURS5c)UbURbURUS'U$UbSUS'U$s snnf)zjNormalize the headers to use for the request. Override this method in subclasses for customized headers. z content-typezapplication/json)r+lowerr` mime_type)r9r?rPrFkeyvaluerQs r$rO%TaskProviderHelper._normalize_headerssDK==?h?ZSV[0ciik50?h  ! !. 1 9DNN$>59^^">2"!$5G">2!! is A6A6c0[US9EUE$)zgReturn the headers to use for the request. Override this method in subclasses for customized headers. )token)r )r9r?rAs r$rI#TaskProviderHelper._prepare_headerss >"1=W==r& mapped_modelcURU5nURX!5nURS5SURS53$)zNReturn the URL to use for the request. Usually not overwritten in subclasses./)_prepare_base_url_prepare_routerstriplstrip)r9rArqr6routes r$rJTaskProviderHelper._prepare_urlsI))'2##L://#&'qc):(;<rCs r$rL+TaskProviderHelper._prepare_payload_as_dictsr&cg)zReturn the body to use for the request, as bytes. Override this method in subclasses for customized body data. Only one of `_prepare_payload_as_dict` and `_prepare_payload_as_bytes` should return a value. Nr")r9r=r>rCr<s r$rN,TaskProviderHelper._prepare_payload_as_bytessr&)r6r5r7r!)__name__ __module__ __qualname____firstlineno____doc__strr:rr*r rRbytesrWrGrrHrrOrIrJrtrurLrN__static_attributes__r"r&r$r3r3Fs 8!!!3!4!043 3 cN 3  3 Tz 3 t3 CH~,3  3 p48 $, *D0   d s # 3:# :R# J "CH~ "04S#X0E "MVY]M] " c3h ">>s>tCH~>=C=s=s= ! ! !3'+D\     8  d{  T  r&r3c z^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \\ \ -S \ S \ S\ S -4Sjr Sr U=r$)BaseConversationalTaski z Base class for conversational (chat completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/chat r5r6c">[TU]XSS9 g)Nconversationalr5r6r7superr:r9r5r6 __class__s r$r:BaseConversationalTask.__init__s (DTUr&rqrArcg)Nz/v1/chat/completionsr"rs r$ru%BaseConversationalTask._prepare_routes%r&r=r>rCNc<[SU0UESUR0E5$)Nmessagesr@r%rKrs r$rL/BaseConversationalTask._prepare_payload_as_dicts' Ji*igG\GhGhijjr&r")rrrrrrr:rur,r*r rrLr __classcell__rs@r$rr s} VVV&3&&&kT667kk 8 k  kkr&rcV^\rSrSrSrU4SjrS\S\4SjrS\S-S\4S jr S r U=r $) AutoRouterConversationalTaskia Auto-router for conversational tasks. We let the Hugging Face router select the best provider for the model, based on availability and user preferences. This is a special case since the selection is done server-side (avoid 1 API call to fetch provider mapping). c">[TU]SSS9 g)Nautozhttps://router.huggingface.co)r5r6r)r9rs r$r:%AutoRouterConversationalTask.__init__&s &3RSr&rArc\URS5(d [S5eUR$)r{r|z>Cannot select auto-router when using non-Hugging Face API key.)r}r-r6rZs r$rt.AutoRouterConversationalTask._prepare_base_url)s+ !!%((]^ ^== r&r@Nc8Uc [S5e[SUUSSS9$)z In auto-router, we don't need to fetch provider mapping info. We just return a dummy mapping info with provider_id set to the HF model ID. zPlease provide an HF model ID.rliver)r5 hf_model_id providerIdrbr7)r-r)r9r@s r$rH2AutoRouterConversationalTask._prepare_mapping_info3s1 ==> >'!   r&r") rrrrrr:rrtrrHrrrs@r$rrs>T!!! 3: :R  r&rc n^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \S \ S \ S\ S -4Sjr Sr U=r $)BaseTextGenerationTaskiDz Base class for text-generation (completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/completions r5r6c">[TU]XSS9 g)Nztext-generationrrrs r$r:BaseTextGenerationTask.__init__Js (DUVr&rqrArcg)Nz/v1/completionsr"rs r$ru%BaseTextGenerationTask._prepare_routeMs r&r=r>rCNc<[SU0UESUR0E5$)Npromptr@rrs r$rL/BaseTextGenerationTask._prepare_payload_as_dictPs'Hfg gGEZEfEfghhr&r")rrrrrrr:rurr*rrLrrrs@r$rrDsl WWW!3!!!ii'+iD\i iir&rN)maxsizer@rcxSSKJn U"5RUS/S9nURnUc[ SU35eU$)z3 Fetch provider mappings for a model from the Hub. r)HfApiinferenceProviderMapping)expandz$No provider mapping found for model )huggingface_hub.hf_apir model_infoinference_provider_mappingr-)r@rr~res r$raraVsM - 7  e-G,H  ID66?wGHH r&dict1dict2c 0UEUR5VVs0sHGup#UX ;a:[X[5(a#[U[5(a[XU5OU_MI snnE$s snnfr!)r+r)r*rM)rrrkrls r$rMrMds}    $kkm  ,   EJ!=!=*UTXBYBY!U3 ,    sAA*)! functoolsrtypingrrhuggingface_hubrrr!huggingface_hub.inference._commonrr :huggingface_hub.inference._generated.types.chat_completionr huggingface_hub.utilsr r r get_loggerrrcrr*r__annotations__r%r,r3rrrrarMr"r&r$rsA %;JaFF   H % UU bUUU bUBU BUBU "!U" b#U$ b%U& b'U()U*+U,-U./U01U25U!4T#7O2O-P(P#Q< ;T#s(^;S#X; ; 1T#Y1491 1@T#s(^d3i/@DcNT#Y4N@"@@Fk/k*# #9# Li/i$ 4 S T:T5U   4   r&