Zj dSSKrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J r SSK J r J r Jr SSKrSSKJr \"5(aSSKrSSKJr SS KJr "S S \5r\R0"5R2r\ "\5R8S rS \S3R=5rS4S\ \ S-\RB"SS944Sjjr""SS5r#S\ \RH-S\ S\ 4Sjr%S\ S\#S\ S\ S\&\'\ \(44 Sjr)S\ S\&\ 4S jr*S\ S!\ S\ S\ 4S"jr+S!\ S\ S\&\'\ \(44S#jr,S$\ S%\-4S&jr.S$\ S\#S'\ S%\'\ \ \&44S(jr/S\ S\#S\ S\&\'\ \(4S%\ 4 S)jr0S\ S\#S\&\'\ \(44S*jr1S\ S\#S\ S\ S\&\'\ \(44 S+jr2S5S,\ S-\ S-S.\S-S/\ S-S%\ 4 S0jjr3S1\ S%\(4S2jr4S3r5g)6N)Callable)date)Path) AnnotatedAnycast)is_libcst_available) CSTVisitor)matchersc\rSrSrSrSrS\RSS4SjrS\R4Sjr S\R4S jr S r g) ClassFinder$z3 A visitor to find all classes in a python module. c./Ul/UlSUlgNF)classespublic_classes is_in_class)selfs t/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/cli/add_new_model_like.py__init__ClassFinder.__init__)s!#DL(*D $D nodereturnNcpURRURR5 SUlg)zwRecord class names. We assume classes always only appear at top-level (i.e. no class definition in function or similar)TN)rappendnamevaluerrrs rvisit_ClassDefClassFinder.visit_ClassDef.s$ LL    0#D rcSUlgr)rr s rleave_ClassDefClassFinder.leave_ClassDef3s $D rc[R"[R"[R"[R"5S9/S9/S9nUR (d[R "X5(a[[RURS5n[[RURSR5RnUS:Xas[[RUR5RnUVs/sH1n[[RUR5RPM3 snUlggggs snf)z:Record all public classes inside the `__all__` assignment.)target)targets)bodyr__all__N)mSimpleStatementLineAssign AssignTargetNamermatchesrcstr)r(r'rTupleelements SimpleStringr)rr!simple_top_level_assign_structurestmtassigned_variabler3elements rvisit_SimpleStatementLine%ClassFinder.visit_SimpleStatementLine6s010E0Ehhaffh(G'HIJ1 -## $(Z(ZCJJ ! 5$(4<<?3I3I$J$P$P!$ 1#CIItzz:CCHfn*ofn[b40@0@'--+P+V+Vfn*oD'2)[# +ps8E)rrr) __name__ __module__ __qualname____firstlineno____doc__rr1ClassDefr!r$r,r9__static_attributes__rrrr$sG  %  $s|| $ $  %s|| % p#2I2I prrz # coding=utf-8 # Copyright aN the HuggingFace Team. All rights reserved. # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. repo_pathzFWhen not using an editable install, the path to the Transformers repo.)helpc`[5unnnn[Ub [U5O[UUUUS9 g)z; Add a new model to the library, based on an existing one. NrDold_model_infosnew_lowercase_namenew_model_paper_namefilenames_to_add)get_user_input_add_new_model_like_internalr REPO_PATHrGs radd_new_model_likerOZs?  !%.%:$y/ '-1) rc&\rSrSrSrS\4SjrSrg) ModelInfosuzA Retrieve the basic information about an existing model classes. lowercase_namectSSKJn SSKJn SSKJn SSKJn SSKJ n SSK J n UR5RSS 5RS S 5UlURU;aURRS S 5 URU;a[US 35eX RUlUR RS S 5UlURU;a>SUlX`RUlUR&S:XaSO UR&UlOSuUlUlUR)URS5UlUR)URS5UlUR)URS5UlUR)URS5Ulg)Nr CONFIG_MAPPING_NAMES)FEATURE_EXTRACTOR_MAPPING_NAMES)IMAGE_PROCESSOR_MAPPING_NAMES)PROCESSOR_MAPPING_NAMES)TOKENIZER_MAPPING_NAMES)VIDEO_PROCESSOR_MAPPING_NAMES _-z is not a valid model nameConfigPreTrainedTokenizerFast)NN)models.auto.configuration_autorV#models.auto.feature_extraction_autorW!models.auto.image_processing_autorXmodels.auto.processing_autorYmodels.auto.tokenization_autorZ!models.auto.video_processing_autor[lowerreplacerS ValueError config_classcamelcase_nametokenizer_classfast_tokenizer_classgetimage_processor_classesvideo_processor_classfeature_extractor_classprocessor_class)rrSrVrWrXrYrZr[s rrModelInfos.__init__zsIYUIKU-224<r?strrrArBrrrQrQusVsVrrQ file_name new_content add_afterc[USSS9nUR5nSSS5 WRUS5upVXR-U-U-n[USSS9nURU5 SSS5 g!,(df  NR=f!,(df  g=f)a? A utility to add some content inside a given file. Args: file_name (`str` or `os.PathLike`): The name of the file in which we want to insert some content. new_content (`str`): The content to add. add_after (`str`): The new content is added just after the first instance matching it. rutf-8encodingNw)openreadsplitwrite)rvrwrxf old_contentbeforeafters radd_content_to_filers~ iw /1ffh  0 %%i3MF${2U:K iw /1   0 / 0 / 0 /sA)A:) A7: BrHrIrJrKc SRSURSS5RS555nURnURnUSSVV s/sHupURUS5U 4PM nnn /n S=pUH_upS U ;aS n MS U ;aS n M[ R "S U 5(aU S upX=(d U 4U S 'MMU RX45 Ma [US- S- S- S- S- SUSUS3SS9 US- S- S- S- S- R5nU (aq[ R"SUS3U[ R5nU(a@USn[US- S- S- S- S- URXb5RXu5S-SS9 U (a[ R "SU[ R5nURS5n[ R"SUS3U[ R5nU(a@USn[US- S- S- S- S- URXb5RXu5S-SS9 U HupU (dMURSS 5nUS- S- S- S- U- R5n [ R"S!US"3U [ R5nUH;n[US- S- S- S- U- URXb5RXu5US9 M= M gs sn nf)#a Add a model to all the relevant mappings in the auto module. Args: old_model_infos (`ModelInfos`): The structure containing the class information of the old model. new_lowercase_name (`str`): The new lowercase model name. new_model_paper_name (`str`): The fully cased name (as in the official paper name) of the new model. filenames_to_add (`list[tuple[str, bool]]`): A list of tuples of all potential filenames to add for a new model, along a boolean flag describing if we should add this file or not. For example, [(`modeling_xxx.px`, True), (`configuration_xxx.py`, True), (`tokenization_xxx.py`, False),...] r`c3@# UHoR5v M g7fNtitle.0xs r -add_model_to_auto_mappings..`0_1WWYY0_r^r]r~NautoFimage_processingTvideo_processingz2(?:tokenization)|(?:image_processing)_auto_fast.pysrc transformersmodelszauto_mappings.pyz("z", "zConfig"), z2CONFIG_MAPPING_NAMES = OrderedDict( [ rwrxz^\s+\("z",\s+{[^}]+}\),?$r z3IMAGE_PROCESSOR_MAPPING_NAMES = OrderedDict( [ zBVIDEO_PROCESSOR_MAPPING_NAMES\s*=\s*OrderedDict\(\s*\[(.*?)\]\s*\)z",\s+"[^"]+"\),?$z3VIDEO_PROCESSOR_MAPPING_NAMES = OrderedDict( [ _fast.py.pyz( {8,12}\(\s*"z",.*?\),\n)(?: {4,12}\(|\]))joinrirrSrlresearchrr read_textfindall MULTILINEDOTALLgroup)rDrHrIrJrKnew_cased_nameold_lowercase_nameold_cased_namefilenameto_addcorrected_filenames_to_addhas_image_processorhas_video_processorfile previous_fileprevious_to_addautofilematching_linesmatch block_matchblocks radd_model_to_auto_mappingsrsu*WW`0B0J0J3PS0T0Z0Z[^0_``N(77$33NWghihjWkWkCS8  ,f 5v>Wk"$055(   %"&  4 '"&  YYLd S S-G-K *M.;=VPV-W &r * & - -tn =)EN*X5>ASS+,D0@@STH E!N2X=FI[[ffhHw/A.BBV$WYacecocop "1%E E!N2X=FI[[!MM*<QYY"R  ii QS[]_]f]f !!!$w/A.BBS$TV[]_]i]ij "1%E E!N2X=FI[[!MM*<QYY"R  7 6'' E:H%6AFJXU``bDZZ#$6#77TUW[]_]f]fN(#%6AFJXU % .@ U ] ]&!$ (7ms K=new_paper_namerc,Sn[R"SS[5RSS5U-n[R "SUSUS35n/nUH'nS US U3nS U;aUS - nUR U5 M) S RU5nX4-U-$)a Create a new doc file to fill for the new model. Args: new_paper_name (`str`): The fully cased name (as in the official paper name) of the new model. public_classes (`list[str]`): A list of all the public classes that the model will have in the library. u ⚠️ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be rendered properly in your Markdown viewer. --> z# ?r`z coding=utf-8 z