Zjk'SrSSKJr SSKJr SSKJr SSKJrJ r SSK J r J r \ R"\5r\"SS \55r\"S S \55r\"S S \55r\"SS9\"SS\555rSrS/rg)zESM model configuration)Union)strict)PreTrainedConfig)auto_docstringlogging)intervalis_divisible_bycF\rSrSr%SrSr\S-\S'Sr\S-\S'Sr \S-\S 'Sr \S-\S 'S r \S-\S 'S r \S-\S'Sr \S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'Sr\S-\S'S rg)!StructureModuleConfiga$ Args: sequence_dim: Single representation channel dimension pairwise_dim: Pair representation channel dimension ipa_dim: IPA hidden channel dimension resnet_dim: Angle resnet (Alg. 23 lines 11-14) hidden channel dimension num_heads_ipa: Number of IPA heads num_qk_points: Number of query/key points to generate during IPA num_v_points: Number of value points to generate during IPA dropout_rate: Dropout rate used throughout the layer num_blocks: Number of structure module blocks num_transition_layers: Number of layers in the single representation transition (Alg. 23 lines 8-9) num_resnet_blocks: Number of blocks in the angle resnet num_angles: Number of angles to generate in the angle resnet trans_scale_factor: Scale of single representation transition hidden dimension epsilon: Small number used in angle resnet normalization inf: Large number used for attention masking iN sequence_dim pairwise_dimipa_dim resnet_dim num_heads_ipa num_qk_points num_v_points皙? dropout_rate num_blocksnum_transition_layersnum_resnet_blocks num_angles trans_scale_factorg:0yE>epsilongj@inf)__name__ __module__ __qualname____firstlineno____doc__rint__annotations__rrrrrrrfloatrrr r"r$r%r&__static_attributes__r'z/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/models/esm/configuration_esm.pyr r s D #L#*""L#*"GS4Z Jd  "M3:" !M3:! L#* !$L%$,$Jd ()3:)$%sTz%Jd %'d ' GUT\ Cr1r cn^\rSrSr%S\0rSr\S-\S'Sr \S-\S'\ "SS 9"S S 9r \S-\S 'S r \S-\S'S r \S-\S'S r\S-\S'\"SS9"SS 9r\\-S-\S'Sr\\-S-\S'Sr\S-\S'\"SS9"SS 9r\S-\S'S r\S-\S'Sr\\S4S-\S'U4SjrSrS rU=r$)! TrunkConfigQstructure_module0Nrisequence_state_dimr)divisorr)defaultpairwise_state_dim sequence_head_widthpairwise_head_width position_binsg?)maxdropout layer_dropFcpu_grad_checkpointr)minr max_recycles chunk_sizer c >URc[5UlO9[UR[5(a[S0URD6Ul[TU]"S0UD6 gNr')r6r isinstancedictsuper __post_init__selfkwargs __class__s r2rMTrunkConfig.__post_init__bsS  ($9$;D ! --t 4 4$9$RD)rOsequence_num_headspairwise_num_headss r2validate_architecture!TrunkConfig.validate_architectureis|  " "T%<%< < A++,E$2I2I1J!M   " "T%<%< < A++,E$2I2I1J!M  "448P8PP!448P8PP  " "&8;S;S&S S++,D1C0DCH`H`Gaabd   " "&8;S;S&S S++,D1C0DCH`H`Gaabd  Tr1)r6)r(r)r*r+r sub_configsrr-r.r8r r;r=r>r?r rBr/rCrDboolrFrGr6rrKrMrXr0 __classcell__rQs@r2r4r4Qs%'<=KJd %)d )%4Q%?%Ld L&(t(&(t( "M3:""*s"3C"@GUS[4 @%(J d"(',,'Aq9L#*9 Jd  DHeD"99:TAH(r1r4c ^\rSrSr%S\0rSr\S-\S'Sr \ S-\S'Sr \ S-\S'Sr \ S-\S 'Sr \ S-\S 'S r\\-S-\S 'Sr\ S-\S 'Sr\ S-\S'Sr\S-\S'Sr\\S4S-\S'U4SjrSrU=r$) EsmFoldConfigtrunkNesm_typeTfp16_esmFuse_esm_attn_mapesm_ablate_pairwiseesm_ablate_sequencerAesm_input_dropoutembed_aa bypass_lmrlddt_head_hid_dimr4c >URc[5UlO9[UR[5(a[S0URD6Ul[TU]"S0UD6 grI)rar4rJrKrLrMrNs r2rMEsmFoldConfig.__post_init__sJ :: $DJ  D ) )$2tzz2DJ ''r1)ra)r(r)r*r+r4rZrbstrr.rcr[rdrerfrgr/r-rhrirjrarrKrMr0r\r]s@r2r_r_sK(KHcDj HdTk $)dTk)',,',,,/us{T)/ HdTk "Itd{"$'sTz'/3E5}$ % ,3((r1r_zfacebook/esm-1b) checkpointc ^\rSrSr%SrSrS\0rSr\ S-\ S'Sr \ S-\ S'Sr \ S-\ S'S r \ \ S 'S r\ \ S 'S r\ \ S 'Sr\ \ S'Sr\S-\ S'Sr\S-\ S'Sr\ \ S'Sr\\ S'Sr\\ S'Sr\S-\ S'Sr\S-\ S'Sr\\ S'Sr\S-\ S'S r\S-\ S!'S r\S-\ S"'Sr\ \-S-\ S'Sr!\"\\#\S#4-S-\ S$'S r$\S-\ S%'S r%\S-\ S&'Sr&\\ S''Sr'\ S-\ S('S)r(\ \"\ -S-\ S*'U4S+jr)S,r*U=r+$)- EsmConfiga mask_token_id (`int`, *optional*): The index of the mask token in the vocabulary. This must be included in the config because of the "mask-dropout" scaling trick, which will scale the inputs depending on the number of masked tokens. rope_theta (`float`, defaults to 10000.0): The base period of the RoPE embeddings. Only used when `position_embedding_type` is set to `"rotary"`. position_embedding_type (`str`, *optional*, defaults to `"absolute"`): Type of position embedding. Choose either `"absolute"` or "rotary"`. emb_layer_norm_before (`bool`, *optional*): Whether to apply layer normalization after embeddings but before the main stem of the network. token_dropout (`bool`, defaults to `False`): When this is enabled, masked tokens are treated as if they had been dropped out by input dropout. is_folding_model (`bool`, defaults to `False`): When this is enabled, ESMFold model will be initialized. esmfold_config (`dict`, *optional*): Configuration to initiate the ESMFold module. vocab_list (`list`, *optional*): List of the vocabulary items. Examples: ```python >>> from transformers import EsmModel, EsmConfig >>> # Initializing a ESM facebook/esm-1b style configuration >>> configuration = EsmConfig(vocab_size=33) >>> # Initializing a model from the configuration >>> model = EsmModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```esmesmfold_configN vocab_size mask_token_id pad_token_idi hidden_sizernum_hidden_layersnum_attention_headsi intermediate_sizerhidden_dropout_probattention_probs_dropout_probimax_position_embeddingsg@ rope_thetag{Gz?initializer_rangeg-q=layer_norm_epsabsoluteposition_embedding_typeT use_cacheemb_layer_norm_beforeF token_dropoutis_folding_model. vocab_list is_decoderadd_cross_attentiontie_word_embeddings bos_token_idr eos_token_idc >UR(aURc%[RS5 [ 5UlO9[ UR[ 5(a[ S0URD6UlURc$[RS5 [5UlOSUlSUlURb'[URSS5(a [S5e[TU]4"S0UD6 g)NzCNo esmfold_config supplied for folding model, using default values.zHNo vocab_list supplied for folding model, assuming the ESM-2 vocabulary!rdFzOThe HuggingFace port of ESMFold does not support use_esm_attn_map at this time!r')rrsloggerinfor_rJrKrwarningget_default_vocab_listgetattrrUrLrMrNs r2rMEsmConfig.__post_init__s  ""* ab&3o#D//66&3&Jd6I6I&J#&ij"8":"&D "DO    *wt7J7JL^`e/f/fno o ''r1)rsr),r(r)r*r+r, model_typer_rZrtr-r.rurvrwrxryrzr{r/r|r}r~rrrrmrr[rrrrsrKrlisttuplerrrrrrMr0r\r]s@r2rprps  DJ#]3K!Jd ! $M3:$#L#*#Ks!!!s!(++14 %$,4#'S'J#u##(NEDL(*4S4Z4It)-4$;-!&M4$;&$)dTk)26ND=(4/659JS E#s(O+d29#Jt #',, $$#L#*#+,L#S /D(,((r1rpcg)N)!zzzzLAGVSERTIDPKQNFYMHWCXBUZOrT-zzr'r'r1r2rrs" r1N)r,typingrhuggingface_hub.dataclassesrconfiguration_utilsrutilsrrutils.type_validatorsr r get_loggerr(rr r4r_rpr__all__r'r1r2rs.3,>   H %1,11h/"//d($((,,-R( R(.R(j#L -r1