#j4B dZddlZddlZddlZddlmZddlmZddlm Z ej e Z Gddej ZGd d Zd ZGd d Z ddedzdedzdedzdedzfdZdZdS)zACollection of utils to be used by backbones and their components.N) repo_exists)logging)maybe_install_capturing_hooksceZdZdZdZdS) BackboneTypetimm transformersN)__name__ __module__ __qualname__TIMM TRANSFORMERSe/lsinfo/ai/hellotax_ai/base_platform/venv/lib/python3.11/site-packages/transformers/backbone_utils.pyrrs D!LLLrrceZdZdZdedzdedzfdZdZedZej dee fdZed Z e j de e d fee zfd Z fd ZxZS) BackboneConfigMixinzv A Mixin to support handling the `out_features` and `out_indices` attributes for the backbone configurations. out_featuresN out_indicesc|_t|trt|n|_jj}}|)|'t jdz g}jdg}n%||fd|D}n||fd|D}||c__dS)ap Sets output indices and features to new values and aligns them with the given `stage_names`. If one of the inputs is not given, find the corresponding `out_features` or `out_indices` for the given `stage_names`. Args: out_features (`list[str]`, *optional*): The names of the features for the backbone to output. Defaults to `config._out_features` if not provided. out_indices (`list[int]` or `tuple[int]`, *optional*): The indices of the features for the backbone to output. Defaults to `config._out_indices` if not provided. NrcDg|]}j|Sr) stage_namesindex).0layerselfs r zJBackboneConfigMixin.set_output_features_output_indices..Ds*SSSU4+11%88SSSrc*g|]}j|Srrridxrs rrzJBackboneConfigMixin.set_output_features_output_indices..Fs!IIIcD,S1IIIr) _out_features isinstancetuplelist _out_indicesverify_out_features_out_indiceslenr)rrrs` r"set_output_features_output_indicesz6BackboneConfigMixin.set_output_features_output_indices(s *1;K1O1O`D---U` ,,...%)$68Ik  <#7t/00145K ,R01LL  \%=SSSSlSSSKK  !k&=IIII[IIIL1=k-D- ,,.....rcjtdjtjtfs$tdt jt fdjDrtdjdjtjttjkrtdjjfdjDx}krtd |djj ]tj ts$td t j tfd j D}t fd |Drtd jdj t|tt|kr/dj }||j krd|dndz }t||tt|krIdtt|j dD}td|dj jkj ftjtj krtdjfdj DkrtddSdSdS)z_ Verify that out_indices and out_features are valid for the given stage_names. Nz2Stage_names must be set for transformers backbonesz out_features must be a list got c3*K|] }|jvVdSNr!rfeatrs r zFBackboneConfigMixin.verify_out_features_out_indices..Vs+OOD4t//OOOOOOrz.out_features must be a subset of stage_names: z got z2out_features must not contain any duplicates, got c&g|] }|jv |Srr$r/s rrzGBackboneConfigMixin.verify_out_features_out_indices..]s& a a a$ddN`F`F`F`F`F`rz@out_features must be in the same order as stage_names, expected z out_indices must be a list, got c3VK|]#}|dkr|tjzn|V$dS)rN)r*rr"s rr1zFBackboneConfigMixin.verify_out_features_out_indices..gsB$r$rY\C!GGS3t/?+@+@%@%@QT$r$r$r$r$r$rrc3bK|])}|ttjv%|V*dSr.)ranger*rr"s rr1zFBackboneConfigMixin.verify_out_features_out_indices..hs@^^3cs4K[G\G\A]A]6]6]36]6]6]6]^^rz2out_indices must be valid indices for stage_names z, got z1out_indices must not contain any duplicates, got z(equivalent to z))cg|]\}}|Srr)r_r#s rrzGBackboneConfigMixin.verify_out_features_out_indices..qs)###"AsC###rc|dS)Nrr)xs rzEBackboneConfigMixin.verify_out_features_out_indices..rs efgheir)keyz?out_indices must be in the same order as stage_names, expected zHout_features and out_indices should have the same length if both are setc*g|]}j|Srr!r"s rrzGBackboneConfigMixin.verify_out_features_out_indices..{s!%Y%Y%Yd&6s&;%Y%Y%YrzQout_features and out_indices should correspond to the same stages if both are set) r ValueErrorr$r%r'typeanyr*setr(r&sortedzip)r sorted_featspositive_indicesmsgsorted_negatives` rr)z3BackboneConfigMixin.verify_out_features_out_indicesLs   #QRR R   )d04':: ` !^DI[D\D\!^!^___OOOOD4 @ @} r)r r r __doc__r'r+r)propertyrsetterstrrr&intrU __classcell__rXs@rrr#s/"/Tk"/D["/"/"/"/H0v0v0vd""X"]c]]]] !!X!\uS#Xc'B\\\\rrcFtjfd}|S)ak Wrapper to filer out `hidden_states` as backbones tend to always use them to get their feature maps, i.e. they also always output `hidden_states`. This controls for user-defined behavior again. NOTE: We assume a `can_return_tuple` decorator to be applied before so that we always expect a dict like object to remove the hidden states. c|dt|jdd}|g|Ri|}|s3d|D}t |di|}|S)Noutput_hidden_statesFc"i|] \}}|dv || S) hidden_statesr)rkvs r z@filter_output_hidden_states..wrapper..s)#b#b#bTQqQ`GaGaAqGaGaGarr)getgetattrconfigitemsr@)rargskwargsrbrWfiltered_output_dataforward_functions rwrapperz,filter_output_hidden_states..wrappers%zz*@'$+WmotBuBuvv!!$888888# :#b#bV\\^^#b#b#b !T&\\99$899F r) functoolswraps)rorps` rfilter_output_hidden_statesrss;_%&&'& Nrc`eZdZUdZedzed<dZeed<dfd ZfdZ ddZ dd Z e d Z e jd eefd Z e d ZejdeeeezfdZe dZe dZdZ ddedzdedzdedzfdZxZS) BackboneMixinN backbone_typeThas_attentionsreturnctj|i||dd}|tj|_ntj|_|jtjkr||dS|jtjkr|dStd|jd)z Method to initialize the backbone. This method is called by the constructor of the base class after the pretrained model weights have been loaded. timm_backboneN)backbonezbackbone_type z not supported.) rT__init__rVrrrvr_init_timm_backbone_init_transformers_backboner?)rrlrmrzrXs rr|zBackboneMixin.__init__s $)&))) ?D99  $!-!2D  !-!:D   !2 2 2  $ $m $ < < < < <  <#< < <  , , . . . . .Qd.@QQQRR Rrcftt|dS)a Override `post_init` to always install capturing hooks, as backbone will ALWAYS capture outputs. We need to do it in `post_init`, as modules need to be already instantiated. It avoids some mixups with `torch.compile`, as the first hook installation will need/create a graph break, which can clash with external user call such as `model = torch.compile(model...)`. N)rT post_initr)rrXs rrzBackboneMixin.post_inits/ %d+++++rct|jdd}t|jdd}d|jjD|_d|jjD|_t |jj}|j}|||krtd|d|||jkrtd|d |j|j_|j ||dS) zj Initialize the backbone model from timm. The backbone must already be loaded to backbone rNrcg|] }|d S)modulerrstages rrz5BackboneMixin._init_timm_backbone..sTTTE(OTTTrcg|] }|d S)num_chsrrs rrz5BackboneMixin._init_timm_backbone..sVVV%U9-VVVrz!Config has `out_features` set to z which doesn't match `out_features` from backbone's feature_info. Please check if your checkpoint has correct out features/indices saved.z Config has `stage_names` set to z which doesn't match `stage_names` from backbone's feature_info. Please check if your checkpoint has correct `stage_names` saved.) rirj feature_infoinfor num_featuresr'r module_namer?r+)rr{out_features_from_configstage_names_from_configrrs rr}z!BackboneMixin._init_timm_backbones= $+4;#M#M ")$+}d"K"K UT9N9STTTVV8;P;UVVV80<== ,88:: # /4LP\4\4\x4Lxxx  # .3JdN^3^3^q3Jqqq  #'"2  66|[QQQQQrch|jj|_|jd|_dSr.)rjrr)rrJs rr~z)BackboneMixin._init_transformers_backbones1;2 33555 rc|jjSr.)rjr$rJs rrzBackboneMixin.out_featuress {((rrc||j_dS)rLN)rjrrNs rrzBackboneMixin.out_featuress $0    rc|jjSr.)rjr(rJs rrzBackboneMixin.out_indices s {''rrc||j_dS)rQN)rjrrRs rrzBackboneMixin.out_indicess #. rcDfdtjDS)Nc2i|]\}}|j|Sr)r)rirrs rrgz6BackboneMixin.out_feature_channels..s'XXX5t(+XXXr) enumeraterrJs`rout_feature_channelsz"BackboneMixin.out_feature_channelss+YXXXIdFV. s!NNND)$/NNNr)rrJs`rchannelszBackboneMixin.channelss NNNNDBackboneMixin.forward_with_filtered_kwargs..'s$HHHtq!iar) rwrVrvrrdictinspectrforward parametersrk)rrlrmrs @rforward_with_filtered_kwargsz*BackboneMixin.forward_with_filtered_kwargs"s" 2 JJ*D 1 1 1  !2 2 2W.t|<<GHHIHHHHv||~~HHHFtT$V$$$rrbr return_dictc td)Nz7This method should be implemented by the derived class.)NotImplementedError)r pixel_valuesrbrrs rrzBackboneMixin.forward*s""[\\\r)rxN)NNN)r r r rvr__annotations__rwboolr|rr}r~rZrr[r'r\rr&r]rrrrr^r_s@rrurus)-M<$&--- NDSSSSSS& , , , , ,RRRRB!!!! ))X)0c0000 ((X(.uSzDI'=.... YYXY OOXO%%%-1)-#' ]]#Tk] $; ] D[ ]]]]]]]]rrudefault_backbonedefault_config_typedefault_config_kwargstimm_default_kwargsc ddlm}ddlm}|dd}|di} |d|dn|} |dd||r| || s|d d d| i|}n| f|dt | rD|| \} } || d } | | | d i| }n|d d d| i| }n||3|1t d |d |pi}||d i|}nGt|tr2|d }||} | |}||fS)Nr)PreTrainedConfig)CONFIG_MAPPINGuse_timm_backboneTbackbone_kwargsr{use_pretrained_backbonerz model_typezG`backbone_config` is `None`. Initializing the config with the default `z` vision config.r)configuration_utilsr models.autorrVrhrget_config_dictupdateloggerrr%r from_dict)backbone_configrrrrrmrrrrr{ config_dictr9 config_classbackbone_model_types r%consolidate_backbone_kwargs_to_configr4s655555++++++ #6==jj!2B77O)/J)?)?)Kvzz*%%%QaH JJ($/// '  (   # $:.9cc8cObcc  /"9 x  d-==hGGNK)+l*CDL    / / /*l99[99OO=n_=ccxcSbccOO  %8%D {Vi { { {   !6 ;=.)<=VV@UVV OT * *B-11,??%&9: &00AA F ""rcddlm}t|dd}|||}n||}|S)a> Loads the backbone model from a config object. If the config is from the backbone model itself, then we return a backbone model with randomly initialized weights. If the config is from the parent model of the backbone model itself, then we load the pretrained backbone weights if specified. r) AutoBackbonerN)rj)r rri from_config)rjrrr{s r load_backbonerfsa*)))))f&7>>O++6+::++?+CC Or)NNNN)rYenumrqrhuggingface_hubrutilsrutils.output_capturingr get_loggerr rEnumrrrsrur\rrrrrrrsHG ''''''AAAAAA  H % %"""""49""" zzzzzzzzz*|]|]|]|]|]|]|]|]B$(&*)-'+ /#/#Dj/#t/# $; /#  /#/#/#/#dr