x[h.SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKJrJ r SSK J r J r J r JrJrJrJr SSKJrJrJrJrJrJrJr SSKJr SSKJr SSKJr SSKJ r SS K!J"r"J#r# SS K$J%r% SS K&J'r' SS K(J)r) SS K*J+r+ Sr,Sr-Sr.Sr/\,\-\./r0Sr1Sr2Sr3Sr4Sr5Sr6Sr7Sr8\Rr"\:5r;SS4SS4SS4S .r<\ "S!S"\55r="S#S$\5r>"S%S&\?5r@"S'S(\?5rA"S)S*\?5rBSGS+jrC\54S,jrD"S-S.\5rE"S/S0\5rF"S1S2\5rG"S3S\)\RS49rIS5rJS6\\I\K44S7jrLS8rMSHS9\KS6\N4S:jjrOS;rPSIS<jrQ"S=S>\R5rSS?rTS@\ISA\KS6\N4SBjrUSA\KS6\\I4SCjrVS6\K4SDjrWSE\KS6\K4SFjrXg)JN)Enumunique)AnyDictList NamedTupleOptionalTupleUnion) atomic_helperdmiimporter lifecyclenet performance type_utils) user_data)util) write_json)Distro) EventScope EventType) launch_index)Paths)CloudInitPickleMixin)eventsdisabledlocalrpass FILESYSTEMNETWORK DataSourcez|EXPERIMENTAL: The structure and format of content scoped under the 'ds' key may change in subsequent releases of cloud-init.zredacted for non-root user cloud-name_unsetunknownz aws-chinac US:H$Nawscs r-Fs1:zaws-govc US:H$r'r)r*s r,r-r-GsQ%Zr.z azure-chinac US:H$)Nazurer)r*s r,r-r-HsqG|r.)zcn-zus-gov-chinac:\rSrSrSrSrSrSrSrSr S\ 4S jr S r g ) NetworkConfigSourceLzV Represents the canonical list of network config sources that cloud-init knows about. cmdlineds system_cfgfallback initramfsreturncUR$Nvalueselfs r,__str__NetworkConfigSource.__str__Y zzr.r)N) __name__ __module__ __qualname____firstlineno____doc__CMD_LINEDS SYSTEM_CFGFALLBACK INITRAMFSstrrB__static_attributes__r)r.r,r4r4Ls. H BJHIr.r4c.\rSrSrSrSrSrS\4SjrSr g) NicOrder]zRepresents ways to sort NICsmacnic_namer;cUR$r=r>r@s r,rBNicOrder.__str__crDr.r)N) rErFrGrHrIMACNIC_NAMErOrBrPr)r.r,rRrR]s& CHr.rRc\rSrSrSrSrg)DatasourceUnpickleUserDataErrorgzERaised when userdata is unable to be unpickled due to python upgradesr)NrErFrGrHrIrPr)r.r,r[r[gsOr.r[c\rSrSrSrg)DataSourceNotFoundExceptionkr)NrErFrGrHrPr)r.r,r_r_kr.r_c\rSrSrSrSrg)InvalidMetaDataExceptionoz8Raised when metadata is broken, unavailable or disabled.r)Nr]r)r.r,rdrdosBr.rdc[R"U5n/n/nUR5GHupgU(a US-U-nOUnUR5U;dUR5U;aUR U5 [ U[ 5(a;URS5(a%UR U5 URSS5X6'[ U[5(dM[XxU5n URU RS55 URU RS55 XU'GM [U5US'[U5US'U$)zProcess all instance metadata cleaning it up for persisting as json. Strip ci-b64 prefix and catalog any 'base64_encoded_keys' as a list @return Dict copy of processed metadata. /zci-b64:base64_encoded_keyssensitive_keys)copydeepcopyitemslowerappend isinstancerO startswithreplacedictprocess_instance_metadataextendpopsorted) metadatakey_pathrjmd_copyri sens_keyskeyval sub_key_path return_vals r,rtrtss+mmH%GINN$ #c>C/LL IIK> )!!#~5   \ * c3  CNN9$=$=  & &| 4;;y"5GL c4 2>J & &z~~6K'L M   Z^^,<= >%CL'%(&,,?%@G !" &y 1G  Nr.c@URS/5(dU$[R"U5nURS5HYnURS5nUnUH1nXe;dM [ XV[ 5(dM#XdS:wdM-XVnM3 WU;dMUXU'M[ U$)zRedact any sensitive keys from to provided metadata dictionary. Replace any keys values listed in 'sensitive_keys' with redact_value. rjrg)getrkrlsplitrprs)rx redact_valuerzry path_partsobjpaths r,redact_sensitive_keysrs <<(" - -mmH%GLL!12^^C( D sy$//rN*i  3;$I3 Nr.c>\rSrSr%\\S'\\S'\\S'\\S'Srg) URLParamsmax_wait_secondstimeout_seconds num_retriessec_between_retriesr)N)rErFrGrHint__annotations__rPr)r.r,rrsr.rc0\rSrSr%\\\S'\\S'Srg)DataSourceHostnamehostname is_defaultr)N) rErFrGrHr rOrboolrPr)r.r,rrssmr.rc8\rSrSr%Sr\\S'\\S'\\S'Srg)HotplugRetrySettingsz in seconds force_retry sleep_period sleep_totalr)N) rErFrGrHrIrrrrPr)r.r,rrsr.rc \rSrSr%\rSrSrSr\ \ \ S'Sr Sr Sr\ \\\ 4\ S'\R$\R&\R(\R*4r\\S4\ S'S rS rS rS r\R:\R>\R@\RB\RD10r#\R:\R>10r$S \%4S\%4S04SSSSSS4 r&\\\ \'4S4\ S'Sr(Sr)\\ S4\ S'Sr*\+"SSS5r,Sr-\ \ \ S'S r.SQS\/S\04Sjjr1S\2S S4S!jr3S"r4S \54S#jr6S \54S$jr7S%r8S&r9SRS'jr:\;Rx"S(S)S*9S \54S+j5r=SSS,jr>S \54S-jr?S.r@STS/jrAS0rBS1rC\DS25rE\DS35rFS4rG\DS55rHS6rI\DS75rJS8rKS9rLS:rMS;rNS<rOS=rPS>rQS?rRS@rSSArT\DSB5rU\DSC5rVSDrWSUSEjrXSFrYSG\Z\4SHjr[SG\Z\S \54SIjr\SJr]SKr^\_SVSLj5r`\DSM5raSNrbSOrcSPrdg)Wr"z en_US.UTF-8_undefN _cloud_name_crawled_metadata.network_config_sourcesr  ec2_metadata network_jsonrx)userdataN) userdata_rawN) vendordataN)vendordata_rawN) vendordata2N)vendordata2_rawNcached_attr_defaultsF) combined_cloud_config merged_cfgmerged_system_cfgzsecurity-credentialsr user-datarr vendor-datazds/vendor_datasensitive_metadata_keysrextra_hotplug_udev_rulesdistropathscXlX lX0lSUl0UlSUlSUlSUlSUlSUl SUl [Ul [Ul [R"URSUR 405UlUR"(d0UlU(d&[$R&"UR5UlgX@lg)N datasource)sys_cfgrrrrxrrrrrmetadata_addressUNSETrrrget_cfg_by_pathdsnameds_cfgudUserDataProcessorud_proc)rArrrrs r,__init__DataSource.__init__Os   '+   9="#/3+0!** LL<5r  {{DK// ;DL"Lr.ci_pkl_versionr;cSSS[SS[SSS[SSS5S. nUR5H#up4[X5(aM[ XU5 M% [US5(d[ USS5 [US5(a%UR b[ UR 5 ggg![a&n[RSU5 [5UeSnAff=f) z(Perform deserialization fixes for Paths.NFr) r_platform_type _subplatformrrrrskip_hotplug_detectrrhotplug_retry_settingscheck_if_fallback_is_allowedcgNFr)r)r.r,r-&DataSource._unpickle..}s%r.rz:Unable to unpickle datasource: %s. Ignoring current cache.) rrrmhasattrsetattrrrOAttributeErrorLOGdebugr[)rArexpected_attrsr|r?es r, _unpickleDataSource._unpickleis"&" !(, $!#(#&:5!Q&G  )..0JC4%%5)1t;<< D8- H 4 $ $)B  ?DMM"*C $" ? / 67Q>  ?sB// C9!CCc.[R"U5$r=)robj_namer@s r,rBDataSource.__str__s""4((r.cg)z#Check if running on this datasourceTr)r@s r, ds_detectDataSource.ds_detectr.cURR5[5R5:Xa[R SU5 gUR R S/5UR/:Xa[R SU5 gg)aOverride if either: - only a single datasource defined (nothing to fall back to) - command line argument is used (ci.ds=OpenStack) Note: get_cmdline() is required for the general case - when ds-identify does not run, _something_ needs to detect the kernel command line definition. z6Kernel command line set to use a single datasource %s.Tdatasource_listz2Datasource list set to use a single datasource %s.F)rrn parse_cmdlinerrrrr@s r,override_ds_detectDataSource.override_ds_detectst ;;   -/"7"7"9 9 IIH  \\  / 4 E IIDd r.cUR5(aUR5$UR5(a&[R SU5 UR5$[R SU5 g)z&Overrides runtime datasource detectionz Detected %szDid not detect %sF)r _get_datarrrr@s r,_check_and_get_dataDataSource._check_and_get_datas^  " " $ $>># # ^^   II >># # II)4 0r.cUR5RnUR5nURnUSnS0SS/_SU_SU_S[ UR UR UR5_SUR _S UR _S US S _S US S_SUS S_SUR_SUR5_SUS_SU_SU_SUSS_SU_SU_USSUR URUSUSS.E0$)z2Return a dictionary of standardized metadata keys.sys_infov1 _beta_keys subplatformavailability-zoneavailability_zonecloud_idr# cloud_namerdistrdistro_versionrdistro_releaseplatformpublic_ssh_keyspython_versionpython instance-id instance_idkernel_releaseunamelocal-hostnamelocal_hostnamevariant)machineregionrsystem_platformr) get_hostnamerget_instance_idrcanonical_cloud_idrr platform_typeget_public_ssh_keysr)rA instance_datarrrsysinfos r,_get_standardized_metadata%DataSource._get_standardized_metadatas**,55**,  22 + }o#%6$%6.OOT[[$2D2D doodoo'&/!,!'&/!"4!'&/!"4D.."4#;#;#=!'("3{ {!"!''"21"5#$!.%&!.'(#7+A.++#//#*:#6"9-1  r.cUR(dgU(aUnO URnUH#up4[X5(dM[XU5 M% U(dSUlgg)zReset any cached metadata attributes to datasource defaults. @param attr_defaults: Optional tuple of (attr, value) pairs to set instead of cached_attr_defaults. NF) _dirty_cacherrr)rA attr_defaults attr_values attributer?s r,clear_cached_attrsDataSource.clear_cached_attrssW    'K33K + It''/!, %D r.zGetting metadataalways)log_modecfSUlUR5nU(dU$UR5 U$)zDatasources implement _get_data to setup metadata and userdata_raw. Minimally, the datasource should return a boolean True on success. T)rrpersist_instance_data)rA return_values r,get_dataDataSource.get_datas7 !//1   ""$r.c U(a\[RRURR5(a$[ XRR S55 URbI[R"UR5nURSS5 URSS5 SU0nO\SSUR00nUR[:waURUSS'UR[:waURUSS'[USS '[R"UR 5US 'S US S '[R"US 5US 'S US S '["R$"5US'UR'UR)U55 [*R,"U5n[/[0R2"U5UR4S9nURRAS5nUSRCSS5n[RREURRFS5n ["RH"U SU3US35 Sn U SU3n [RRKU 5(a[RRMU 5n ["RN"XSS9 U (aX:wa["RP"U 5 [SXuSS9 URRAS5n [SU [UU55 g![6a)n[8R;S[=U55 SnAgSnAf[>a)n[8R;S[=U55 SnAgSnAff=f)a Process and write INSTANCE_JSON_FILE with all instance metadata. Replace any hyphens with underscores in key names for use in template processing. :param write_cache: boolean set True to persist obj.pkl when instance_link exists. @return True on successful write, False otherwise. obj_pklNrrr7 meta_datarr_docrz TZZ%7%7D  =/8*5(2G!,oQxj9 77>>- ( (!#!1!1-!@  'dC "4"I MM, -&UCJJ**?; 93NCD1  KKA3q6 J!  KKA3q6 J s$*>L)) N 3M N $NN c[S5e)z@Walk metadata sources, process crawled data and save attributes.zlSubclasses of DataSource must implement _get_data which sets self.metadata, vendordata_raw and userdata_raw.)NotImplementedErrorr@s r,rDataSource._get_dataQs! D  r.c ^URn[URRSUR55nURn[S[URRSUR555nURn[URRSUR55nURn[URRSUR55n[XX45$![a: [ R "[SURRS5U5 GN f=f![aF URn[ R "[SURRS5U5 GNf=f![a: [ R "[SURRS5U5 GN%f=f![a: [ R "[S URRS5U5 GN0f=f) zReturn the Datasource's preferred url_read parameters. Subclasses may override url_max_wait, url_timeout, url_retries. @return: A URLParams object with max_wait_seconds, timeout_seconds, num_retries. max_waitz6Config max_wait '%s' is not an int, using default '%s'rtimeoutz5Config timeout '%s' is not an int, using default '%s'retriesz5Config retries '%s' is not an int, using default '%s'rzAConfig sec_between_retries '%s' is not an int, using default '%s') url_max_waitrrr ValueErrorrlogexcr url_timeoutmax url_retries Exceptionurl_sec_between_retriesr)rArJrKrLrs r,get_url_paramsDataSource.get_url_paramsXs$$ 4;;??:t7H7HIJH"" !SDUs s $ Mg g)Nsd)vdxvdvtbz/dev/)rmrqlenr&rr8)rA short_namemappingsnfromtlistntocands r, _remap_deviceDataSource._remap_device sr ./$NN,LE((//&):c%jl+CD77>>$''K-r.cgr=r))rA_names r,device_name_to_device DataSource.device_name_to_devices r.cvURnURR5nU$![a U$f=f)z, (str, bool). is_default is a bool and it's true only if hostname is localhost and was returned by util.get_hostname() as a default. This is used to differentiate with a user-defined localhost hostname. Optionally return (None, False) when metadata_only is True and local-hostname data is not available. localdomain localhostFrNT.rzip-%sr"r)rxrrrrget_fqdn_from_hostsfindrOrris_ipv4_address gethostbyaddrrrrr5) rAfqdn resolve_ip metadata_only defdomaindefhostdomainrtoksr hosts_fqdnlhosts r,rDataSource.get_hostnameAs&"  }}DMM$5$56F$G$G)$ ;; D((*H;&! 11(;Jjooc2Q6:,,S1hmmC0148}**3/ ,+MM"23E""5))--e4Dt9??3/D#emmC&==>D{{3' t9q=AwHXXd12h'FAwH F'"*F3H!(77r.c4URRUS9$)N) data_source)rget_package_mirror_infor@s r,r"DataSource.get_package_mirror_infos{{22t2DDr.source_event_typesc0nUHcnURR5HBunnX5;dM URU5(d [5X$'X$R U5 MD Me U$r=)supported_update_eventsrmrsetadd)rArsupported_eventsevent update_scope update_eventss r,get_supported_eventsDataSource.get_supported_eventssq24'E--335)+// ==9<(6$266u= 6 ( r.c URU5nUR5Hjup4[RSURSR UVs/sHoURPM sn55 UR SU-[445 Ml U(a(UR 5 UR5nU(ag[RSUSR UVs/sHoURPM sn55 gs snfs snf)aRefresh cached metadata if the datasource supports this event. The datasource has a list of supported_update_events which trigger refreshing all cached metadata as well as refreshing the network configuration. @param source_event_types: List of EventTypes which may trigger a metadata update. @return True if the datasource did successfully update cached metadata due to source_event_type. z:Update datasource metadata and %s config due to events: %s, z _%s_configTz(Datasource %s not updated for events: %sF) rrmrrr?r5rrr)rArrscopematched_eventsrresults r,update_metadata_if_supported'DataSource.update_metadata_if_supporteds 445GH%5%;%;%= !E IIL  NCN5;;NCD   # #lU&:E%B$D E&>   # # %]]_F 6  II0BC0Bu{{0BC D !DDs DDcgrr))rArs r,check_instance_idDataSource.check_instance_idsr.cg)zcheck_if_fallback_is_allowed() Checks if a cached ds is allowed to be restored when no valid ds is found in local mode by checking instance-id and searching valid data through ds list. @return True if a ds allows fallback, False otherwise. Fr)r@s r,r'DataSource.check_if_fallback_is_allowedsr.cUc[nUc[nUH)nUcMX2;aUs $[RSX15 Us $ U$)Nz%invalid dsmode '%s', using default=%s)DSMODE_NETWORK VALID_DSMODESrr2) candidatesdefaultvalid candidates r,_determine_dsmodeDataSource._determine_dsmodesV ?$G =!E#I !   ;Y$r.cgr=r)r@s r,network_configDataSource.network_configrr.cg)asetup(is_new_instance) This is called before user-data and vendor-data have been processed. Unless the datasource has set mode to 'local', then networking per 'fallback' or per 'network_config' will have been written and brought up the OS at this point. Nr))rAis_new_instances r,setupDataSource.setups r.cg)aactivate(cfg, is_new_instance) This is called before the init_modules will be called but after the user-data and vendor-data have been fully processed. The cfg is fully up to date config, it contains a merged view of system config, datasource config, user config, vendor config. It should be used rather than the sys_cfg passed to __init__. is_new_instance is a boolean indicating if this is a new instance. Nr))rAcfgrs r,activateDataSource.activates r.)rrrrrrrrxrrrrrrrrrrrr=)r)T)F)FFF)NN)erErFrGrHrdsmoderrrr rOrrrrr rr4rJrNrLrKrr rMrPrRrTrr!rBOOT_NEW_INSTANCEBOOT BOOT_LEGACYHOTPLUGrdefault_update_eventsrrrrrrrrr_ci_pkl_versionrrrrrrBrrrrr rrtimedrrrrUr\r`rdpropertyrrrirrqrrZrYr_rcrr rrrrrrrrrrrrrr staticmethodrrrrrPr)r.r,r"r"sl F"NF"&K#%N L48xdCi 018 $$%%&& ?E"5s":;LKK@   ' ' NN  ! !        ' '    R ! 9%c3h 45 L 0U38_ " 2%A>/3hsm2O##u#4#?#?#?J)4D, $ L&&)H=$>$JX 4 :Jx  ##  ! !   .!#$ G  KK++1 F8PE  tI  $"&y/$ $L*  r.) metaclassc/nU(dU$[U[5(aUR5$[U[[45(a [U5$[U[ 5(aqUR 5H]up#[U[5(aU/n[U[[45(dM:UHnU(dM URU5 M M_ U$r=)rprO splitlineslistrrsrmro) pubkey_datakeys_keynameklistpkeys r,rrs D  +s##%%''+c{++K  +&&*002OH%%%%$--!Dt D) " 3 Kr.r;c [XCU5nUVs/sHn[R"U5PM n n[U;aSOSn [R SX5 [ X5Hup[R"SU RSS5-SU <SU <3S U <S U <3US 9n U  [R S U 5 U "XU5nUR[R/5(a2S U <SU <3U l U[R"U 54sSSS5 s $SSS5 M SSR#U 5-n[%U5es snf!,(df  M=f![a! [R "[SU 5 GM&f=f)Nnetworkrz#Searching for %s data source in: %sz search-%sr"rhzsearching for z data from zno z data found from )name descriptionmessageparentz%Seeing if we can get any data from %szfound zGetting data from %s failedz4Did not find any data source, searched classes: (%s)r) list_sourcesrr DEP_NETWORKrrziprReportEventStackrrrrrr rSrrOr5r_)rrrds_depscfg_listpkg_listreporterds_listrds_namesr%rclsmyrepsmsgs r, find_sourcersh8h7G0781 ##A&H8#w.9GDII3TD+ ''t||L"==;?F26=   A A3G/11001@DT$JEMz22378,& A499D C &c **59 A KK:C @ @ As< E"E$A+E  EE E EE&F F c/n[RSUUU5 UHn[R"U5n[R"XRS/5upgU(d[R SU5 UHHn[R "U5n [U S5n U "U5n U (dM6URU 5 M M U$)zReturn a list of classes that have the same depends as 'depends' iterate through cfg_list, loading "DataSource*" modules and calling their "get_datasource_list". Return an ordered list of classes that match (if any) zLLooking for data source in: %s, via packages %s that matches dependencies %sget_datasource_listzDCould not import %s. Does the DataSource exist and is it importable?) rrr"match_case_insensitive_module_name find_moduleerror import_modulegetattrru) rdependsrsrc_listr7ds_namem_locs _looked_locsm_locmodlistermatchess r,r r ?s HII 8 ==bA'33  56  II$  E((/CS"78FWoGw( $ Or.fieldcU(dg[R"U5nU(dgUR5UR5:H$r)r read_dmi_datarn)rr+ dmi_values r,instance_id_matches_system_uuidr/cs; !!%(I     )//"3 33r.cU(d[nU(d[nU[:XaU[:waU$U$[R5H2up4UupVURU5(dM!U"U5(dM0Us $ U[:waU$U$)z@Lookup the canonical cloud-id for a given cloud_name and region.)rmCLOUD_ID_REGION_PREFIX_MAPrmrq)rrrprefix cloud_id_testr valid_clouds r,rrqs % ! !! ) ) !;!A!A!C"/   V $ $Z)@)@O"D%% Or.c@U(dg[U[5(aU$[U[5(a[R"U5$[U[ 5(a)USLa[ URS5SS9$[S5e[S[U5-5e)a,data: a loaded object (strings, arrays, dicts). return something suitable for cloudinit vendordata_raw. if data is: None: return None string: return string list: return data the list is then processed in UserDataProcessor dict: return convert_vendordata(data.get('cloud-init')) NTz cloud-initF)recursez'vendordata['cloud-init'] cannot be dictz$Unknown data type for vendordata: %s) rprOrrkrlrsconvert_vendordatarrNrr)datar6s r,r7r7s $ $}}T""$ d?%dhh|&  C;UCs 0A&AA&BBcSn[R"U5nU(dg[R"U5$![aDn[RR U5(a[ RSX5 SnANhSnAff=f![a g[a [R"[ SU5 gf=f)zBUse pickle to deserialize a instance Datasource from a cache file.Nzfailed loading pickle in %s: %sz#Failed loading pickled blob from %s) rload_binary_filerSr&risfilerr2rEr0r[rO)r@pickle_contentsrs r,pkl_loadrLsOE//6 ||O,, E 77>>% KK95 DE +  C>Fs,9B B:BB B>%B>=B>c>[[R"55$)z}Check if command line argument for this datasource was passed Passing by command line overrides runtime datasource detection )parse_cmdline_or_dmir get_cmdliner)r.r,rrs  0 0 2 33r.inputc[R"SU5n[R"SU5n[R"SU5nU=(d U=(d UnU=(d UnU(a?URS5R5n[R "SUSU3SSUS 3S 9 U(a'URS5(aURS5$g ) Nz(?:^|\s)ds=([^\s;]+)z(?:^|\s)ci\.ds=([^\s;]+)z (?:^|\s)ci\.datasource=([^\s;]+)rz8Defining the datasource on the command line using ci.ds=z or ci.datasource=z23.2zUse ds=z instead) deprecateddeprecated_version extra_messagerh)researchgroupstripr deprecate)rP ds_parse_0 ds_parse_1 ds_parse_2r7rRrs r,rNrNs2E:J6>J>FJ  /z /ZB)zJ!!!$**,!!!'* &#F884  bhhqkkxx{ r.)rhr))z system-uuidr)Yabcrkr/loggingr&rErUenumrrtypingrrrrr r r cloudinitr r rrrrrrrrcloudinit.atomic_helperrcloudinit.distrosrcloudinit.eventrrcloudinit.filtersrcloudinit.helpersrcloudinit.persistencercloudinit.reportingrDSMODE_DISABLED DSMODE_LOCALr DSMODE_PASSrDEP_FILESYSTEMr  DS_PREFIXr+REDACT_SENSITIVE_VALUErprrm getLoggerrErr1r4rRrSr[r_rdrtrrrrABCMetar"rrOrr rr/rr7IOErrorr:r?r)rLrrNr)r.r,rrs   FFF&.$1*#6&   ,?   < 6' ! - ./03 4 $   tPiP ) CyC F2H:  :w %w t:+ :s?+B!J, 4 4  4&J0 W :cd$CHZ0*4s4r.