iU %SrSSKrSSKrSSKrSSKrSSKrSSKrSSKJr SSK J r J r J r J r SSKJrJrJrJrJr SSKJr SSKJr SSKJr SS KJr SS KJr \R<"\5r S r!S r"S r#Sr$Sr%SSS.r&\ \'\'4\(S'SSS/\/S.r)\\(S'Sr*Sr+Sr,Sr-SSS.r.S S S.r/S!S"/r0/S#Qr1S$r2S\20r3SUS%jr4S&\'S'\S(\S)\5S*S4 S+jr6S,r7S-r8S.r9S/r:S0r;S1rS4r?S5\'S*\'4S6jr@S*\'4S7jrAS*\'4S8jrBS*\ \'\'44S9jrCS:\'S*\D4S;jrESS?.rFS@rGS*\ \'\'44SAjrHSBrISCrJSVSDjrKSErLSWSFjrMSXSGjrNSHrOSIrPSJrQSKrRSLrSSMrTSNrUSOrVSPrWSUSQjrXSRrYSYSSjrZST\<0r[g)Zz*Apt Configure: Configure apt for the user.N)indent)DictIterableListMapping)features lifecyclesubp templaterutil)Cloud)Config) MetaSchema)GPG) PER_INSTANCEz ^[\w-]+:\wz/etc/apt/trusted.gpgz/etc/apt/trusted.gpg.d/z/etc/apt/cloud-init.gpg.d/z&# cloud-init disable_suites redacted: zsoftware-properties-commongnupg)add-apt-repositorygpgPACKAGE_DEPENDENCY_BY_COMMANDcc_apt_configureubuntudebian)iddistros frequencyactivate_by_schema_keysmetaz/var/lib/apt/listsz'/etc/apt/apt.conf.d/94cloud-init-configz)/etc/apt/apt.conf.d/90cloud-init-aptproxyzkeyserver.ubuntu.comz!http://archive.ubuntu.com/ubuntu/z"http://security.ubuntu.com/ubuntu/PRIMARYSECURITYz$http://ports.ubuntu.com/ubuntu-portsamd64i386)s390xarm64armhfpowerpcppc64elriscv64a# Ubuntu sources have moved to the /etc/apt/sources.list.d/ubuntu.sources # file, which uses the deb822 format. Use deb822-formatted .sources files # to manage package sources in the /etc/apt/sources.list.d/ directory. # See the sources.list(5) manual page for details. cUc[R"5nU[;a[R 5$U[ ;a[ R 5$[SU-5e)zreturns the default mirrors for the target. These depend on the architecture, for more see: https://wiki.ubuntu.com/UbuntuDevelopment/PackageArchive#Portsz#No default mirror known for arch %s)r get_dpkg_architecturePRIMARY_ARCHESPRIMARY_ARCH_MIRRORScopy PORTS_ARCHES PORTS_MIRRORS ValueErrorarchs C/usr/lib/python3/dist-packages/cloudinit/config/cc_apt_configure.pyget_default_mirrorsr4UsV  |))+ ~#((** |!!## :TA BBnamecfgcloudargsreturnc [U5nURS05n[U[5(d![ SR [ U5S95e[U5 [5n[XBU5 SSS5 g!,(df  g=f)zprocess the config for apt_config. This can be called from curthooks if a global apt config was provided or via the "apt" standalone command.aptz9Expected dictionary for 'apt' config, found {config_type}) config_typeN) convert_to_v3_apt_formatget isinstancedictr0formattypeapply_debconf_selectionsr apply_apt)r6r7r8r9apt_cfg gpg_contexts r3handlerHdsr #3 'CggeR G gt $ $ ""(&T']&"C  W% +'+. s ) A?? B c[R"5(ag[R"S5(d[R"S5(dgg)N)Fzsystem is snappy.zapt-getr<)Fzno apt commands.)TzApt is available.)r system_is_snappyr whichr5r3_should_configure_on_empty_aptrMws7 ) JJy ! !TZZ%6%6( $r5cU(d*[5up4U(d[RSU5 g[RSU5 [R"5Sn[R "5n[ XUS9n[RSU5 SnURS[5n U (a [R"U 5Rn[XU5 [R"URSS55(a [XU5 OO[R"URS S55(a$[!XU5n [#XXqU 5 [%Xv5 ['U[([*5 S U;aUn X[S 'US U S '[3US UUU US9 gg![,[.4a [R1S 5 NMf=f)Nz#Nothing to do: No apt config and %szhandling apt config: %scodenamer1zApt Mirror info: %sadd_apt_repo_matchgenerate_mirrorlistsFpreserve_sources_listz)Failed to apply proxy or apt config info:sourcesRELEASEMIRROR)template_params aa_repo_match)rMLOGdebugr lsb_releaser*find_apt_mirror_infor?ADD_APT_REPO_MATCHrecompilesearch_ensure_dependenciesis_truerQis_falseadd_mirror_keysgenerate_sources_listrename_apt_listsapply_apt_config APT_PROXY_FN APT_CONFIG_FNIOErrorOSError exceptionadd_apt_sources) r7r8r should_configmsgreleaser2mirrorsmatchermatchcfgkeysparamss r3rErEs ;=  II;S A II'- ,G  % % 'D"3D9GII#W-Gww+-?@H**X&--u- ||CGG2E:;;S51 sww6> ? ?s3/cGDA'ClM: C#y"8,x  N  "!   W C ABCs(F##%G  G chURS5(dUS- n[R"S/USS9 g)N zdebconf-set-selectionsTdatacapture)endswithr ) selectionss r3debconf_set_selectionsr|s5   u % %e II !" r5cx/n/nUHUnU[;a7[RSU5 [U"5 URU5 MDURU5 MW [ U5(a[R SU5 [ U5(a%[ R "SS/[U5-SSS9 gg)Nzunconfiguring %szSThe following packages were installed and preseeded, but cannot be unconfigured: %szdpkg-reconfigurez--frontend=noninteractiveTrw)CONFIG_CLEANERSrXrYappendlenwarningr list)packages unhandled to_configpkgs r3dpkg_reconfigurers II / ! II(# . C "   S !   S !  9~~  -   9~~ !< =9o   r5cURS5nU(d[RS5 gSR[ UR 55Vs/sHo!UPM sn5n[ UR55 [5nUR5H]upVUR5HDnURS5(aM[R"SSU5nURU5 MF M_ [R "5n [RSU5 UR#U 5n U (d[RS 5 g[%U 5 gs snf) z2apply_debconf_selections - push content to debconfdebconf_selectionsz(debconf_selections was not set in configN #z[:\s].*z pkgs_cfgd: %szno need for reconfig)r?rXrYjoinsortedrsr|encodesetitems splitlines startswithr]subaddr get_installed_packages intersectionr) r7selsetskeyr{ pkgs_cfgd_keycontentlinerpkgs_installed need_reconfigs r3rDrDs gg*+G  <=F7<<>4JK4JSCL4JKLJ:,,./I  &&(Ds##&&R.C MM#  ))002NIIoy)**>:M  ()]#+LsE#c[R"[R"SS95n[R SU5 UHn[ R "U5 M g)z%clean out any local cloud-init configz/etc/cloud/cloud.cfg.d/*dpkg*pathz#cleaning cloud-init config from: %sN)globr target_pathrXrYosunlink)flistdpkg_cfgs r3clean_cloud_initrsA IId&&,KL MEII3U; (r5cUnURS5(aUSSnURS5nUS:aXS-SnURSS5nU$)zmirrorurl_to_apt_fileprefix Convert a mirror url to the file prefix used by apt on disk to store cache information for that mirror. To do so do: - take off ???:// - drop tailing / - convert in string / to _/rz://N_)rzfindreplace)mirrorstringposs r3mirrorurl_to_apt_fileprefixrs[F s" ++e C axa " ^^C %F Mr5ct[U5n[R"[5nUR 5HupEUR U5nU(dMU[ RR-[U5-nU[ RR-[U5-nXx:XaMx[U5n [R"SU-5H:n U<XS<3n [RSX5 [ R"X5 M< M g![a [R!SSS9 Mdf=f)z>rename_apt_lists - rename apt lists to preserve old cache dataz%s_*NzRenaming apt list %s to %szFailed to rename apt list:T)exc_info)r4r r APT_LISTSrr?rrseprrrrXrYrenamerjr) new_mirrorsr2default_mirrorsprer6omirrornmirroroprefixnprefixolenfilenamenewnames r3reres)$/O   9 %C(..0 //$'  #&A'&JJ #&A'&JJ   7| &7"23H '%9G II2H F I (, 41 I 84 H Is6DD76D7cFSSSSSS.nXnU$![a UnU$f=f)zthere are a few default names which will be auto-extended. This comes at the inability to use those names literally as suites, but on the other hand increases readability of the cfg quite a lotz$RELEASE-updatesz$RELEASE-backportsz$RELEASE-securityz$RELEASE-proposedz$RELEASE)updates backportssecurityproposedro)KeyError)suitemappingretsuites r3map_known_suitesr2sH &)'' G> O  Os    deb822_entryc[R"SU5(dD[R"SSU5n[R"[SU5nS[ US5-$U$)z0If no active Suites, disable this deb822 source.z\nSuites:[ \t]+([\w-]+)z \nSuites:.*rz7## Entry disabled by cloud-init, due to disable_suites z# disabled by cloud-init: )r]findallrDISABLE_SUITES_REDACT_PREFIXr)rs r3%disable_deb822_section_without_suitesrDsd ::0, ? ?vvnb,? vv,-L  G\#?@ A  r5c\/nUVs/sH%n[R"[U5SU05PM' nn[R SX5 SnUR 5GHnUR S5(a"U(aXgS3- nOURU5 M<U(aUR5(a6U(aUR[U55 SnURU5 MUnUR S5(d XgS-- nMU(aSUR5SSn U Vs/sH nXE;dM UPM n nX:wa"U[US3- nS S RU 53nXhS-- nGM U(aUR[U55 SRU5$s snfs snf) z:reads the deb822 format config and comment disabled suitesrTzDisabling suites %s as %srrrzSuites:NzSuites:  ) r render_stringrrXrYrrrisspacersplitrr) disabledsrcronew_srcrdisabled_suite_namesnew_deb822_entryrnew_line orig_suites new_suitess r3disable_suites_deb822rTsGE  0 7)W9MNII)8J  ??3   fBK/ t$ t||~~9:JK$& NN4 y)) t +   **,qr*K)(E4(  ( 'C&DTF"$MM %chhz&:%;<tO+A!B<=MNO 99W S<s,F$* F)7F)c2U(dU$Un[U5(a [XU5$UHn[U5n[R"USU05n[ R SXE5 SnURS5HnURS5(aXg- nMUR5n[U5S:aQSn USRS5(a)USS H n U S- n U RS 5(dM O XU:XaS U-nXg- nM UnM U$) zNreads the config for suites to be disabled and removes those from the templaterTzDisabling suite %s as %srTrr[N]z"# suite disabled by cloud-init: %s) is_deb822_sources_formatrrr rrXrYrrrrrz) rrroretsrcr releasesuitenewsrcrcolspcolcols r3disable_suitesrs  F$$$XG<< ' ..uy'6JK  ,eB%%d+Ds## ::4 (D  DE ( D D9"11ELL--.xj 9 55nEK KK={ K "";/&&t4H #H - -. %& 1 II"   +Kcgg&67KHOOK6(RWW^^> LL    4#6#67G#HH@$$&E I HH;=M  MM* +#.N(r5cf[R"S5n[R"[ U55 [R "[ X2R RS3- 5USS3SS9 [R "[ X2R RS3- 5USS3SS9 g ) zQgenerate_mirrorlists create one file for every mirror for apt-transport-mirror(1)z/etc/apt/mirrors.listrrr rz-security.listr N)pathlibPathr ensure_dirstrrrr6)r7rpr8aptmirs r3rQrQTs\\, -FOOCK OO F ))*%0 01 9  b!   OO F ))*.9 9: :  r" r5c[RSU5 [R"U5Rn[ SX$XS9$![ Ra [RS5 ef=f)zA actual adding of a key as defined in key argument to the system zAdding key: '%s'r) output_filerxhardenedz(failed to add apt GPG Key to apt keyring) rXrYr'r(stemapt_keyr rrk)rrrr.r6s r3add_apt_key_rawr1esg II!3'||I&++ 3s    % % @A s *A+A.c/n[5n[R"URSS55(aWSHQnURU5(dMXH.nSS1R U5(dMUR S5 M0 MS URS05nUR 5H\nSS1R U5(aUR S5 U"URSS 55(dMKUR S 5 M^ UH8n [R"U 5(aM UR[U 5 M: U(a%URR[U55 g g ) aInstall missing package dependencies based on apt_sources config. Inspect the cloud config user-data provided. When user-data indicates conditions where add_apt_key or add-apt-repository will be called, ensure the required command dependencies are present installed. Perform this inspection upfront because it is very expensive to call distro.install_packages due to a preliminary 'apt update' called before package installation. rRFrrkeyidrrSsourcerrN)rr rbr?rrvaluesshutilrKrrrinstall_packagesr) r7rWr8missing_packages required_cmds mirror_key mirror_itemapt_sources_dictentcommands r3r`r`us7#%#&5M }}SWW4e<==1Jwwz""$'?Kw'44[AA%))%0$3 2wwy"-&&( 7  ( ( - -   e $ 2. / /   2 3 ) !||G$$  # #$A'$J K! %%f-=&>?r5cSU;a/SU;a)[nSU;aUSnURUSU5US'SU;a[USU=(d USX#S9$g)z Add key to the system as defined in ent (if any). Supports raw keys or keyid's The latter will as a first step fetched to get the raw key r3r keyserverrr.N)DEFAULT_KEYSERVER getkeybyidr1)r=r8rr.rr@s r3rrsn #~%s*% # K(I^^CL)<E  | J 4S_c  r5cUc0nUc [S5e[U[5(d[SU-5eUGHKnXn[R SU5 SU;aXVS'SU;aSUS;a[ XaUSS 9nXsS 'O [ XaU5 SU;aM[USn[R"X5nUSRS 5(d&[RRS US5US'USRS 5(d US==S - ss'U"U5(a[R"SSU/5 GM[R""USS9n SU-n Sn SU;a US(dSn [$R&"XU S9 GMN UR*R-SS9 g![Ra [R!S5 ef=f![(an [R!SX5 eSn A ff=f)a install keys and repo source .list files defined in 'sources' for each 'source' entry in the config: 1. expand template variables and write source .list file in /etc/apt/sources.list.d/ 2. install defined keys 3. update packages via distro-specific method (i.e. apt-key update) @param srcdict: a dict containing elements required @param cloud: cloud instance object Example srcdict value: { 'rio-grande-repo': { 'source': 'deb [signed-by=$KEY_FILE] $MIRROR $RELEASE main', 'keyid': 'B59D 5F15 97A5 04B7 E230 6DCA 0620 BBCF 0368 3F77', 'keyserver': 'pgp.mit.edu' } } Note: Deb822 format is not supported Nz did not get a valid repo matcherzunknown apt format: %szadding source/key '%s'rr4z $KEY_FILETrAKEY_FILErz/etc/apt/sources.list.d/r&rz --no-updatezadd-apt-repository failed.rz%s arw)omodezfailed write to file %s: %s)force)r0r@rA TypeErrorrXrYrr rrrrrrzr rrkrr rrirupdate_package_sources) srcdictr8rrVrWrr=key_filer4sourcefncontentsrHdetails r3rlrls6;<< gt $ $0G<== *C0 S & O s?{c(m;"3sTBH*2J ' C ( 3  X((A:))#.. ggll*C OC O:''00  Ow &O    )=&A ##Z9 (HE3s8} OOHe r>s:''-.K8EM &c *C Jr5cSnU(aSn/nUS:XaSnOUS:XaSnO [S5e[R"X#5RnSR UR S5S S5nU(aUR S U-5 URS 5 /n URRn S U <S U<S<SU <3n UHn U R X-5 M [R"U 5nU$)z? Try to resolve a list of predefines DNS names to pick mirrors Nrrrrzsecurity-mirrorzunknown mirror type.rz.%s)z .localdomainrzhttp://-z%sr) r0r get_hostname_fqdnfqdnrrrextendrr6search_for_mirror) configured mirrortyper7r8rmydomdoms mirrordnsr mirror_listr mirrorfmtposts r3search_for_mirror_dnsrsF  " I : %)I23 3%%c166C,-  KK &    ""+19dFK D   y1 2'' 4 Mr5cUb UcUnXS.$URR5nU(a"UR5nUSUS'USUS'U$[U5$)zZsets security mirror to primary if not defined. returns defaults if no mirrors are definedrrrrr ) datasourceget_package_mirror_infor-r4)pmirrorsmirrorr2r8 mirror_infoms r3update_mirror_inforsr ?G"88""::" "  %G + Nr5c[XU5nUcgURSS5nUc&[R"URSS55nUc[ URSS5XU5nU$)zpass the three potential stages of mirror specification returns None is neither of them found anything otherwise the first hit is returnedNrdr_rg)rr?r rr)r7rr2r8mcfgrs r3 get_mirrorrsv !$ 7D |XXeT "F~''4(@A~& HH\4 (*5  Mr5cUc+[R"5n[RSU5 [ USX!5n[RSU5 [ USX!5n[RSU5 [ X4X!5nUSUS'U$)afind_apt_mirror_info find an apt_mirror given the cfg provided. It can check for separate config of primary and security mirrors If only primary is given security is assumed to be equal to primary If the generic apt_mirror is given that is defining for both z!got arch for mirror selection: %srzgot primary mirror: %srzgot security mirror: %srrU)r r*rXrYrr)r7r8r2rrrs r3r[r[s |))+ 5t<i5GII&0j$6GII'1$WtCK( 2K r5cSnUVVs/sH0upEURU5(dMXPRU5-PM2 nnn[U5(a@[RSU5 [R "USR U5S-5 OP[RRU5(a,[R"U5 [RSU5 URSS5(a<[RSU5 [R "X RS55 g[RRU5(a-[R"U5 [RSU5 ggs snnf) z@apply_apt_config Applies any apt*proxy config from if specified ))roAcquire::http::Proxy "%s";)rpr)rrzAcquire::ftp::Proxy "%s";)rqzAcquire::https::Proxy "%s";zwrite apt proxy info to %srz#no apt proxy configured, removed %sconfNzwrite apt config info to %sz$no apt config configured, removed %s) r?rrXrYr rrrrisfiler)r7 proxy_fname config_fnamecfgsr6fmtproxiess r3rfrfs  D7;Ld{cggdm"sWWT]"dGL 7|| . <  TYYw%7$%>?  $ $ k" 7E wwvt />  ggfo6  % % l# 8,G &Ms FFc^^^^^SmUUU4SjnUU4SjnUS:XaU"U5$US:XdUS:XaU"U5$[S5e)aHapt-key replacement commands implemented: 'add', 'list', 'finger' @param output_file: name of output gpg file (without .gpg or .asc) @param data: key contents @param human_output: list keys formatted for human parsing @param hardened: write keys to to /etc/apt/cloud-init.gpg.d/ (referred to with [signed-by] in sources file) c[RR[5(a[/O/n[R"[ 5H3nUR S5(dMUR[ U-5 M5 U(aU$S$)zreturn all apt keys /etc/apt/trusted.gpg (if it exists) and all keyfiles (and symlinks to keyfiles) in /etc/apt/trusted.gpg.d/ are returned based on apt-key implementation )z.gpgz.ascr)rrrAPT_LOCAL_KEYSlistdirAPT_TRUSTED_GPG_DIRrzr) key_filesfiles r3_get_key_filesapt_key.._get_key_filesHsg)+~(F(F^$B JJ23D}}-..  !4t!;<4&y-2-r5c>SnT(d,[R"[SRT55 U$T(a[O[ nUR T5nSRUT5n[R"X5 U$![Ra. [R"[SRT55 U$[a. [R"[SRT55 U$f=f)zYapt-key add returns filepath to new keyring, or '/dev/null' when an error occurs z /dev/nullz)Unknown filename, failed to add key: "{}"z{}{}.gpgz Gpg error, failed to add key: {}z#Decode error, failed to add key: {}) r logexcrXrBCLOUD_INIT_GPG_DIRrdearmorrr rUnicodeDecodeError)rGrkey_dirstdoutrxr.r-s r3 apt_key_addapt_key..apt_key_addWs   KK@GGM & *2&8K%,,T2&--g{C  2--  ;BB4H &  >EEdK  sA B>C>3C>=C>c>/nT"5H#nURURUTS95 M% SR U5$![Ra!n[R SX#5 SnAMhSnAff=f)zgapt-key list returns string of all trusted keys (in /etc/apt/trusted.gpg and /etc/apt/trusted.gpg.d/) ) human_outputzFailed to list key "%s": %sNr)r list_keysr rrXrr)rGkey_listrMerrorrrs r3 apt_key_listapt_key..apt_key_listssy &(H L))()N)yy""-- L 98KK LsAA8A33A8rfingerrz@apt_key() commands add, list, and finger are currently supported)r0) r>rr-rxr.rrrrs ```` @r3r0r05sQ& .8# %3 H 6 1C   N  r5z cloud-init)N)F)FN)NN)NNFT)\__doc__rloggingrr'r]r6textwraprtypingrrrr cloudinitrr r r r cloudinit.cloudr cloudinit.configrcloudinit.config.schemar cloudinit.gpgrcloudinit.settingsr getLogger__name__rXr\rrrrrr*__annotations__rrrhrgrBr,r/r+r.rrr4rrHrMrEr|rrDrrrerrrrrcboolrrrr rdrQr1r`rrlrZrarmr~r>rrrrr[rfr0r~rLr5r3rs1   00@@!#.+ !#'/1G7 4wsCx0 (#! j ! : : +34 66 6"K #$,-L"M  C//6/%/t//&%. b @ $F$I2$    ,S,^%c%PS(9cd4*-H 0T#s(^0fD,N"  @D (>BU p8&$GT &R%0&40H>  U r"r5