~gpSSKrSSKrSSKrSSKJr SSKJr SSKJrJ r SSK r Sr SSK r Sr"SS5rg!\ a Sr Nf=f!\ a SrN#f=f) N)getpass)_sos) is_executableTIMEOUT_DEFAULTTFc\rSrSrSrSrSrSrSrSr Sr Sr Sr Sr SrSrSrSrSrS rSrSrSrSrSrSrSrSrSrSr0S S _S S _S S _S/_SS_SS_SS_SS_SS_SS _SS_SS_SS_SS_SS_SS_SS_SS0ErSBSjrSr S r!\"S!5r#S"r$S#r%S$r&S%r'S&r(S'r)S(r*S)r+S*r,S+r-S,r.SCS-jr/S.r0S/r1S0r2S1r3S2r4S3r5S4r6S5r7S6r8S7r9S8r:SCS9jr;S:rSDS=jr?S>r@SES?jrASFS@jrBSArCg)G UploadTarget z This class is designed to upload files to a distribution defined location. These files can be either sos reports, sos collections, or other kind of files like: vmcores, application cores, logs, etc. z Upload a file (can be an sos report, a must-gather, or others) to a distribution defined remote location zGeneric UploadgenericN/zhttps://s3.amazonaws.com upload_filecase_id low_priorityFprofiles upload_urlupload_directory upload_user upload_pass upload_methodautoupload_no_ssl_verifyupload_protocolupload_s3_endpointupload_s3_regionupload_s3_bucketupload_s3_access_keyupload_s3_secret_keyupload_s3_object_prefix upload_targetc^[R"S5UlXlX0lX lg)Nsos_ui)logging getLoggerui_logparsercmdlineargs)selfr%r'r&s =/usr/lib/python3/dist-packages/sos/upload/targets/__init__.py__init__UploadTarget.__init__as#''1    cg)a3This should be overridden by upload targets This is called by sos upload on each target type that exists, and is meant to return True when the upload target matches a criteria that indicates that is the local upload target that should be used. Only the first upload target to determine a match is selectedFr(s r)check_distributionUploadTarget.check_distributionhsr,cUR$)N)upload_target_idr/s r) get_target_idUploadTarget.get_target_idrs$$$r,cpUR(a UR$URR5$)z-Returns the upload target's name as a string.)upload_target_name__name__lower)clss r)nameUploadTarget.nameus,  ! !)) )||!!##r,cURSURSURSRURSRS.$)N cmdlineoptspolicy)r>r?rr) hook_commonsrrr/s r) get_commonsUploadTarget.get_commons|sP,,];''1((7?? $ 1 1- @     r,cXlg)z9Set common host data for the Upload targets to reference N)commons)r(rDs r) set_commonsUploadTarget.set_commonss  r,cXlUR5UlURSnURSnUR(aUR 5 UR UlUR UlURUlURUl SUl URUl URUl URUl URUlURUlUR UlUR"(dUR$(dUR'5(a1UR(S:Xd!UR+5 UR-5 OPUR(S:Xa@UR/5 UR15 UR35 UR55 UR6R9S5 ggg)Nr>r?r s3)r@rArDr_configure_low_priorityrrrrupload_passwordupload_archive_namerrrrrrbatchquietget_upload_urlrprompt_for_upload_userprompt_for_upload_passwordprompt_for_upload_s3_bucketprompt_for_upload_s3_endpointprompt_for_upload_s3_access_keyprompt_for_upload_s3_secret_keyr$info)r(r@ cmdline_optsr?s r)pre_workUploadTarget.pre_works('') ||M2 h'  $ $  * * , '11'33 , = =+77#% "."A"A , = =$0$E$E! , = ='3'K'K$$0$E$E!!!""""$$$44<++-//1--5002224446446 KK  R #"r,cUR5(d?SUR5SUR5S3n[[ U55Ulgg)zeShould be overridden by targets to determine if an access key needs to be provided for upload or not z0Please provide the upload access key for bucket  via endpoint : N)get_upload_s3_access_keyget_upload_s3_bucketget_upload_s3_endpointinput_rr(msgs r)rS,UploadTarget.prompt_for_upload_s3_access_keys^,,..--/01//12"6  ).af D %/r,cUR5(d6SUR5SUR5S3n[U5Ulgg)zdShould be overridden by targets to determine if a secret key needs to be provided for upload or not z0Please provide the upload secret key for bucket rZr[N)get_upload_s3_secret_keyr]r^rrras r)rT,UploadTarget.prompt_for_upload_s3_secret_keysZ,,..--/01//12"6  )0 D % /r,c2UR(d{UR(a@URRS5(a URSSUlUR$[[ S55nUR S5UlUR$)z`Should be overridden by targets to determine if a bucket needs to be provided for upload or not s3://Nz"Please provide the upload bucket: r )rr startswithr_r`strip)r( user_inputs r)rQ(UploadTarget.prompt_for_upload_s3_bucketsz$$4??#=#=g#F#F(,(;%$$$#1%I#JK (2(8(8(=%$$$r,cURnUR(d;SUR5SUS3n[[ U55nU=(d UUlUR$)zcShould be overridden by targets to determine if an endpoint needs to be provided for upload or not z.Please provide the upload endpoint for bucket z (default: z): )_upload_s3_endpointrr]r_r`)r(default_endpointrbrls r)rR*UploadTarget.prompt_for_upload_s3_endpointsk 33&&--/0./s4  qvJ&0&D4DD #&&&r,cUR5(d.SUR5S3n[[U55Ulgg)zSShould be overridden by targets to determine if a user needs to be provided or not zPlease provide upload user for r[N)get_upload_userrNr_r`rras r)rO#UploadTarget.prompt_for_upload_users@##%%3D4G4G4I3J"MC$QsV}D &r,cUR5(dDUR5UR:wa%SUR5S3n[U5Ulggg)zbShould be overridden by targets to determine if a password needs to be provided for upload or not z'Please provide the upload password for r[N)get_upload_passwordrs _upload_userrrJras r)rP'UploadTarget.prompt_for_upload_passwords]''))t/C/C/E/3/@/@0A<**,-R1C#*3z://z#Must provide protocol in upload URLz&Unsupported or unrecognized protocol: ) upload_ftp upload_sftp upload_https upload_s3rDrrrzsplit)r(protsprotr`s r)r{#UploadTarget._determine_upload_type3s??$$&&..   << & 6 6% ?m4DDE E  'AB B//''.  DTFKL L{r,cU(dUR5nU(dUR5n[RR X5$)a0Formats the user/password credentials using basic auth :param user: The username for upload :type user: ``str`` :param password: Password for `user` to use for upload :type password: ``str`` :returns: The user/password auth suitable for use in requests calls :rtype: ``requests.auth.HTTPBasicAuth()`` )rsrvrequestsauth HTTPBasicAuth)r(userpasswords r)get_upload_https_auth"UploadTarget.get_upload_https_authIs;'')D//1H}}**4::r,c|[R"SS5=(d UR=(d UR$)zHelper function to determine if we should use the target default upload access key or one provided by the user :returns: The access_key to use for upload :rtype: ``str`` SOSUPLOADS3ACCESSKEYN)osgetenvr_upload_s3_access_keyr/s r)r\%UploadTarget.get_upload_s3_access_key\4 0$7+))+** ,r,c\UR(dUR5 UR$)zHelper function to determine if we should use the target default upload endpoint or one provided by the user :returns: The S3 Endpoint to use for upload :rtype: ``str`` )rrRr/s r)r^#UploadTarget.get_upload_s3_endpointgs%&&  . . 0&&&r,c@UR=(d UR$)zHelper function to determine if we should use the target default upload region or one provided by the user :returns: The S3 region to use for upload :rtype: ``str`` )r_upload_s3_regionr/s r)get_upload_s3_region!UploadTarget.get_upload_s3_regionrs$$>(>(>>r,chUR(abURRS5(aBURSSRSS5nUSUl[ U5S:a USUlUR(dUR 5 UR=(d UR$)zHelper function to determine if we should use the target default upload bucket or one provided by the user :returns: The S3 bucket to use for upload :rtype: ``str`` rhriNr r)rrjrrlenrrQ_upload_s3_bucket)r(bucket_and_prefixs r)r]!UploadTarget.get_upload_s3_bucket{s ??t99'BB $ 3 9 9#q A $5a$8D !$%)/@/C,$$  , , .$$>(>(>>r,c@UR=(d UR$)zHelper function to determine if we should use the target default upload object prefix or one provided by the user :returns: The S3 object prefix to use for upload :rtype: ``str`` )r_upload_s3_object_prefixr/s r)get_upload_s3_object_prefix(UploadTarget.get_upload_s3_object_prefixs++Lt/L/LLr,c|[R"SS5=(d UR=(d UR$)zHelper function to determine if we should use the target default upload secret key or one provided by the user :returns: The S3 secret key to use for upload :rtype: ``str`` SOSUPLOADS3SECRETKEYN)rrr_upload_s3_secret_keyr/s r)re%UploadTarget.get_upload_s3_secret_keyrr,c"UR(d`UR(aOUR(a>UR(a-UR 5nUR 5nSUSU3UlUR=(d UR $)zHelper function to determine if we should use the target default upload url or one provided by the user :returns: The URL to use for upload :rtype: ``str`` rhr )rrrrr]r _upload_url)r(bucketprefixs r)rNUploadTarget.get_upload_urlsl  ! !  % %  % %..0F557F!&vhax8D 2$"2"22r,c:Sn[R"USU5nU$)Nz([^:]+://[^:]+:)([^@]+)(@.+)z \1********\3)resub)r(urlpatternobfuscated_urls r)_get_obfuscated_upload_url'UploadTarget._get_obfuscated_upload_urls1#>r,c@URUR55$)zUsed by upload targets to potentially change the string used to report upload location from the URL to a more human-friendly string )rrNr/s r)r|"UploadTarget.get_upload_url_strings..t/B/B/DEEr,c|[R"SS5=(d UR=(d UR$)zHelper function to determine if we should use the target default upload user or one provided by the user :returns: The username to use for upload :rtype: ``str`` SOSUPLOADUSERN)rrrrwr/s r)rsUploadTarget.get_upload_users3 /40"  "!! #r,c|[R"SS5=(d UR=(d UR$)a/Helper function to determine if we should use the target default upload password or one provided by the user A user provided password, either via option or the 'SOSUPLOADPASSWORD' environment variable will have precendent over any target value :returns: The password to use for upload :rtype: ``str`` SOSUPLOADPASSWORDN)rrrJ_upload_passwordr/s r)rv UploadTarget.get_upload_passwords4 -t4&$$&%% 'r,ch[S5(d [S5eSSKnSnU(dUR 5nU(dUR 5nUR 5RSS5nS US U3nURUS S 9nS SSURUR/n URU SS9n U S:XaSnOU S:XarURU5 S SURUR/n URU SS9S:HnU(d,UR5 [SUR535eOcU S:Xa[SUR5S35eU S:Xa[SUR535eU S:Xa[SUR35eU(d,UR5 [SUR535eSUR S UR#53n URU 5 S!URURS"/n URU S#S9nUS:XaURS$5 gUS:Xa [S%5eUS:Xa[S&UR35eUS:Xa [S'5e[S(UR35e![an[S5UeSnAff=f))a}Attempts to upload the archive to an SFTP location. Due to the lack of well maintained, secure, and generally widespread python libraries for SFTP, sos will shell-out to the system's local ssh installation in order to handle these uploads. Do not override this method with one that uses python-paramiko, as the upstream sos team will reject any PR that includes that dependency. rzSFTP is not locally supportedrNzFSFTP upload requires python3-pexpect, which is not currently installedFzsftp://r z sftp -oStrictHostKeyChecking=no @zutf-8)encodingzsftp>z password:zConnection refusedtimeoutTrzPermission denied z#Incorrect username or password for zConnection refused by z. Incorrect port?z!Timeout hit trying to connect to z,Unexpected error trying to connect to sftp: zUnable to connect via SFTP to zput  z100%zNo such file or directorybyezTimeout expired while uploadingzUnknown error during upload: z&Unable to write archive to destinationz!Unexpected response from server: )rrzpexpect ImportErrorrsrvrNreplacespawnTIMEOUTEOFexpectsendlinecloser|beforerK_get_sftp_upload_name)r(rrrerrsftp_connectedsftp_urlsftp_cmdret sftp_expectsidx pass_expectsput_cmd put_expects put_successs r)rUploadTarget.upload_sftpsV$$;< <  @  '')D//1H&&(00B?5dV1XJGmmHwm7   OO KK  jjrj2 !8!N AX LL "# L !ZZ bZAQFN!  E#'#=#=#?"@!BCC"AX4#99;<? ? AXJ"zzl,- - IIK<#99;<>? ?$223100235 W  OO KK '  jjcj: !  LL  ! => > ! ;CJJ<HI I ! DE E;CJJ<HII] @67E r,cr[R"UR5UUR5U[S9$)zIf upload_https() needs to use requests.put(), use this method. Targets should override this method instead of the base upload_https() :param archive: The open archive file object )datarverifyr)rputrNrr)r(r}rs r)_upload_https_putUploadTarget._upload_https_putDs5||D//1!%!;!;!=#)?D Dr,c0$)zJDefine any needed headers to be passed with the POST request here r.r/s r)_get_upload_headers UploadTarget._get_upload_headersOs  r,cSURRS5SUUR540n[R"UR 5UUR 5U[S9$)zIf upload_https() needs to use requests.post(), use this method. Targets should override this method instead of the base upload_https() :param archive: The open archive file object filer r)filesrrr)r;rrrpostrNrr)r(r}rrs r)_upload_https_postUploadTarget._upload_https_postTsj W\\'',R0'--/1 }}T002%"&"<"<">$*OE Er,c@[(d [S5e[URS5nURSR S:Xa UR nOURSR nURSRSLnUS:XaURX5nOURX5nURS;a@URS:Xa [S 5e[S URS UR35eS S S 5 g !,(df  g =f)zAttempts to upload the archive to an HTTPS location. :returns: ``True`` if upload is successful :rtype: ``bool`` :raises: ``Exception`` if upload was unsuccessful z7Unable to upload due to missing python requests libraryrbr>rFr)iz/Authentication failed: invalid user credentialszPOST request returned r[NT) REQUESTS_LOADEDrzopenrKrDr_upload_methodrrr status_codereason)r(arcmethodrrs r)rUploadTarget.upload_httpscs&' '$**D 1S||M*88FB,,m4BB\\-0EENF**37++C8}}J.==C'#I "8r#$88*!.//#2 1 1s CD DcSSKnSSKnU(dUR5nUc [S5eUR SS5nU(dUR 5nU(dUR 5nU(dUR=(d URnURXUSS9nU(d [S5eURU5 [!UR"S5n UR%SUR"RS5S3U 5 SSS5 UR'5 g!URan[S U35UeSnAfURan[S U35UeSnAfURazn[U5R5Sn U S :Xa[S US 35UeU S:Xa[SUS 35UeU S:Xa[SU35Ue[S[U535UeSnAff=f!,(df  N=f)aAttempts to upload the archive to either the target defined or user provided FTP location. :param url: The URL to upload to :type url: ``str`` :param directory: The directory on the FTP server to write to :type directory: ``str`` or ``None`` :param user: The user to authenticate with :type user: ``str`` :param password: The password to use for `user` :type password: ``str`` :returns: ``True`` if upload is successful :rtype: ``bool`` :raises: ``Exception`` if upload in unsuccessful rNzPno FTP server specified by upload target, use --upload-url to specify a locationzftp://r rrz3connection failed, did you set a user and password?z timeout hit while connecting to zunable to connect to 503zcould not login as ''530zinvalid password for user '550z"could not set upload directory to z#error trying to establish session: rzSTOR r rT)ftplibsocketrNrzrrsrvr_upload_directoryFTPcwdrgaierror error_permstrrrrK storbinaryquit) r(r directoryrrrrsessionrerrno_arcfiles r)rUploadTarget.upload_ftps * %%'C ;EF Fkk(B''')D//1H--G1G1GI jjHbjAG!,-- KK ""$**D 1X   0066s;B?@A8 2  +~~ O>seDE3 N D3C59: C  HNN$Q'E~"6tfA >?SH~"=dV1 EFCO~ D#,+!/0589A#c(LM  2 1s=4D*2G;*G8:E  G8E++G8>A5G33G8; H c[(d [S5eU(dUR5nU(dUR5nU(dUR 5R S5nU(d[UR 5nUS:waURS5(aUSSnUS:wa$URS5(dU(aUS3OSnU(dUR5nU(dUR5n[R"SUUUUS9nX@RRS5S-nURURX85 g ![an [S [!U 535U eSn A ff=f) a5Attempts to upload the archive to an S3 bucket. :param endpoint: The S3 endpoint to upload to :type endpoint: str :param region: The S3 region to upload to :type region: str :param bucket: The name of the S3 bucket to upload to :type bucket: str :param prefix: The prefix for the S3 object/key :type prefix: str :param access_key: The access key for the S3 bucket :type access_key: str :param secret_key: The secret key for the S3 bucket :type secret_key: str :returns: True if upload is successful :rtype: bool :raises: Exception if upload is unsuccessful z4Unable to upload due to missing python boto3 libraryr r rNrH) endpoint_url region_nameaws_access_key_idaws_secret_access_keyrTzFailed to upload to S3: ) BOTO3_LOADEDrzr^rr]rkrrjendswithr\reboto3clientrKrr r) r(endpointregionrr access_key secret_key s3_clientkeyes r)rUploadTarget.upload_s3s[6|&' '224H..0F..066s;F557F| 1 1# 6 6|FOOC$8$8)/F81R668J668JLLH-33=7AC  H3399#>rBBC  ! !$":":"( / H6s1vh?@a G HsDLIM.2?Hr,r)rrr"rsosrr` sos.utilitiesrrrrrr'r%rr.r,r)r<sl 8OL g Hg HO Ls :AAAAA