Of,~SrSrSSK7 SSKJrJr SSKJr "SS\5rSS jr "S S \ 5r "S S \5r g)z& Corpus reader for the SemCor Corpus. z epytext en)*)XMLCorpusReader XMLCorpusView)Treec\rSrSrSrSSjrSSjrSSjrSS4SjrSS jr SS jr SS4S jr S r S r \S5rSrg)SemcorCorpusReaderz Corpus reader for the SemCor Corpus. For access to the complete XML data structure, use the ``xml()`` method. For access to simple word lists and tagged word lists, use ``words()``, ``sents()``, ``tagged_words()``, and ``tagged_sents()``. cJ[R"XU5 X@lX0lgN)r__init___lazy_wordnet)selfrootfileidswordnetlazys ;/usr/lib/python3/dist-packages/nltk/corpus/reader/semcor.pyr SemcorCorpusReader.__init__s  W5  Nc,URUSSSS5$)zZ :return: the given file(s) as a list of words and punctuation symbols. :rtype: list(str) wordF_itemsrrs rwordsSemcorCorpusReader.words s {{7FE5%@@rc,URUSSSS5$)z :return: the given file(s) as a list of chunks, each of which is a list of words and punctuation symbols that form a unit. :rtype: list(list(str)) chunkFrrs rchunksSemcorCorpusReader.chunks's{{7GUE5AArposc8URUSSUS:gUS:g5$)a :return: the given file(s) as a list of tagged chunks, represented in tree form. :rtype: list(Tree) :param tag: `'pos'` (part of speech), `'sem'` (semantic), or `'both'` to indicate the kind of tags to include. Semantic tags consist of WordNet lemma IDs, plus an `'NE'` node if the chunk is a named entity without a specific entry in WordNet. (Named entities of type 'other' have no lemma. Other chunks not in WordNet have no semantic tag. Punctuation tokens have `None` for their part of speech tag.) rFsemr"rrrtags r tagged_chunks SemcorCorpusReader.tagged_chunks0s#{{7GUC5L#,OOrc,URUSSSS5$)zx :return: the given file(s) as a list of sentences, each encoded as a list of word strings. :rtype: list(list(str)) rTFrrs rsentsSemcorCorpusReader.sents?s {{7FD%??rc,URUSSSS5$)zx :return: the given file(s) as a list of sentences, each encoded as a list of chunks. :rtype: list(list(list(str))) rTFrrs r chunk_sentsSemcorCorpusReader.chunk_sentsGs {{7GT5%@@rc8URUSSUS:gUS:g5$)aC :return: the given file(s) as a list of sentences. Each sentence is represented as a list of tagged chunks (in tree form). :rtype: list(list(Tree)) :param tag: `'pos'` (part of speech), `'sem'` (semantic), or `'both'` to indicate the kind of tags to include. Semantic tags consist of WordNet lemma IDs, plus an `'NE'` node if the chunk is a named entity without a specific entry in WordNet. (Named entities of type 'other' have no lemma. Other chunks not in WordNet have no semantic tag. Punctuation tokens have `None` for their part of speech tag.) rTr$r"rr%s r tagged_sentsSemcorCorpusReader.tagged_sentsOs#{{7GT3%<NNrc ^US:XaU(dU4SjnO#TR(a[O TRn[TR U5Vs/sHnU"XrX4UTR 5PM sn5$s snf)Nrcb>[TR(a[O TR"U65$r )LazyConcatenationr SemcorWordView_words)argsrs r+SemcorCorpusReader._items..bs"/#'::4;;>Fr)r r5r6concatabspathsr)rrunit bracket_sentpos_tagsem_tag_fileids` rrSemcorCorpusReader._items^sm 6>,A#'**$++A#mmG4 4F& w N4    sA7c US;de/n[RU5R5nURS5Hn/n [ U5HNn [ R XXEUR5n US:XaU RU 5 M=U RU 5 MP U(a*UR[URSU 55 MURU 5 M SU;deU$)a Helper used to implement the view methods -- returns a list of tokens, (segmented) words, chunks, or sentences. The tokens and chunks may optionally be tagged (with POS and sense information). :param fileid: The name of the underlying file. :param unit: One of `'token'`, `'word'`, or `'chunk'`. :param bracket_sent: If true, include sentence bracketing. :param pos_tag: Whether to include part-of-speech tags. :param sem_tag: Whether to include semantic tags, namely WordNet lemma and OOV named entity status. )tokenrrz.//srsnumN) ElementTreeparsegetrootfindall_all_xmlwords_inr_wordrextendappendSemcorSentenceattrib) rrAr<r=r>r?resultxmldocxmlsentsentxmlworditms rr6SemcorCorpusReader._wordsns1111""6*224~~f-GD+G4(..7T]]6>KK$KK$5 nW^^F-CTJK d#. 6!!! rcURnU(dSnURSU5nURS5nUb,US-U-nS[URS5S5S- n OS=pURS U5n URS 5n S UR 5;n URS 5n US :Xa2U(d U(dUnU$U4U(aU 4OS-U(aXiX4OS-nU$URS5nUS:XaU$U bUR U5nU(a [X5/OUnU(a-U (a&U b[W[SU5/5$[SU5$U(aU b [WU5$U(aUS$U$![ a4 SUU [U 54-nN![a US-U -S-U -nNf=ff=f)Nlemmalexsn%)nvars:rrdfwnsnpnr"rDr@rz %s.%s.%02d.NE) textgetintsplitkeyslemma_from_key Exception ValueErrorr)rTr<r>r?rtknrYrZ sense_keywnposredefsensenum isOOVEntityr"rUwwsensebottoms rrKSemcorCorpusReader._wordsllC GS) G$   e+I-EKK$Q'(1,E!% $I 3 ;;v&glln, kk   7?7J F!(vb2@Gh+?@@#D&11!5v..!!9$!M;% $0 % % #H 4%E * % e 3c 9H D"s*F GF##F?;G>F??G)r r)Tr )__name__ __module__ __qualname____firstlineno____doc__r rr r'r*r-r0rr6 staticmethodrK__static_attributes__rfrrrrs_ AB%)u P@A$(e O #JJ"J"rrNc~Uc/nUH1nURS;aURU5 M&[X!5 M3 U$)Nwfpunc)r&rMrJ)eltrPchilds rrJrJs= ~ 99 & MM% U +  Mrc\rSrSrSrSrSrg)rNz A list of words, augmented by an attribute ``num`` used to record the sentence identifier (the ``n`` attribute from the XML). c:Xl[RX5 gr )numlistr )rritemss rr SemcorSentence.__init__s d"r)rN)r{r|r}r~rr rrfrrrNrNs  #rrNc0\rSrSrSrSrSrSrSrSr g) r5zF A stream backed corpus view specialized for use with the BNC corpus. cU(aSnOSnX lX0lX@lXPlX`l[ R "XU5 g)aC :param fileid: The name of the underlying file. :param unit: One of `'token'`, `'word'`, or `'chunk'`. :param bracket_sent: If true, include sentence bracketing. :param pos_tag: Whether to include part-of-speech tags. :param sem_tag: Whether to include semantic tags, namely WordNet lemma and OOV named entity status. z.*/sz.*/s/(punc|wf)N)_unit_sent_pos_tag_sem_tagrrr )rrAr<r=r>r?rtagspecs rr SemcorWordView.__init__s: G&G !    tW5rchUR(aURU5$URU5$r )r handle_sent handle_word)rrcontexts r handle_eltSemcorWordView.handle_elts+ ::##C( (##C( (rc[RXRURURUR 5$r )rrKrrrr)rrs rrSemcorWordView.handle_words.!'' T]]DMM4==  rc$/nUHpnURS;aGURU5nURS:XaURU5 MGUR U5 MZ[ SUR-5e [ URSU5$)NrrzUnexpected element %srE)r&rrrLrMrprNrO)rrrSrrUs rrSemcorWordView.handle_sents~EyyN*&&u-::'KK$KK$ !8599!DEEcjj0$77r)rrrrrN) r{r|r}r~rr rrrrrfrrr5r5s6,)  8rr5r ) r __docformat__nltk.corpus.reader.apinltk.corpus.reader.xmldocsrr nltk.treerrrJrrNr5rfrrrsF $EK"K"\#T#18]18r