Of$SrSSKrSSK7 SSK7 SSKJr SSKJr \RS5r \RS5r \RS5r \RS 5r "S S \5r"S S \\5r"SS\5rg)zO Corpus reader for corpora that consist of parenthesis-delineated parse trees. N)*)map_tag)Treez\((\d+) ([^\s()]+) ([^\s()]+)\)z\(([^\s()]+) ([^\s()]+)\)z\([^\s()]+ ([^\s()]+)\)z \s*\(\s*\(cL\rSrSrSrS SjrSrSrSrS Sjr S r S r g) BracketParseCorpusReaderz Reader for corpora that consist of parenthesis-delineated parse trees, like those found in the "combined" section of the Penn Treebank, e.g. "(S (NP (DT the) (JJ little) (NN dog)) (VP (VBD barked)))". NcT[RXX%5 X0lX@lX`lg)ag :param root: The root directory for this corpus. :param fileids: A list or regexp specifying the fileids in this corpus. :param comment_char: The character which can appear at the start of a line to indicate that the rest of the line is a comment. :param detect_blocks: The method that is used to find blocks in the corpus; can be 'unindented_paren' (every unindented parenthesis starts a new parse) or 'sexpr' (brackets are matched). :param tagset: The name of the tagset used by this corpus, to be used for normalizing or converting the POS tags returned by the ``tagged_...()`` methods. N)SyntaxCorpusReader__init__ _comment_char_detect_blocks_tagset)selfrootfileids comment_char detect_blocksencodingtagsets B/usr/lib/python3/dist-packages/nltk/corpus/reader/bracket_parse.pyr !BracketParseCorpusReader.__init__"s%, ##DB)+ c ~URS:Xa[XRS9$URS:Xa [U5$URS:Xad[ USS9nUR(aGUVs/sH:n[ R S[ RUR5-SU5PM< nnU$S 5es snf) Nsexpr)r blanklineunindented_parenz^\()start_rez (?m)^%s.*zbad block type)r read_sexpr_blockr read_blankline_blockread_regexp_blockresubescape)rstreamtokstoks r _read_block$BracketParseCorpusReader._read_block=s   ' )#F9K9KL L  K /'/ /  $6 6$Vf=D!! $#FF;43E3E)FFCP#K && &1 s.AB:cb[RSSU5n[RSSU5nU$)Nz\((.)\)z(\1 \1)z"\(([^\s()]+) ([^\s()]+) [^\s()]+\)(\1 \2)r"r#rts r _normalize#BracketParseCorpusReader._normalizeOs, FF:z1 - FF8*a Hrc ~[R"URU55nUR5S:Xa[ U5S:XaUS$U$![ an[ RRS5 URS:Xan[SS5H^n[URUSU--55n[ RRSU-5 Us sSnA$![ a M\f=f [ RRS 5 [S URU55sSnA$SnAff=f) Nrrz(Bad tree detected; trying to recover... )zmismatched parens)z( Recovered by adding %d close paren(s) z' Recovered by returning a flat parse. S) r fromstringr/labellen ValueErrorsysstderrwriteargsrange_tag)rr.treeenvs r_parseBracketParseCorpusReader._parseVs +??4??1#56Dzz|r!c$i1nAw  + JJ  H Ivv//q!A S1W!=> ((JQN !%% JJ  G HTYYq\* *! +sOA AA D<>D7AC%D7D<% C3/D72C33>D71D<7D<c [RURU55VVs/sHup4XC4PM nnnU(a;X R:wa,UVVs/sHupCU[ URX#54PM nnnU$s snnfs snnfN)TAGWORDfindallr/rr)rr.rpw tagged_sents rr?BracketParseCorpusReader._tagqs{,3OODOOA$BcJ[RURU55$rG)WORDrIr/r-s r_wordBracketParseCorpusReader._wordys||DOOA.//r)r r r)Nrutf8NrG) __name__ __module__ __qualname____firstlineno____doc__r r(r/rDr?rP__static_attributes__rrrrs3(6'$+60rrc^\rSrSrSrSrS U4SjjrS U4SjjrS U4SjjrS U4Sjjr S U4Sjjr S U4S jjr S r U=r $) #CategorizedBracketParseCorpusReader}z A reader for parsed corpora whose documents are divided into categories based on their file identifiers. @author: Nathan Schneider cb[RX5 [R"U/UQ70UD6 g)a< Initialize the corpus reader. Categorization arguments (C{cat_pattern}, C{cat_map}, and C{cat_file}) are passed to the L{CategorizedCorpusReader constructor }. The remaining arguments are passed to the L{BracketParseCorpusReader constructor }. N)CategorizedCorpusReaderr r)rr=kwargss rr ,CategorizedBracketParseCorpusReader.__init__s* ((6 ))$@@@rcB>[TU]URX5U5$rG)super tagged_words_resolverr categoriesr __class__s rrc0CategorizedBracketParseCorpusReader.tagged_wordsw#DMM'$FOOrcB>[TU]URX5U5$rG)rb tagged_sentsrdres rrk0CategorizedBracketParseCorpusReader.tagged_sentsrircB>[TU]URX5U5$rG)rb tagged_parasrdres rrn0CategorizedBracketParseCorpusReader.tagged_parasrirc@>[TU]URX55$rG)rb parsed_wordsrdrrrfrgs rrq0CategorizedBracketParseCorpusReader.parsed_wordsw#DMM'$FGGrc@>[TU]URX55$rG)rb parsed_sentsrdrrs rrv0CategorizedBracketParseCorpusReader.parsed_sentsrtrc@>[TU]URX55$rG)rb parsed_parasrdrrs rry0CategorizedBracketParseCorpusReader.parsed_parasrtrrY)NNN)NN)rSrTrUrVrWr rcrkrnrqrvryrX __classcell__)rgs@rr[r[}s8 APPPHHHHrr[c<\rSrSrSrS SjrS SjrS SjrSrSr g) AlpinoCorpusReadera Reader for the Alpino Dutch Treebank. This corpus has a lexical breakdown structure embedded, as read by `_parse` Unfortunately this puts punctuation and some other words out of the sentence order in the xml element tree. This is no good for `tag_` and `word_` `_tag` and `_word` will be overridden to use a non-default new parameter 'ordered' to the overridden _normalize function. The _parse function can then remain untouched. Nc 4[RUUSSUUS9 g)Nz alpino\.xmlr)rrr)rr )rrrrs rr AlpinoCorpusReader.__init__s' ))   % * rc>USSS:wag[RSSU5nU(a[RSSU5nO[RS S U5n[RS S U5n[RS SU5n[RSSU5nU$)a=Normalize the xml sentence element in t. The sentence elements , although embedded in a few overall xml elements, are separated by blank lines. That's how the reader can deliver them one at a time. Each sentence has a few category subnodes that are of no use to us. The remaining word nodes may or may not appear in the proper order. Each word node has attributes, among which: - begin : the position of the word in the sentence - pos : Part of Speech: the Tag - word : the actual word The return value is a string with all xml elementes replaced by clauses: either a cat clause with nested clauses, or a word clause. The order of the bracket clauses closely follows the xml. If ordered == True, the word clauses include an order sequence number. If ordered == False, the word clauses only have pos and word parts. N z z(\1z> z (\1 \2 \3)z- r+z r4z.*zr,)rr.ordereds rr/AlpinoCorpusReader._normalizes" Sb6\ ! FF0&! < QA GUVWA FF<q ) FF-sA 6 FF%sA .rc [RURUSS95VVVs/sHup4n[U5XT4PM nnnnUR 5 U(a?X R :wa0UVVVs/sHup5oE[ UR X$54PM nnnnU$UVVVs/sH up5oEU4PM nnnnU$s snnnfs snnnfs snnnf)NT)r) SORTTAGWRDrIr/intsortrr)rr.rorJrKrLs rr?AlpinoCorpusReader._tags(//40PQ Q qVQNQ    f ,GRGR)1GDLL&45{  4??;iqQq6;K? @sB82$B?"Cc^URU5nUVVs/sHup4UPM snn$s snnf)z(Return a correctly ordered list if words)r?)rr.rLrKrJs rrPAlpinoCorpusReader._words)iil +, fq ,,,s)rY)z ISO-8859-1N)FrG) rSrTrUrVrWr r/r?rPrXrYrrr}r}s  D -rr})rWr:nltk.corpus.reader.apinltk.corpus.reader.utilnltk.tagr nltk.treerr"compilerrHrOEMPTY_BRACKETSr rr^r[r}rYrrrs $%ZZ: ; **1 2 zz,-M*`01`0F%H5%HPH-1H-r