Of- J S r SSKrSSK7 SSK7 \R " S5 r\R " S5 r\R " S5 r\R " S5 r\R " S5 r \R " S 5 r
\R " S
5 r " S S 5 r " S
S\
5 rg)a
CorpusReader for the Comparative Sentence Dataset.
- Comparative Sentence Dataset information -
Annotated by: Nitin Jindal and Bing Liu, 2006.
Department of Computer Sicence
University of Illinois at Chicago
Contact: Nitin Jindal, njindal@cs.uic.edu
Bing Liu, liub@cs.uic.edu (https://www.cs.uic.edu/~liub)
Distributed with permission.
Related papers:
- Nitin Jindal and Bing Liu. "Identifying Comparative Sentences in Text Documents".
Proceedings of the ACM SIGIR International Conference on Information Retrieval
(SIGIR-06), 2006.
- Nitin Jindal and Bing Liu. "Mining Comprative Sentences and Relations".
Proceedings of Twenty First National Conference on Artificial Intelligence
(AAAI-2006), 2006.
- Murthy Ganapathibhotla and Bing Liu. "Mining Opinions in Comparative Sentences".
Proceedings of the 22nd International Conference on Computational Linguistics
(Coling-2008), Manchester, 18-22 August, 2008.
N)*z^\*+$z z z
zz (\d)_((?:[\.\w\s/-](?!\d_))+)z
\(([^\(]*)\)$c 4 \ rS rSrSr SS jrS rSrg)
Comparison3 zF
A Comparison represents a comparative sentence and its constituents.
Nc L Xl X l X0l X@l XPl X`l g)a
:param text: a string (optionally tokenized) containing a comparison.
:param comp_type: an integer defining the type of comparison expressed.
Values can be: 1 (Non-equal gradable), 2 (Equative), 3 (Superlative),
4 (Non-gradable).
:param entity_1: the first entity considered in the comparison relation.
:param entity_2: the second entity considered in the comparison relation.
:param feature: the feature considered in the comparison relation.
:param keyword: the word or phrase which is used for that comparative relation.
N)text comp_typeentity_1entity_2featurekeyword)selfr r r
r r r
s F/usr/lib/python3/dist-packages/nltk/corpus/reader/comparative_sents.py__init__Comparison.__init__8 s" & "
c SR U R U R U R U R U R
U R 5 $ )Nz]Comparison(text="{}", comp_type={}, entity_1="{}", entity_2="{}", feature="{}", keyword="{}"))formatr r r
r r r
)r s r __repr__Comparison.__repr__R s@
*
& II NN MM MM LL LL
r )r r
r r r
r )NNNNNN)__name__
__module__ __qualname____firstlineno____doc__r r __static_attributes__ r r r r 3 s% 4
r r c | \ rS rSrSr\r\" 5 SS4S jrSS jr SS jr
S r SS jr SS
jr
S rS rS
rS rSrg) ComparativeSentencesCorpusReader` aO
Reader for the Comparative Sentence Dataset by Jindal and Liu (2006).
>>> from nltk.corpus import comparative_sentences
>>> comparison = comparative_sentences.comparisons()[0]
>>> comparison.text # doctest: +NORMALIZE_WHITESPACE
['its', 'fast-forward', 'and', 'rewind', 'work', 'much', 'more', 'smoothly',
'and', 'consistently', 'than', 'those', 'of', 'other', 'models', 'i', "'ve",
'had', '.']
>>> comparison.entity_2
'models'
>>> (comparison.feature, comparison.keyword)
('rewind', 'more')
>>> len(comparative_sentences.comparisons())
853
Nutf8c V [ R XX%5 X0l X@l SU l g)a~
:param root: The root directory for this corpus.
:param fileids: a list or regexp specifying the fileids in this corpus.
:param word_tokenizer: tokenizer for breaking sentences or paragraphs
into words. Default: `WhitespaceTokenizer`
:param sent_tokenizer: tokenizer for breaking paragraphs into sentences.
:param encoding: the encoding that should be used to read the corpus.
z
README.txtN) CorpusReaderr _word_tokenizer_sent_tokenizer_readme)r rootfileidsword_tokenizersent_tokenizerencodings r r )ComparativeSentencesCorpusReader.__init__t s' " d'< - - # r c
Uc
U R nO[ U[ 5 ( a U/n[ U R USS5 VVVs/ s H u p#nU R X R US9PM" snnn5 $ s snnnf )z
Return all comparisons in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
comparisons have to be returned.
:return: the given file(s) as a list of Comparison objects.
:rtype: list(Comparison)
Tr+ )_fileids
isinstancestrconcatabspaths
CorpusView_read_comparison_blockr r( pathencfileids r comparisons,ComparativeSentencesCorpusReader.comparisons sz ?mmG
%
% iG ,0==$+M
+M'T &A&ACP+M
s 'A5 c
[ U R USS5 VVVs/ s H u p#nU R X R US9PM" snnn5 nU Vs1 s H of( d M UR 5 iM nnU$ s snnnf s snf )z
Return a set of all keywords used in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
keywords have to be returned.
:return: the set of keywords and comparative phrases used in the corpus.
:rtype: set(str)
Tr. )r2 r3 r4 _read_keyword_blocklower)r r( r7 r8 r9 all_keywordsr
keywords_sets r keywords)ComparativeSentencesCorpusReader.keywords s ,0==$+M
+M'T &>&>M+M
8DO|Gw
| O
Ps 'A7
A> A>c , / nU R S5 nUR 5 nSSS5 WR S5 HA nU( a UR S5 ( a M" UR UR 5 5 MC U$ ! , ( d f Nf= f)zj
Return the list of words and constituents considered as clues of a
comparison (from listOfkeywords.txt).
zlistOfkeywords.txtN
z//)openreadsplit
startswithappendstrip)r rA fpraw_textlines r keywords_readme0ComparativeSentencesCorpusReader.keywords_readme sq
YY+
,wwyH - NN4(D4??400 OODJJL ) )
-
,s B
Bc
[ U R USS5 VVVs/ s H u p#nU R X R US9PM" snnn5 $ s snnnf )a+
Return all sentences in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
sentences have to be returned.
:return: all sentences of the corpus as lists of tokens (or as plain
strings, if no word tokenizer is specified).
:rtype: list(list(str)) or list(str)
Tr. )r2 r3 r4 _read_sent_blockr6 s r sents&ComparativeSentencesCorpusReader.sents sX ,0==$+M
+M'T &;&;cJ+M
'A
c
[ U R USS5 VVVs/ s H u p#nU R X R US9PM" snnn5 $ s snnnf )z
Return all words and punctuation symbols in the corpus.
:param fileids: a list or regexp specifying the ids of the files whose
words have to be returned.
:return: the given file(s) as a list of words and punctuation symbols.
:rtype: list(str)
Tr. )r2 r3 r4 _read_word_blockr6 s r words&ComparativeSentencesCorpusReader.words sX ,0==$+M
+M'T &;&;cJ+M
rT c | UR 5 nU( d / $ [ R " [ U5 nU( Ga [ R " [ U5 n[ R " [
U5 nUR 5 R
5 nU R ( a U R R U5 nUR 5 / nU( Ga U GH n[ [ R " SU5 R S5 5 n [ XiS9n
UR 5 n[ R U5 n U ( ab U H\ u pU S:X a U
R
5 U
l M" U S:X a U
R
5 U
l M? U S:X d MG U
R
5 U
l M^ [" R U5 nU( a
US U
l UR' U
5 GM U( aR U HL n[ [ R " SU5 R S5 5 n [ XiS9n
UR' U
5 MN U$ GM< )Nz )r r 123r )readlinerefindall
COMPARISONGRAD_COMPARISONNON_GRAD_COMPARISONrJ r$ tokenizeintmatchgroupr ENTITIES_FEATSr
r r KEYWORDr
rI )r streamrM comparison_tagsgrad_comparisonsnon_grad_comparisonscomparison_textcomparison_bundlecompr
comparisonentities_featscode entity_featr
s r r5 7ComparativeSentencesCorpusReader._read_comparison_block s ??$D jjT :O #%::ot#D ')zz2Et'L$"(//"3"9"9";''&*&:&:&C&CO&TO! %'!# 0$' t(D(J(J1(M$N %/!0&
& 0)7)?)?)E)5C 1#'3;:E:K:K:MJ$7%)S[:E:K:K:MJ$7%)S[9D9J9J9LJ$6
6D #*//$"7"18J .)00<% !1* ( 4$' t(D(J(J1(M$N %/!0&
*00<
!5 )(e r c p / nU R U5 H nUR UR 5 M U$ N)r5 rI r
)r rj rA rq s r r= 4ComparativeSentencesCorpusReader._read_keyword_block s3 55f=J OOJ . . / >r c x UR 5 n[ R " [ U5 ( a6 UR 5 n[ R " [ U5 ( a OM3 Mg [ R " [
U5 ( d [ R U5 ( d [ R " [ U5 ( dr U R ( aE U R R U5 Vs/ s H nU R R U5 PM sn$ U R R U5 /$ GM5 s snf rw ) r^ r_ rf STARSr` ra rh CLOSE_COMPARISONr% rd r$ )r rj rM sents r rQ 1ComparativeSentencesCorpusReader._read_sent_block s ??$Dxxt$$!??,Dxxt,, JJz400&..t44
#3T::'' %)$8$8$A$A$$G $GD ,,55d;$G
! 0 0 9 9$ ?@@' s 0%D7c \ / nU R U5 H nUR U5 M U$ rw )rQ extend)r rj rW r| s r rV 1ComparativeSentencesCorpusReader._read_word_block1 s- ))&1D LL 2 r )r& r% r$ rw )r r r r r StreamBackedCorpusViewr4 WhitespaceTokenizerr r: rA rN rR rW r5 r= rQ rV r r r r r r ` sP " (J +,
$,
( &
"
3)j A,r r )r r_ nltk.corpus.reader.api
nltk.tokenizecompilerz ra r{ rb rc rh ri r r# r r r r r s 8
$
8
ZZ
'
::o. **]+jj+ <=
**%
&*
*
ZU| Ur