unimore/bda-6-steffo
unimore/bda-6-steffo
1
Fork 0
mirror of https://github.com/Steffo99/unimore-bda-6.git synced 2024-11-21 15:34:18 +00:00
Code Activity

Fix type annotation of PottsTokenizerWithNegation

Browse source
This commit is contained in:
Steffo 2023-02-13 15:55:45 +01:00
parent d4373f8c02
commit e93a8ddaf7
Signed by: steffo
GPG key ID: 2A24051445686895
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
unimore_bda_6/tokenizer/potts.py
View file

@ -127,7 +127,7 @@ class PottsTokenizerWithNegation(PottsTokenizer):
Version of `.PottsTokenizer` which after tokenizing applies `nltk.sentiment.util.mark_negation`.
"""
def tokenize(self, text: str) -> str:
def tokenize(self, text: str) -> t.Iterator[str]:
# Apply the base tokenization
words = super().tokenize(text)
# Convert to a list (sigh) the iterator