openSUSE-SU-2022:10040-1

This update for python-nltk fixes the following issues:

Update to 3.7

• Improve and update the NLTK team page on nltk.org (#2855, #2941)

• Drop support for Python 3.6, support Python 3.10 (#2920)

  • Update to 3.6.7

• Resolve IndexError in sent_tokenize and word_tokenize (#2922)

  • Update to 3.6.6

• Refactor gensim.doctest to work for gensim 4.0.0 and up (#2914)

• Add Precision, Recall, F-measure, Confusion Matrix to Taggers (#2862)
• Added warnings if .zip files exist without any corresponding .csv files. (#2908)
• Fix FileNotFoundError when the download_dir is a non-existing nested folder (#2910)
• Rename omw to omw-1.4 (#2907)
• Resolve ReDoS opportunity by fixing incorrectly specified regex (#2906, boo#1191030, CVE-2021-3828).
• Support OMW 1.4 (#2899)
• Deprecate Tree get and set node methods (#2900)
• Fix broken inaugural test case (#2903)
• Use Multilingual Wordnet Data from OMW with newer Wordnet versions (#2889)
• Keep NLTKs 'tokenize' module working with pathlib (#2896)
• Make prettyprinter to be more readable (#2893)
• Update links to the nltk book (#2895)
• Add CITATION.cff to nltk (#2880)
• Resolve serious ReDoS in PunktSentenceTokenizer (#2869)
• Delete old CI config files (#2881)
• Improve Tokenize documentation + add TokenizerI as superclass for TweetTokenizer (#2878)
• Fix expected value for BLEU score doctest after changes from #2572
• Add multi Bleu functionality and tests (#2793)
• Deprecate 'return_str' parameter in NLTKWordTokenizer and TreebankWordTokenizer (#2883)
• Allow empty string in CFG's + more (#2888)
• Partition tree.py module into tree package + pickle fix (#2863)
• Fix several TreebankWordTokenizer and NLTKWordTokenizer bugs (#2877)
• Rewind Wordnet data file after each lookup (#2868)
• Correct init call for SyntaxCorpusReader subclasses (#2872)
• Documentation fixes (#2873)
• Fix levenstein distance for duplicated letters (#2849)
• Support alternative Wordnet versions (#2860)
• Remove hundreds of formatting warnings for nltk.org (#2859)
• Modernize nltk.org/howto pages (#2856)
• Fix Bleu Score smoothing function from taking log(0) (#2839)
• Update third party tools to newer versions and removing MaltParser fixed version (#2832)
• Fix TypeError: _pretty() takes 1 positional argument but 2 were given in sem/drt.py (#2854)

• Replace http with https in most URLs (#2852)

  • Update to 3.6.5

• modernised nltk.org website

• addressed LGTM.com issues
• support ZWJ sequences emoji and skin tone modifer emoji in TweetTokenizer
• METEOR evaluation now requires pre-tokenized input
• Code linting and type hinting
• implement get_refs function for DrtLambdaExpression
• Enable automated CoreNLP, Senna, Prover9/Mace4, Megam, MaltParser CI tests
• specify minimum regex version that supports regex.Pattern

• avoid re.Pattern and regex.Pattern which fail for Python 3.6, 3.7

  • Update to 3.6.4

• deprecate nltk.usage(obj) in favor of help(obj)

• resolve ReDoS vulnerability in Corpus Reader
• solidify performance tests
• improve phone number recognition in tweet tokenizer
• refactored CISTEM stemmer for German
• identify NLTK Team as the author
• replace travis badge with github actions badge

• add SECURITY.md

  • Update to 3.6.3

• Dropped support for Python 3.5

• Run CI tests on Windows, too
• Moved from Travis CI to GitHub Actions
• Code and comment cleanups
• Visualize WordNet relation graphs using Graphviz
• Fixed large error in METEOR score
• Apply isort, pyupgrade, black, added as pre-commit hooks
• Prevent debug_decisions in Punkt from throwing IndexError
• Resolved ZeroDivisionError in RIBES with dissimilar sentences
• Initialize WordNet IC total counts with smoothing value
• Fixed AttributeError for Arabic ARLSTem2 stemmer
• Many fixes and improvements to lm language model package
• Fix bug in nltk.metrics.aline, C_skip = -10
• Improvements to TweetTokenizer
• Optional show arg for FreqDist.plot, ConditionalFreqDist.plot

• edit_distance now computes Damerau-Levenshtein edit-distance

  • Update to 3.6.2

• move test code to nltk/test

• fix bug in NgramAssocMeasures (order preserving fix)

  • Update to 3.6

• add support for Python 3.9

• add Tree.fromlist
• compute Minimum Spanning Tree of unweighted graph using BFS
• fix bug with infinite loop in Wordnet closure and tree
• fix bug in calculating BLEU using smoothing method 4
• Wordnet synset similarities work for all pos
• new Arabic light stemmer (ARLSTem2)
• new syllable tokenizer (LegalitySyllableTokenizer)

• remove nose in favor of pytest

  • Update to v3.5

• add support for Python 3.8

• drop support for Python 2
• create NLTK's own Tokenizer class distinct from the Treebank reference tokeniser
• update Vader sentiment analyser
• fix JSON serialization of some PoS taggers
• minor improvements in grammar.CFG, Vader, pl196x corpus reader, StringTokenizer
• change implementation <= and >= for FreqDist so they are partial orders
• make FreqDist iterable

• correctly handle Penn Treebank trees with a unlabeled branching top node

  • Update to 3.4.5 (boo#1146427, CVE-2019-14751):