Fix typo in word_tokenize docstring

Unless I'm misunderstanding something, `nltk.tokenize.word_tokenize()` splits text into words, not into sentences (which `nltk.tokenize.sent_tokenize()` does).
pblh123 · Apr 13, 2017 · aea7b84 · aea7b84
1 parent 472382b
commit aea7b84
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/nltk/tokenize/__init__.py b/nltk/tokenize/__init__.py
@@ -103,7 +103,7 @@ def word_tokenize(text, language='english'):
     along with :class:`.PunktSentenceTokenizer`
     for the specified language).
 
-    :param text: text to split into sentences
+    :param text: text to split into words
     :param language: the model name in the Punkt corpus
     """
     return [token for sent in sent_tokenize(text, language)