Articles → NLP → Blankline Tokenizer In NLP
Blankline Tokenizer In NLP
Purpose
Example
from nltk.tokenize import BlanklineTokenizer
text = """This is the first paragraph.
This is the second paragraph.
And this is the third one."""
# Create tokenizer
tokenizer = BlanklineTokenizer()
# Tokenize text
tokens = tokenizer.tokenize(text)
print(tokens)
Output
| Posted By - | Karan Gupta |
| |
| Posted On - | Saturday, August 23, 2025 |