Articles → Spacy → Introduction to Natural Language Processing and Tokens in Spacy

Introduction to Natural Language Processing

and Tokens in Spacy






What is Natural Language Processing?





Tokenization in NLP






import spacy

nlp = spacy.load("en_core_web_sm")
doc = nlp(u"This is a sentence.")  # each word is token

for token in doc:
    print(token.text)




Picture showing the output of tokens in spacy

Click to Enlarge


Posted By  -  Karan Gupta
 
Posted On  -  Thursday, July 16, 2020

Query/Feedback


Your Email Id  
 
Subject 
 
Query/FeedbackCharacters remaining 250