Articles → Spacy → Introduction To Natural Language Processing And Tokens In Spacy

Introduction To Natural Language Processing And Tokens In Spacy






What Is Natural Language Processing?





Tokenization In NLP






import spacy

nlp = spacy.load("en_core_web_sm")
doc = nlp(u"This is a sentence.")  # each word is token

for token in doc:
    print(token.text)




Picture showing the output of tokens in spacy

Click to Enlarge


Posted By  -  Karan Gupta
 
Posted On  -  Thursday, July 16, 2020

Query/Feedback


Your Email Id  
 
Subject 
 
Query/FeedbackCharacters remaining 250