Natural Language Processing With Python and NLTK p.1 Tokenizing words and Sentences

Natural Language Processing is the task we give computers to read and understand (process) written text (natural language). By far, the most popular toolkit or API to do natural language processing is the Natural Language Toolkit for the Python programming language.

The NLTK module comes packed full of everything from trained algorithms to identify parts of speech to unsupervised machine learning algorithms to help you train your own machine to understand a specific bit of text.

NLTK also comes with a large corpora of data sets containing things like chat logs, movie reviews, journals, and much more!

Bottom line, if you're going to be doing natural language processing, you should definitely look into NLTK!

Playlist link:

sample code:

27 Comments

  1. Hi Sendtex, absolutely smashing tuts, really love the calm relaxing way you teach. Please keep up the awesome work…python is great to use and hardly any good intros on specialised modules such as NLTK….reading python documentation is like watching paint dry so verbose and uninspiring…Regular Expressions are a pain – you’re right they take forever to formulate and never parse what you need. Look forward to watching all the playlists. 🙂

  2. I am really interested in natural language processing and data mining stuff and i have just begun with python
    Can you recommend me a book or a learning path that would let me make my basics strong and simultaneously move towards understanding data and natural language processing from scratch ?
    and thanks for all the awesome tuts !

  3. This is so cool, an easy module to use implement within statistical models on various probabilistic outcomes. I can’t find a more useful channel on Python than yours.

  4. Thank for the awesome tutorials! I have one question about the globe thing you showed on your website, Sentdex. How did you plot things on the globe? It looks really cool. I am really curious about that. Is it done in Python also?

  5. Hey Sentdex.. your videos are amazing. I had to understand NLP and your videos proved to be amazing.

    Could you just help me out in steps to find out sentiment analysis for example DRUG-ADVERSE REACTION PAIRS in the data which might be taken from twitter,FB or blogs???

  6. Thank you for this great tutorial. I am actually new to Python and NLP. However, I found this tutorial to be increadibly easy to follow. Looking forward to watching the playlist.

  7. I swear man. Every time I have a question that I think will yield 0 results on google I find one of your videos. Thanks for doing what you do!

  8. Hi sentdex, the tutorials are too good and any novice to nlp can understand the concept well. The way you teach methodically is super!! Especially the calm and cool way you teach. It would really help many.

  9. Fantastic series. Gotta love Harris and his silly humor. Explanations are excellent and he makes it the easiest time I ever “learned” the main features of a language form scratch. And I’m learning a marketable skill while I’m at it. Fantastic stuff!!

  10. Hi Sentdex, thank you so much for the videos. Your explanation/teaching is 100 times better than my university professor. I’m looking forward to watching the rest of your videos.

  11. Insanely helpful tutorials man. I am coming from a java background and have almost 0 experience in python but the way you have explained every single thing from downloading and installing to every detail. Its just insane.

  12. Hey It’s great to learn from you and the way your teaching is amazing you cover almost everything that helping me a lot. Thank you so much

  13. I cant praise your courses enough. Not only do they offer an introduction, but you seem to be able to seamlessly progress and transition into the really useful complex tools too. Not only this course, but all of them. I use Udemy and Datacamp a lot, and they are both excellent, but your python courses really are a step above even DataCamp. Thank you so much !!!

  14. HI @sentdex , since it’s 2020 and there’s quite an upgrade, what do you say about making a tutorial regarding NLP regarding all algorithms out there ? Like GPT-2 , BERT (just the popular ones)
    Whatever else you would like to include .

  15. This is my best tutorial experience from YouTube. It’s amazingly well paced. I whole-heartedly thank the person who made this…

Leave a Reply

Your email address will not be published. Required fields are marked *

Amazon Affiliate Disclaimer

Amazon Affiliate Disclaimer

“As an Amazon Associate I earn from qualifying purchases.”

Learn more about the Amazon Affiliate Program