Natural Language Processing in Python

Alice Zhao

Natural language processing (NLP) is an exciting branch of artificial intelligence (AI) that allows machines to break down and understand human language. As a data scientist, I often use NLP techniques to interpret text data that I'm working with for my analysis. During this tutorial, I plan to walk through text pre-processing techniques, machine learning techniques and Python libraries for NLP.

Text pre-processing techniques include tokenization, text normalization and data cleaning. Once in a standard format, various machine learning techniques can be applied to better understand the data. This includes using popular modeling techniques to classify emails as spam or not, or to score the sentiment of a tweet on Twitter. Newer, more complex techniques can also be used such as topic modeling, word embeddings or text generation with deep learning.

We will walk through an example in Jupyter Notebook that goes through all of the steps of a text analysis project, using several NLP libraries in Python including NLTK, TextBlob, spaCy and gensim along with the standard machine learning libraries including pandas and scikit-learn.

## Setup Instructions
[ ]( )

===

A FREE annual conference for anyone interested in Python in and around Ohio, the entire Midwest, maybe even the whole world.

29 Comments

  1. This was super helpful. Thanks a lot!
    Learnt about markov chains, sentiment analysis and LDA so beautifully!

    Great great tutorial. Thanks a lot, again. God bless you. 🙂

    1. Bro i want to know how I can use algorithms in some ready data available . I just want to see how it works all the NLP algorithms so please do suggest me ,I feel ur good in programming

  2. I love how she didn’t shy away from the curse words. Basically, she was professional about it and everyone else including her were like “we’re all adults here, and we have a goal we’re trying to reach”. I really enjoyed this video and her demo gave me a lot of little ideas for my projects. Thank you for uploading this!

  3. zhao has a talent of explaining difficult concept to audiences. The majority of developers do not have that capability. Engineers tend to “learn-by-doing” which gets you to the destination fast but in such a hurry that one often do not have time to understand the why.

  4. This may be the best Python tutorial I’ve followed, and I’ve done quite a few. All of the concepts covered, even the very complex ones, are explained in a way that makes it super-easy to understand but detailed enough that I know what’s happening. I learned a LOT from this. Thank you, Alice!!

  5. Impeccable tutorial about NLP! You are an awesome teacher, Alice! Keep your Data Science drive going. 🙂

  6. Thank you for your presentation and materials. The tools taught are clear and easy to follow. I like your deliberate and relaxed teaching style. It is most helpful.

  7. This is one of the best NLP tutorials I have gone through in a long while… Awesome pedagogy. She simply made it super intuitive for a newbie like me. Thanks a lot!

  8. I’m so happy to learn NLP for the first time with this great teacher. It’s as a dream for me thanks a lot .

    1. How far have you got? This was my first video learning NLP or Python. I have yet to start the juicy Python tutorials!

  9. It’s been a pleasure learning from this lecture. I am trying to figure out how to work with large text files (judgments) for my thesis project and wish I had more guidance like this along the way as a beginner in the area, most of the material I found before this starts with a corpus and I’m there trying to figure out what exactly that is and how to make my dataset into it. Thank you!

    1. Could you please guide me how to start in machine learning and neutral language processing field ؟

  10. Very clear lesson. Incredibly useful. I can’t thank you enough. Really saw the power of data science using the stuff in this tutorial. Thank you!!!

  11. This video is amazing! I really, really like how she goes through the cleansing process because data is almost never cookie cutter like we want it to be. Loved seeing all the steps laid out so methodically.

  12. Excellent teacher with deliberate and relaxed teaching style!!! and wish if every teachers be like you. Thanks for giving such a tidy lecture.

  13. Thank you! I wondered why others make CS/DataSci so hard to understand! Great preparation, fantastic explaining, most of all a very passionate teacher!

  14. I have taken dozens of NLP courses (most of which are paid) and this is the most explained, organized and perfect course I have ever seen, thank you Alice.

  15. This is my first time taking a course without skipping. Very good explanation. Thank you.

Leave a Reply

Your email address will not be published. Required fields are marked *