Skip to content

Some smoothing techniques used in NLP and ML, including Laplacian and Lidstone Smoothing, Absolute Discounting, Backoff, Kneser-Ney and Interpolation.

License

Notifications You must be signed in to change notification settings

PangYunsheng8/Smoothing-Techniques-in-NLP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 

Repository files navigation

Smoothing techniques commonly used in NLP

In this notebook, I will introduce several smoothing techniques commonly used in NLP or machine learning algorithms. They are:

  • Laplacian (add-one) Smoothing
  • Lidstone (add-k) Smoothing
  • Absolute Discounting
  • Katz Backoff
  • Kneser-Ney Smoothing
  • Interpolation

For more detail, please move to the ipython notebook

About

Some smoothing techniques used in NLP and ML, including Laplacian and Lidstone Smoothing, Absolute Discounting, Backoff, Kneser-Ney and Interpolation.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published