NLP Illustrated, Half 1: Textual content Encoding | by Shreya Rao | Nov, 2024

An illustrated information to text-to-number translation, with code

Welcome again to the nook of the web the place we take complex-sounding machine studying ideas and illustrate our means via them — solely to find they’re not that difficult in any case!

At this time, we’re kicking off a brand new collection on Pure Language Processing (NLP). That is thrilling as a result of NLP is the spine of all the flowery Giant Language Fashions (LLMs) we see all over the place — suppose Claude, GPT, and Llama.

In easy phrases, NLP helps machines make sense of human language — whether or not which means understanding it, analyzing it, and even producing it.

In the event you’ve been following alongside our Deep Studying journey, we’ve realized that at their coronary heart, neural networks function on a easy precept: they take an enter, work their mathematical magic, and spit out an output.

For neural networks to do that although each the enter and the output should be in a format they perceive: numbers.

This rule applies whether or not we’re working with an easy mannequin…