Tokenisation
As we all know, neural networks understand one and only one thing i.e. numbers, so how are they able to work with text data like "what's your name?"? If that’s the case, then how do we convert text into numbers, what’s the best way to do it, and is one way better than another and why? We need a way to convert text into numbers and numbers back to text. ...