AI Search engine | text embedding | Vector DB | txtai |
In a nutshell
Computer can only understand numbers really but we humans can't really do number
We speak languages but we can really quantize text on a graph
Hence we use nlp (which means natural language processing I have explained a bit in the video about it) to processs text
You really need to understand 2 terms
Tokenizers: Converting text to numbers
Embedding: These tokenizers are bunch of number with info of similar words with grammar and context within itself....
In this video I have explained how you can build a database of your custom words and then search with relative vage words to get ai like search results