Alberto Romero
Nov 22, 2024

--

The reason is the tokenizer. It's not about lack of intelligence! It's how the model parses words into vectors. ChatGPT doesn't see letters like we do but tokens which are parts of words numbered in a long vocabulary. That's why it sometimes gets it right and sometimes wrong

--

--

Alberto Romero
Alberto Romero

Written by Alberto Romero

AI & Tech | Weekly AI Newsletter: https://thealgorithmicbridge.substack.com/ | Contact: alber.romgar at gmail dot com

Responses (1)