Can someone explain what “predicting the next token” means
Can someone explain what “predicting the next token” means

Can someone explain what “predicting the next token” means

Say I ask a chatbot a question or ask the chatbot to perform a task. What does predicting a token mean in this activity? What is happening to make the chatbot come up with an answer or perform a task?

Thanks.

submitted by /u/SeverusBaker
[link] [comments]