An important step to reaching AGI is to crack continual learning. However, with all the hallucinations and mishaps with LLM models, I really don’t think they are capable of being continual learners. One of the biggest bottlenecks imo is the context window. Genuinely curious what others think.
[link] [comments]