And these language models do acquire a vast amount of knowledge, but they do so as a byproduct as opposed to direct learning objective. Resulting in unwanted side effects such as hallucinated effects
Why AI Is Incredibly Smart and Shockingly Stupid | Yejin Choi | TED · TED