In the interests of replication, I had to try this myself. I first asked to describe the water cycle and its major stocks and flows.
It did this in the usual LLM style (overly wordy, some important errors, particularly when talking about actual numbers), then it offered to draw it (!)
Here’s what it then produced (it kind of destroyed my soul to produce the alt-text). Again, a figure of a cycle that doesn’t actually have a cycle depicted, amongst other multitudinous sins.
Making your students make conceptual diagrams with LLMs in the first class of the semester, then critiquing them, is possibly your best bet for convincing them LLMs don't actually understand anything.
From: @petergleick
https://fediscience.org/@petergleick/115034355935585552
