https://arxiv.org/abs/2304.15004 suggests the some of the seemingly intelligent behavior of LLMs may be more a result of choice in how to measure it, than an actual phenomenon.
Definitely need to read and understand the whole article for balance. Plenty of breathless optimism out there already.