Visualizing Tiny LLMs from OpenAI's Parameter Golf screenshot

What is Visualizing Tiny LLMs from OpenAI's Parameter Golf?

How does a 16MB LLM behave?