Hierarchical Reasoning Models - The mighty 27M param model that bested multi billion param models from OpenAI & Anthropic underscores the need to model intelligence as a complex system.
The fact that it has only 27M parameters and can potentially compete with much larger models, shows inherent logic/intelligence. In my past experience, hierarchal models have higher cost and would look forward the overall ROI here.
The human brain, and many other biological systems produced by evolution are often deeply hierarchical. Initially they can appear "overly complex", until it is understood what they achieve, which is often many times more efficient, because nature fundamentally pursues energy minimization.
The fact that it has only 27M parameters and can potentially compete with much larger models, shows inherent logic/intelligence. In my past experience, hierarchal models have higher cost and would look forward the overall ROI here.
The human brain, and many other biological systems produced by evolution are often deeply hierarchical. Initially they can appear "overly complex", until it is understood what they achieve, which is often many times more efficient, because nature fundamentally pursues energy minimization.