Bigger is Better?
Huge models and transformers change how we use AI.
But they shouldn’t change how we study intelligence both human,and artificial.
// Generalization is a bare necessity of life. No animal (humans included) can thrive without it. While partly inspired by our cognitive system, today’s AI is still task-biased.
Hierarchical representations and efficient computations are the matchmakers of nature and nurture.
With that in mind we cannot see a way for AI to achieve such abilities by choosing between rule-based and end-to-end learning. Instead, we strive to find the unified approach that combines their strengths.