Meta learning—also known as learning to learn—is another fascinating topic within deep learning and is considered by many to be a promising path toward Artificial General Intelligence (AGI). For those of you who do not know what AGI is, it is when artificial intelligence reaches the capacity to understand and learn to do any type of intelligent task that a human is capable of doing, which is the goal of artificial intelligence.
Deep neural networks, as we know, are very data-hungry and require a lot of training time (depending on the size of the model), which can sometimes be several weeks, whereas humans are able to learn new concepts and skills a lot faster and more efficiently. For example, as kids, we can quickly learn to tell the difference between a donkey, a horse, and a zebra with absolute certainty after only seeing them once or a handful of...
