Is evolution a form of learning?

Some say that learning is a form of evolution - e.g. see my Keeping Darwin in mind essay. However others say that evolution is a form of learning. For example, here's Leslie Valiant (from Probably Approximately Correct) in a section titled "Evolution as a form of learning":

To see evolution as a form of learning we view the genome in evolution as corresponding to the hypothesis in learning. The performance of the genome corresponds to its expected closeness to ideal behaviour, where the expectation is taken over the distribution of experiences the world offers.

What is going on here? Is evolution a form of learning? Or is learning a form of evolution?

I think that this is a fairly easy question: learning is a form of evolution, but not all evolution is a form of learning. Some evolution is more like forgetting than learning. It represents a loss of adaptive fit. If you forget everything you ever knew, that's still a part of evolution, but it is hard to see it as a form of learning. So: evolution is the larger category, while learning is a subset of it.

Perhaps those who claim that evolution is a form of learning should start by making it clear that it is only adaptive evolution they are talking about. Then they would have a reasonable point.