
Compression, Prediction, and Understanding
What can a learning system safely forget? Compare simple predictors and compression methods on sequences with hidden patterns, then change the patterns or ask a different question about the same data. Investigate which summaries remain useful, what information has been lost, and whether good prediction alone is enough to support further learning.
Link to this idea


