Idea Ripper // ArchiveCards: 1555 [Live] | Updated: 2026-10-14
Card #c731IR // #c731Synthesis

the curiosity drive is such a general and generally useful concept for limited-resource RL in rare-reward environments that it should be prewired, as opposed to be learnt from scratch

— In our words · Source: Driven by Compression Progress (Jürgen Schmidhuber)

[Use when]

Use when deciding what to build into a system, a team, or a practice rather than hoping it appears on its own.

[Why it matters]

Curiosity is not a luxury for agents with spare compute — it is the optimal prior when rewards are rare and time is finite. Build it in; do not wait for it to emerge.

More from Driven by Compression Progress

#c718This drive maximizes interestingness, the first derivative of subjective beauty or compressibility, that is, the steepness of the learning…Use when judging whether something is boring: ask whether the data went flat, or whether your learning curve… #c719I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once…Use when the same thing bores you now that electrified you a year ago: you compressed it, and the derivative… #c720Curiosity is the desire to create or discover more non-random, nonarbitrary, regular data that is novel and surprising not in the…Use when designing anything meant to hold attention: the target is learnable regularity, not noise.