From Zipf’s Law and the category of “things that vary inversely to frequency” I got my first brush with the idea that keeping track of usage frequencies is part and parcel of building efficient codes.

In its first application the environment the Learner had to learn was the usage behavior of its user, as given by finite sequences of characters from a finite alphabet which might as well be called words and as given by finite sequences of those words which might as well be called phrases or sentences.  In other words, Job One for the Learner was the job of constructing a user model.

In that frame of mind we are not seeking anything so grand as a Universal Induction Algorithm but simply looking for any approach that gives us a leg up, complexity wise, in Interactive Real Time.

Resource

• Survey of Theme One Program

cc: Cybernetics • Ontolog Forum (1) (2) • Systems Science (1) (2)
cc: Peirce List (12-12) (18-02) (18-03) (20-09) (20-10) (21-10)
cc: FB | Theme One Program • Laws of Form (1) (2)