…accept that knowledge can be expressed in bits of information. This implies always an uncertainty. Prior knowledge however usually comes as certain. The expert cannot estimate how convinced he is…
Statistical pattern recognition
Prior knowledge
…combinations of the given properties are equally valid and should be considered as well. If there are n binary properties then the difference between any two objects that are not…
Recognition, belief or knowledge
…generalize. It is another version of the Cover’s study on complexity . For a long time I’ve used Nilsson’s observation against the idea that sufficiently large artificial neural networks can…
The art and science of pattern recognition
…and by computers. They are used in many places in science and engineering for replacing or supporting human recognition tasks. But … Where is the art? Well, the recognition of…
Dissimilarity measures
…distance measures. There are some additional properties that may be helpful. Dissimilarities versus distances It is very common to define dissimilarity measures that are non-negative. It is however not essential….
My classifier scores 50% error. How bad is that?
…probable class. However, in case of multi-class problems much larger errors may be found. How good is a 50% error for a multi-class classifier? Can we compare it in one…
Non-Euclidean and non-metric dissimilarities
…common, as often, by definition dissimilarity measures are metric: the dissimilarity between two objects is the smallest difference that can be found according to some optimization procedure. The criteria for…
Regularization and invariants
…mean (or are shifted to the origin before). This matrix needs to be inverted in the computation of a classifier. It will, however, be singular (having rank 0) in case…
What is pattern recognition?
…basis of any science, in particular, the natural sciences. The question how we do this, how we come from observations to memory and to generalization is thereby the basic scientific…
The ten Aristotelian categories, features and dissimilarities
…The founding fathers of philosophy, Plato and Aristotle, created two competing foundations for knowledge: the ideas and the categories. According to Plato reality is constituted by the non-materialistic ideas:…