We already discussed several times the significance of understanding the Platonic and Aristotelian ways of gaining knowledge. It can be of great help to researchers in the field of pattern recognition in the appreciation of contributions by others, in discussions with colleagues and in supervising students. This may hold for science in general, but it…
Foundation Archives
Aristotle and the ugly duckling theorem
Why is the nearest neighbor rule so good?
Just compare the the new observations with the ones stored in memory. Take the most similar one and use its label. What is wrong with that? It is simple, intuitive, implementation is straightforward (everybody will get the same result), there is no training involved and it has asymptotically a very nice guaranteed performance, the Cover…
The ten Aristotelian categories, features and dissimilarities
The founding fathers of philosophy, Plato and Aristotle, created two competing foundations for knowledge: the ideas and the categories. According to Plato reality is constituted by the non-materialistic ideas: they are the true objects of the world. In his view ideas can be grouped into more and more universal ideas. According to Aristotle there is…
Random Representations
The goal of representation is in pattern recognition to map objects into a domain in which they can be compared. Usually, this domain is a vector space. It might also be a graph or a symbolic sequence or any other modality that allows the computation of distances between the represented objects. The quality of a…
Hume’s fork in pattern recognition
Some things are necessarily true, there is no escape: bachelors are unmarried, the set of prime numbers is infinitely large, the Pythagorean theorem. Other things just happen to be true: stones fall down to earth, birds fly, men are mortal. It could have been otherwise. These are manifestations of Hume’s fork. Are there examples of…
Pattern recognition and the art of naming
If we really understand something, we are able to express it in words, at least for ourselves. Having the right words available may be essential. Language plays a basic role in thinking, If something new is found, if a new idea pops up the right word can crystallize it in language. By this, it can…
Platonic thinking
Everybody tries to understand his world. Some people, the scientists, try to do this in a systematic way. They report their findings in books, journals and at conferences. The starting student may think that there is a single way of doing this, of building knowledge and describing progress. He will be confused on what he…
Non-metric dissimilarities are all around
A big advantage of the representation of objects by a dissimilarity space over the use of kernels is that it has no problems with the usage of non-Euclidean dissimilarity measures. More specifically, it can handle non-metric measures as well. Here, we will show common examples that such dissimilarities arise easily, both, in daily life as…
Metric learning, a problem in consciousness
Pattern recognition studies the tools to learn from examples what is yet unknown. Distances (or dissimilarities) are a primary notion for learning in pattern recognition. What to do if no proper distance measure is known? Can it be learnt? On what basis? This seems to be a consciousness problem. There are three sources of scientific…
Kernel-induced space versus the dissimilarity space
The dissimilarity representation has a strong resemblance to a kernel. There are, however, essential differences in assumptions and usage. Here they will be summarized and illustrated by some examples. Dissimilarities and kernels are both functions describing the pairwise relations between objects. Dissimilarities can be considered as a special type of kernel if kernels are understood…