The Census transform does not impose a specific shape on the region in which comparisons are performed to generate the binary string. This limitation is addressed in (CLSF10), one of the first works to formalize the problem of constructing discriminative binary descriptors.
Most binary descriptors are inspired by Census and generalize it: instead of comparing every pixel only with the center of the region, they compare suitably selected pairs of pixels. The comparison function is defined as:
| (7.5) |
The pixel pairs (the “mask”) are selected by training on sample images, with the aim of maximizing the descriptor's discriminative power.
Numerous approaches in the literature address the selection of points and the type of image filtering to apply.