Higher Order Neural Network Group-based Adaptive Tolerance Trees

Introduction

Artificial higher order neural network models have been widely used for patten recognition with the benefit of HONNs being open box models (Bishop (1995); Park, Smith, & Mersereau (2000); Spirkovska, & Reid (1992, and1994); and Zhang, Xu, & Fulcher (2007)). Shin and Ghosh (1991) introduce a novel feedforward network called the pi-sigma network. This network utilizes product cells as the output units to indirectly incorporate the capabilities of higher order networks while using a fewer number of weights and processing units. The pi-sigma network is an efficient higher order neural network for pattern classification and function approximation. Linhart and Dorffner (1992) present a self-learning visual pattern explorer and recognizer using a higher order neural network, which could improve the efficiency of higher order neural networks, is built into a pattern recognition system that autonomously learns to categorize and recognize patterns independently of their position in an input image. Schmidt and Davis (1993) explore alternatives that reduce the number of network weights while pattern recognition properties of various feature spaces for higher order neural networks. Spirkovska and Reid (1993) describe coarse-coded higher order neural networks for PSRI object recognition. The authors describe a coarse coding technique and present simulation results illustrating its usefulness and its limitations. Simulations show that a third-order neural network can be trained to distinguish between two objects of 4096×4096 pixels. Wan and Sun (1996) show that the higher order neural networks (HONN) have numerous advantages over other translational rotational scaling invariant (TRSI) pattern recognition techniques for automatic target recognition. Morad and Yuan (1998) present a method for automatic model building from multiple images of an object to be recognized. The model contains knowledge which has been computed during the learning phase from large 2D images of an object for automatic model building and 3D object recognition. A neuro-based adaptive higher order neural network model has been developed by Zhang, Xu, and Fulcher (2002) for data model recognition. Voutriaridis, Boutalis, and Mertzios (2003) propose ridge polynomial networks in pattern recognition. Ridge polynomial networks (RPNs) are special class of high order neural networks with the ability of high order neural networks for perform shift and rotation. Development of new higher order neural network models for face recognition is the first motivation of the chapter.