Game Theory Meets Statistical Physics: A Novel Deep Neural Networks Design

What the paper says

We introduce a novel deep graphical representation that integrates game theory (GT) principles with the laws of statistical physics (SP), enabling feature extraction and pattern classification within a unified learning framework. In our approach, neurons in a network are analogous to players in a GT model. Each neuron, viewed as a classical particle governed by the laws of SP, corresponds to a set of actions that represent specific activation values. The feed-forward process in deep learning (DL) is interpreted as a sequential game with each game involving multiple players. During training, neurons are evaluated iteratively and filtered based on their contributions to a payoff function, which is quantified using the Shapley value driven by a Gaussian-Boltzmann energy model. To mitigate the computational burden of exact Shapley value computations, we employ Monte-Carlo (MC) sampling, reducing the algorithmic complexity from exponential to polynomial. This approximation significantly improves scalability, making our framework suitable for larger networks. Neurons that significantly contribute to the payoff form strong coalitions, and only these neurons are allowed to propagate information to the next layers. Using the Shapley value, we devised a new model regularization technique, thereby improving overall performance. We applied this framework to facial age estimation and gender classification tasks. Experimental results show that our approach outperforms several traditional and recent machine learning models in terms of accuracy, precision, recall, and $F1$ -score.