15th European Conference on Artificial Intelligence
  July 21-26 2002     Lyon     France  
   

ECAI-2002 Conference Paper

[PDF] [full paper] [prev] [tofc] [next]

Boltzmann Machine for Population-Based Incremental Learning

Arnaud Berny

We propose to apply the Boltzmann machine (BM) to population-based incremental learning (PBIL). We will replace the statistical model used in PBIL, which assumes that the binary variables of the optimisation problem are independent, with that of a BM. From the logarithm of the expectation of the function to maximise, we derive specific learning rules for the BM. These learning rules involve expectations with respect to the distribution of the BM and also to its selected version, in the spirit of PBIL or genetic algorithms. New populations are sampled from the BM using traditional Gibbs sampling. The proposed BM-PBIL algorithm alternates Gibbs sampling, selection, and update of the parameters. We evaluate BM-PBIL with different classes of functions, compare it to the original PBIL, and identify classes for which it is superior to PBIL, in particular functions with jumps and quadratic functions.

Keywords: Genetic Algorithms, Neural Networks, Search

Citation: Arnaud Berny: Boltzmann Machine for Population-Based Incremental Learning. In F. van Harmelen (ed.): ECAI2002, Proceedings of the 15th European Conference on Artificial Intelligence, IOS Press, Amsterdam, 2002, pp.198-202.


[prev] [tofc] [next]


ECAI-2002 is organised by the European Coordinating Committee for Artificial Intelligence (ECCAI) and hosted by the Université Claude Bernard and INSA, Lyon, on behalf of Association Française pour l'Intelligence Artificielle.