Deep unsupervised learning on a desktop pc: A primer for cognitive scientists

Alberto Testolin, Ivilin Stoianov, Michele De Filippo De Grazia, Marco Zorzi

Research output: Contribution to journalArticlepeer-review

Abstract

Deep belief networks hold great promise for the simulation of human cognition because they show how structured and abstract representations may emerge from probabilistic unsupervised learning. These networks build a hierarchy of progressively more complex distributed representations of the sensory data by fitting a hierarchical generative model. However, learning in deep networks typically requires big datasets and it can involve millions of connection weights, which implies that simulations on standard computers are unfeasible. Developing realistic, medium-to-large-scale learning models of cognition would therefore seem to require expertise in programing parallel-computing hardware, and this might explain why the use of this promising approach is still largely confined to the machine learning community. Here we show how simulations of deep unsupervised learning can be easily performed on a desktop PC by exploiting the processors of low cost graphic cards (graphic processor units) without any specific programing effort, thanks to the use of high-level programming routines (available in MATLAB or Python). We also show that even an entry-level graphic card can outperform a small high-performance computing cluster in terms of learning time and with no loss of learning quality. We therefore conclude that graphic card implementations pave the way for a widespread use of deep learning among cognitive scientists for modeling cognition and behavior.

Original languageEnglish
Article numberArticle 251
JournalFrontiers in Psychology
Volume4
Issue numberMAY
DOIs
Publication statusPublished - 2013

Keywords

  • Cognitive modeling
  • Computer cluster
  • Deep neural networks
  • GPUs
  • Hierarchical generative models
  • MPI
  • Parallel-computing architectures
  • Unsupervised learning

ASJC Scopus subject areas

  • Psychology(all)

Fingerprint

Dive into the research topics of 'Deep unsupervised learning on a desktop pc: A primer for cognitive scientists'. Together they form a unique fingerprint.

Cite this