The influence of hyper-parameters in the infinite relational model

Kristoffer Jon Albers, Morten Mørup, Mikkel Nørgaard Schmidt

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

The infinite relational model (IRM) is a Bayesian nonparametric stochastic block model; a generative model for random networks parameterized for uni-partite undirected networks by a partition of the node set and symmetric matrix of inter-partion link probabilities. The prior for the node clusters is the Chinese restaurant process, and the link probabilities are, in the most simple setting, modeled as iid. with a common symmetric Beta prior. More advanced priors such as separate asymmetric Beta priors for links within and between clusters have also been proposed. In this paper we investigate the importance of these priors for discovering latent clusters and for predicting links. We compare fixed symmetric priors and fixed asymmetric priors based on the empirical distribution of links with a Bayesian hierarchical approach where the parameters of the priors are inferred from data. On synthetic data, we show that the hierarchical Bayesian approach can infer the prior distributions used to generate the data. On real network data we demonstrate that using asymmetric priors significantly improves predictive performance and heavily influences the number of extracted partitions.
Original languageEnglish
Title of host publicationProceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2016)
Number of pages6
PublisherIEEE
Publication date2016
ISBN (Print)978-1-5090-0746-2
DOIs
Publication statusPublished - 2016
Event2016 IEEE 26th International Workshop on Machine Learning for Signal Processing - Vietri sul Mare, Italy
Duration: 13 Sept 201616 Sept 2016
Conference number: 26
https://ieeexplore.ieee.org/xpl/conhome/7605057/proceeding

Conference

Conference2016 IEEE 26th International Workshop on Machine Learning for Signal Processing
Number26
Country/TerritoryItaly
City Vietri sul Mare
Period13/09/201616/09/2016
Internet address

Keywords

  • Infinite relational model
  • Hyperparameter inference
  • Link-prediction
  • Bayesian nonparametrics

Fingerprint

Dive into the research topics of 'The influence of hyper-parameters in the infinite relational model'. Together they form a unique fingerprint.

Cite this