Search Constraints

Number of results to display per page
Results for: Affiliation Athens University of Economics and Business Remove constraint Affiliation: Athens University of Economics and Business Creator / Instructor Data & Web Mining Lab Remove constraint Creator / Instructor: Data & Web Mining Lab Keywords Machine learning Remove constraint Keywords: Machine learning Polyu oer sim No Remove constraint Polyu oer sim: No Resource Type Presentation Remove constraint Resource Type: Presentation

Search Results

  • Presentation 
    Sampling Table Configurations for the Hierarchical Poisson-Dirichlet Process

    Sampling Table Configurations for the Hierarchical Poisson-Dirichlet Process

    This video was recorded at European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), Athens 2011. Hierarchical modeling and reasoning are fundamental in machine intelligence, and for this the two-parameter Poisson-Dirichlet Process (PDP) plays an important role. The most popular MCMC sampling algorithm for the hierarchical PDP and hierarchical Dirichlet Process is to conduct an incremental sampling based on the Chinese restaurant metaphor, which originates from the Chinese restaurant process (CRP). In this paper, with the same metaphor, we propose a new table representation for the hierarchical PDPs by introducing an auxiliary latent variable, called table indicator, to record which customer takes responsibility for starting a new table. In this way, the new representation allows full exchangeability that is an essential condition for a correct Gibbs sampling algorithm. Based on this representation, we develop a block Gibbs sampling algorithm, which can jointly sample the data item and its table contribution. We test this out on the hierarchical Dirichlet process variant of latent Dirichlet allocation (HDP-LDA) developed by Teh, Jordan, Beal and Blei. Experiment results show that the proposed algorithm outperforms their "posterior sampling by direct assignment" algorithm in both out-of-sample perplexity and convergence speed. The representation can be used with many other hierarchical PDP models.

    Subjects:
    Computing
    Keywords:
    Machine learning Artificial intelligence
    Resource Type:
    Presentation
     
    OER