Skip to content

Auxiliary Link Prediction Objective and Entropy Regularization? #8

Closed

Description

@markcheung

I'm trying to understand the code after reading the paper:

  1. How is Auxiliary Link Prediction Objective calculated? Is it using Frobenius norm as described in the paper? It seems to be nll_loss instead.

  2. Where is the Entropy Regularization?

Thanks!

Activity

  1. RexYing commented on Mar 8, 2019

    @RexYing
    Owner
    1. Yes we use NLL instead, since Frobenius norm / L2 loss is harder to train in experiments

    2. I'll add ent later. It's merged from another repo and I didn't put that in.
      It's just a sum of row-wise entropy of the assignment matrix

  2. markcheung commented on Mar 9, 2019

    @markcheung
    Author

    Thanks.

  3. usherbob commented on Jun 17, 2019

    @usherbob

    Hi, Rex. Thanks for sharing your code. But I think you should mention NLL loss in your paper. At first, I did not find your diffpool repo, and tried to reproduce your code with L2 loss. It really confused me a lot since the model always went to NaN, then I had to remove the LP loss.

  4. usherbob commented on Jun 18, 2019

    @usherbob

    Thanks.

    Hi, mark, did you figure it out the calculation of the Link Prediction loss. Could you give me a detailed explanation? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions