nip.utils.maths.logit_entropy

Contents

nip.utils.maths.logit_entropy#

nip.utils.maths.logit_entropy(logits: Float[Tensor, '... logits']) Float[Tensor, '...'][source]#

Compute the entropy of a set of logits.

Parameters:

logits (Float[Tensor, "... logits"]) – The logits.

Returns:

Float[Tensor, “…”] – The entropy of the logits.