42digest首页
FMMI: Flow Matching 相互信息估算

FMMI: Flow Matching Mutual Information Estimation

Ivan Butakov, Alexander Semenenko, Alexey Frolov, Ivan Oseledets

arXiv
2025年11月11日

我们引入了一种新的相互信息(MI)估计器,从根本上重新构建了歧视性方法。 而不是训练一个分类器来区分联合和边缘分布,我们学习一种将一个变换为另一个的正态流。 该技术产生计算高效和精确的MI估计,可以很好地扩展到高尺寸和广泛的地面真实MI值。

We introduce a novel Mutual Information (MI) estimator that fundamentally reframes the discriminative approach. Instead of training a classifier to discriminate between joint and marginal distributions, we learn a normalizing flow that transforms one into the other. This technique produces a computationally efficient and precise MI estimate that scales well to high dimensions and across a wide range of ground-truth MI values.