https://s-ai-unix.github.io/tags/%E4%BF%A1%E6%81%AF%E8%AE%BA/Recent content in 信息论 on s-ai-unix's BlogHugo -- 0.161.1zh-cnTue, 03 Feb 2026 08:36:00 +0800https://s-ai-unix.github.io/posts/2026-02-03-maximum-entropy-principle-gaussian-distribution/Tue, 03 Feb 2026 08:36:00 +0800https://s-ai-unix.github.io/posts/2026-02-03-maximum-entropy-principle-gaussian-distribution/深入探讨最大熵原理的数学基础、严格证明及其深刻含义，揭示为什么在已知均值和方差的条件下，高斯分布是自然界最合理的选择https://s-ai-unix.github.io/posts/2026-02-03-kl-divergence-information-theory/Tue, 03 Feb 2026 08:30:00 +0800https://s-ai-unix.github.io/posts/2026-02-03-kl-divergence-information-theory/系统综述KL散度（Kullback-Leibler散度）的历史背景、数学推导、核心性质及其在信息论、统计推断和机器学习中的深刻应用