Kullback-Leibler divergence
Related Words
entropyinformationprobabilitydistributiondivergencelikelihoodlogarithmexpectationvariancecovarianceinferencestochasticrandomnessuncertaintycross entropymutual informationstatisticsmachine learningdeep learningneural networkoptimizationgradientloss functioncost functionobjective functionpriorposteriorevidencesamplingMonte Carloautoencoderlatent spacemanifoldmetricdistancemeasuredensitypdfnormalizationconvergenceasymptotebiasoverfittingunderfittingregularizationinformation theorybitclusteringclassificationregressionparametermodelapproximationconvexityintegralsummation