KL Divergence: Entropy, Cross Entropy, and Mutual Information in PyTorch
A walkthrough of information entropy, KL divergence, mutual information, and cross entropy — with PyTorch implementations.
#python
Content tagged with "python"
Off-Policy Monte Carlo Prediction with Importance Sampling
How importance sampling lets us estimate value functions under a target policy using episodes collected by a different behavior policy.
GAN 5: Conditional GAN and Pix2Pix
How Conditional GANs extend vanilla GANs to generate class-specific samples, and how Pix2Pix does image-to-image translation.
GAN 4: Deep Convolutional GAN (DCGAN) on SVHN
Implementing DCGAN with CNNs, batch normalization, and transposed convolutions to generate Street View House Numbers.
GAN 3: Implementing a Linear GAN on MNIST in PyTorch
Step-by-step PyTorch implementation of a vanilla GAN trained on MNIST — data loading, Discriminator, Generator, training loop.