MATH · IN · MODELS

GAN units align with object masks and causally control objects

measured in 1 paper

Bau et al. identify interpretable units in a real trained Progressive GAN by scoring each channel's spatial activation against object-segmentation masks [bau-etal-2019-gan-dissection] Causally ablating or forcibly activating identified units reliably removes or adds the corresponding object (e.g. a tree, a door) in generated images [bau-etal-2019-gan-dissection] The method also locates and removes artifact-causing units and enables interactive scene editing [bau-etal-2019-gan-dissection] Identification is a quantified geometric measurement and the ablation/insertion is a direct causal intervention with measured image effects [bau-etal-2019-gan-dissection]

Context

interpretable GAN units, segmentation-scored channel identification, causal object ablation/insertion

Papers

GAN Dissection: Visualizing and Understanding Generative Adversarial Networks — Bau, David, Zhu, Jun-Yan, Strobelt, Hendrik, Zhou, Bolei, Tenenbaum, Joshua B., Freeman, William T., Torralba, Antonio2019 · arXiv:1811.10597