RUS  ENG
Full version
JOURNALS // Doklady Rossijskoj Akademii Nauk. Mathematika, Informatika, Processy Upravlenia // Archive

Dokl. RAN. Math. Inf. Proc. Upr., 2023 Volume 514, Number 2, Pages 49–59 (Mi danma450)

SPECIAL ISSUE: ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING TECHNOLOGIES

Adaptive spectral normalization for generative models

E. A. Egorov, A. I. Rogachev

HSE University, Moscow, Russia

Abstract: When using Wasserstein GAN loss function for training generative adversarial networks (GAN), it is theoretically necessary to limit the discriminators’ expressive power (so called discriminator normalization). Such limitation increases the stability of GAN training at the expense of a less expressive final model. Spectral normalization is one of the normalization algorithms that involves applying a fixed operation independently to each discriminator layer. However, the optimal strength of the discriminator limitation varies for different tasks, which requires a parameterized normalization method. This paper proposes modifications to the spectral normalization algorithm that allow changing the strength of the discriminator limitation. In addition to parameterization, the proposed methods can change the degree of limitation during training, unlike the original algorithm. The quality of the obtained models is explored for each of the proposed methods.

Keywords: generative adversarial network, wasserstein gan, spectral normalization, high energy physics.

UDC: 004.85

Presented: A. I. Avetisyan
Received: 04.09.2023
Revised: 08.09.2023
Accepted: 18.10.2023

DOI: 10.31857/S2686954323601884


 English version:
Doklady Mathematics, 2023, 108:suppl. 2, S205–S214

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2026