AI Blog

AI Blog

by Michele Laurelli

Group Normalization

Technique
Definition

Normalizes by dividing channels into groups and normalizing within each group.

Independent of batch size, unlike batch norm. Divides channels into groups. Good for small batches and video tasks.

Examples

1

Small batch training

2

Video understanding

3

Object detection

Michele Laurelli - AI Research & Engineering