SwinTransformer

A transformer with CNN concepts

Overall structure

shift window

Mask is a clever approach to disregard the computation we are not interested in without doing too complicated manipulation.