A type of positional embedding that is very effective when working with attention networks on multi-dimensional data, or for language models in general.

After hours: February 28 at 6:06:43 PM EST ...