/google-research/ General-purpose, long-context autoregressive modeling with Perceiver AR
Code Link
https://github.com/google-research/perceiver-ar
Description
Real-world data is high-dimensional: a book, image, or musical performance can easily contain hundreds of thousands of elements even after compression. Code: https://github.com/google-research/perceiver-ar