Drawing inspiration from the success of previous neural autoregressive models applied to sequential raw data (e.g., images, text, and raw audio waveforms) and building upon previously proposed ...

An autoregressive model utilizes an autoencoder to compress raw image pixels into discrete tokens as ... the researchers want to go down this path and build vision-language models on top of the ...