VidEoMT turns plain ViT into a video segmenter at 160 FPS
Researchers just introduced VidEoMT, an encoder-only video segmentation model built on standard Vision Transformers. By replacing dedicated tracking modules with a lightweight query propagation mechanism, it matches competitive accuracy while running 5x to 10x faster at up to 160 FPS.