PerceptionEncoder How to use facebook/pe_core_base_patch16_224_timm with PerceptionEncoder:
# Use any PE model as a vision encoder
import core.vision_encoder.pe as pe
model = pe.VisionTransformer.from_config("facebook/pe_core_base_patch16_224_timm", pretrained=True)