You can try using coremltools - https://coremltools.readme.io/docs/pytorch-conversion

I was trying to find something more specific for you, but couldn’t. Personally I haven’t tried VQGAN, but it seems like CLIP model can be converted. Here’s an issue that has been resolved regarding CLIP.