I had a lot of fun experimenting with VQGAN+CLIP a couple of weeks ago too; it feels kind of like you're prodding into the mind of an alien species to extract its ideas. My findings: https://blog.roboflow.com/ai-generated-art/

Have you played around with the (unofficial) DALLE-mini yet to compare? https://huggingface.co/spaces/flax-community/dalle-mini