No that's not it. The issue is actually pretty involved, there is a LTT video on it, this is the bit I'm remembering: https://youtu.be/OHKKcd3sx2c?t=475
Ah I see... you can disable network waking, also the ability of Windows Update to wake the computer. That, combined with disabling wake in other areas, solves it on various Windows computers I've tried it on.
I guess it's possible that all of them were defaulting to S3 sleep though, I never checked.