The issue is you have to disclose your phone number to Google, not (just) to Midjourney, AND Google will know you use Midjourney.

There's too much unnecessary connected PII data generated by such mechanisms.