Yes. We download an apk file. And then install it after it giving it permission that it is ok to install unverified apks.

Some of the more savvy ordinary people even export apps as apk for other phones.