It's pretty hard to imagine what an "uncountable group of points" could possibly be, or how anyone could ever test for the existence of such a thing, but we're talking about any possible universe so I can't exactly refute what you're saying here. The very fact that we can even ask questions like "what is the cardinality of a 'set of points' that occupies physical volume?" shows that our math is not at all bound by the constraints of our own universe.
> propositional logic only works because our universe allows us to write truth tables that are causally valid, natural numbers only work because our universe allows us to count over discrete objects, etc.
No, none of this is true. Our universe also allows us to write truth tables that are not valid. We do not dematerialize upon writing down a logical fallacy. Our universe does not seem to contain any infinities at all, and if it does, they're almost certainly countable; yet we can still reason about uncountable infinities without ever having observed them. Our universe seems to exist in only 4 dimensions, yet we can still reason about high dimensional spaces. Why should the constraints of our universe matter to our math at all, other than making some things more obvious than others?
> all 'math' that we can talk about would just be the 'physics' of things that work on paper in our universe
That is just patently obviously not what math is. We have tons of math that is not describing the physics of our universe as we know it.
> propositional logic only works because our universe allows us to write truth tables that are causally valid, natural numbers only work because our universe allows us to count over discrete objects, etc.
No, none of this is true. Our universe also allows us to write truth tables that are not valid. We do not dematerialize upon writing down a logical fallacy. Our universe does not seem to contain any infinities at all, and if it does, they're almost certainly countable; yet we can still reason about uncountable infinities without ever having observed them. Our universe seems to exist in only 4 dimensions, yet we can still reason about high dimensional spaces. Why should the constraints of our universe matter to our math at all, other than making some things more obvious than others?
> all 'math' that we can talk about would just be the 'physics' of things that work on paper in our universe
That is just patently obviously not what math is. We have tons of math that is not describing the physics of our universe as we know it.