I feel like there is a misunderstanding in this thread.
The universe is described by math. Math itself is also very fundamental though.
However even the Singularities are disputed and generally not liked by physicist. We try to find other explanations for how black holes work (lots of papers on this). Moreover, we never really have a singularity, but ringularities, as all black holes rotate changing the singularity to a singularity (they probably also have a charge but that is a different matter).
And on the other hand, if you are a follower of the simulation argument (I know a few physicists that are) there are also counter arguments against this (which I believe are more likely).
You are correct about the replication problems, but this also varies heavily depending what scientific discipline you look at.
Also if you do science you may take the results oft another scientist (if they make sense and are peer revievewed) and build your next experiment on it, which may also work out and get peer reviewed.
So even with the replication problem science can work and build on thousands of experiments. But it would be better and needed that the experiments were reproducible.