The overwhelming majority of theories are rejected because they contain bad explanations, not because they fail experimental tests.
Reality contains not only evidence, but also the means (such as our minds, and our artefacts) of understanding it. There are mathematical symbols in physical reality. The fact that it is we who put them there does not make them any less physical.
Our best theories are not only truer than common sense, they make more sense than common sense…
To say that prediction is the purpose of a scientific theory is to confuse means with ends. It is like saying that the purpose of a spaceship is to burn fuel. … Passing experimental tests is only one of many things a theory has to do to achieve the real purpose of science, which is to explain the world.