I think it really depends upon what one is trying to verify, and the circumstances that require the verification.
I was asked recently on another thread whether, when someone told me what they were feeling, I would take their word for it or insist that they give me ‘evidence’ of what they were feeling. Clearly the latter suggestion is absurd. In everyday conversation, a person’s assertion that they are feeling happy, down, excited, etc is all the evidence we need, coupled with visual cues from their facial expressions and body language, which are also important factors in human communication. We might question their claim to be happy if their mouth was downturned, their shoulders slumped, their tone of voice flat - we might suspect they were not being honest about how they felt, and would perhaps, if they were a close friend, want to question them and find out if there was anything we could do to help them. On the other hand, we probably wouldn’t suggest they get a brain scan to find out what was ‘really’ going on in their head. In such circumstances, our normal, everyday means of communication are sufficient.
Historical evidence is another matter. If we want to find out what people of the past were thinking or feeling, we might rely on an old diary, for example. Mostly, the thoughts and feelings of past generations of people are lost to us, and the documentation we have of past events is often quite limited. The important things when it comes to using historical evidence are reliability and corroboration. To assess reliability, we need to decide how closely the document was written after the event it deals with, whether the writer was really in a position to know about the events they describe, and what their bias might have been. And if multiple sources agree on certain aspects of the events they deal with, we can be reasonably sure that certain things happened in the past. There are, of course, some things that we’ll never know beyond reasonable doubt, and that’s why historical fiction can be so fascinating!
The nature of evidence becomes more serious when we are dealing with a legal case, where someone’s liberty (or life) and the demands of justice are at stake. The standard of evidence is ‘beyond reasonable doubt’ - the requirement that any reasonable person could feel satisfied of the verdict. Again, corroboration and reliability are issues, and some forms of evidence are necessarily more reliable, more accurate than others - DNA evidence, for example, is more accurate than fingerprint evidence. A surveillance video showing someone’s face may be more reliable than an eyewitness identification. If multiple sources of evidence - witness testimony, fingerprinting, DNA, exhibits, circumstances - all support a particular verdict, it is highly likely, if not absolutely certain, to be the right one.
Scientific evidence is another matter again. The scientific method sets out clear parameters by which evidence can be examined and hypotheses tested. Yet again, corroboration and reliability are important factors. Corroboration occurs if multiple sources of data support a given hypothesis. Reliability can be established through repeated experiment. If a reliable piece of evidence is discovered that doesn’t fit the hypothesis, the hypothesis is revised, or, in extreme cases, may be abandoned altogether. True scientific theories remain open to falsification - they may never be 100% ‘proven’ (especially as in the case of evolutionary theory, since it deals with past events for which there are necessarily no living witnesses), but the more evidence is gathered which supports the theory, and the longer a theory lasts without falsification (and so far no-one has ever discovered JBS Haldane’s fossil rabbits in the Precambrian), the stronger it becomes as a description of some aspect of how the world works.
In all of the above, corroboration and reliability are key factors. If all the evidence we have adds up to support a particular conclusion, and if the evidence is sound (a genuine diary rather than a forgery, or a genuine fossil rather than a carefully constructed hoax, for example), then it’s likely that our conclusions are correct.