Veracity Values
March 2, 2009
How do you know what is true ?
As a third party, how do you know that something is objectively true as opposed to subjectively true ?
Can you have such as thing as a truth ‘Richter scale’ ?
There are technological tools out there that should be able to help us with verification, even before the semantic web breaks through. Text mining should be able to pull out the key words and phrases of a document. You need to find a set of rules to feed the miner, but apart from that the issues with text mining seem to me to be logistical these days. Feed those results into the relevant search engines and databases and you should be able to automate the evidence gathering process.
Rate the relevance and ‘authority’ of the source and you could derive a ‘veracity value’ for the document.
Place some security around that veracity value and you have a ‘veracity certificate’ that has links to the evidence and a sliding scale of verifiable-ness.
The problem comes in identifying objective vs subjective. For example; take two academic papers, one on the physical qualities of a new metal alloy the other on Mayan cultural artifacts and their relevance to modern day Mexico. They have equal numbers of citations, equally authoritative reviewers, equal external coverage in conference proceedings and equal numbers and quality of references. How does a reader know which is objective and which subjective in nature ?
That’s something that humans do all the time, and frequently get wrong, but that AI has yet to approach.
Perhaps we leave that to the human for the moment and leave the automation at veracity.
The business model writes itself, so if anyone wants to try it get in touch
