Accuracy and relevance of information provided by high ranked sites is often questionable
Saturday, December 31st, 2005My friend and I were arguing about what type of search strategy for information providers (in this case search engines) was preferable. We were divided on the issue of accuracy of search results. My friend didn’t want the search engine to determine if the information it was finding was wrong or not, in other words, he didn’t want the likes of Google to gauge the accuracy of the information it was indexing and searching. He just wanted it to present the information and allow him to make up his own mind. I disagreed, I felt that information seekers want and need authoritative and relevant information. Search results usually fall across several pages, but rarely do most seekers click through all the pages. If inaccurate information that falls below a high standard of veracity is given an equal footing with authoritative information, the information seeker is provided with less high quality results.
Some of you may balk at the term ‘authoritative,’ by which I don’t mean ‘established dogma’ or the quashing of alternative perspectives on history or poverty. At present, if using a search engine to find information about (or , cows, cows, and cows) you’re more likely to find all sorts of cow related products information than what it is you were actually looking for (full disclosure: I tried to use first, but ironically I found high ranking authoritative information for it, though only limited - Google turned out to be less relevant than Yahoo, probably because it’s more often the target of SEO). What you actually want will be spread out across the many pages of search results, outnumbered by the commercial product and service results. Possibly relevant information unfairly competes with the other results that are only trying to sell you something or trying to get you to click on their ads. You’ll probably not even see what you wanted to find, even if it’s right in front of you.
The web is highly commercialized, and the numerous commercial sites on the web depend on search engines to bring their business. Commercial sites have the resources and incentive to use Search Engine Optimization (SEO) to get higher rankings in search results. Non-profit oriented sites that only provide information do not have resources nor the incentive to invest in higher rankings. The US Government created firstgov.gov, a site meant to be the #1 portal for government information and advertised it on traditional media (TV and radio ads) because, in part, searching for information about government information leads seekers to anything but what they were looking for. Search for , , , information, and more, returns 99% junk sites that try to sell you something (and sometimes masking themselves as being a government site) and not the information you as a citizen have a right to (although checking these search results, it seems that things have improved). Search results are questionable because they can be manipulated, often through underhanded means such as link spamming and link injections.
My friend is willing to determine the accuracy of the information himself, but he has a lot of work a head of him. His job is made tougher by the many spam results he has to filter through. He also may have a biased perspective because he’s a programmer and technology searches return relevant results far more often than non-technology oriented searches because of the prevalence of technology information, especially web technology, on the Internet. If he where in a different profession and his primary concern were to look for something else, such as food related items or toys, you name it, he’d have a tough go at it. Also, because of his technology background and his work with search technology and databases, he’s more capable than most to create competent query searches, and has an unrealistic appreciation of the search experiences of most people.
Another issue is that of intellectual freedom. Search engines are operated by profit oriented corporation that have their investors concerns at heart, not necessarily that of the information seeker. If MSN Search is willing to help the Chinese government block information for the selfish purposes of the authorities, then what’s to stop them from working behind the scenes with undemocratic forces in your world? To what extend can we trust that search results were not manipulated behind the scenes when the search process is a closed and secretive one?
I often argue that the web has a need for a non-profit oriented search engine that strives to provide authoritative results. The commercialization of the web has made this difficult, but in the mean time there are options for people who want to bypass the trash they usually have to put up with. Library websites often are great portals to authoritative information, and I urge you to look up your local libraries web page, or that of a major near by city (will probably have a better site) if you live in a rural area.