But there is something that has been troubling me about search, and it has taken some long thinking and reflection to get to it. Search is good for information that is missing, like what was Babe Ruth’s WAR? Google and Bing can tell you who Babe Ruth was, along with what a WAR is (wins above replacement value— a geeky baseball stat). Those are kind of needle in the haystack factual tidbits that can satisfy your query. And I guess that last word, query, is the salient issue.
Search is about queries. Questions, with answers. To a search engine’s thinking, there is an algorithmic way to determine an authoritative response. And yeah, for fact-based stuff there probably is. But what about subjective arenas? The search engines respond to the notion of subjectivity through personalization filters. And these create their own issues with insulation and skewed viewpoints. (A filter essentially tries to guess what you would want to click on based on other stuff you’ve clicked on…). Eventually, personalization becomes a self-reinforcing algorithm which makes your world smaller. I wrote about filters earlier, and I strongly recommend Eli Pariser’s book, The Filter Bubble: What the Internet Is Hiding from You (affilate link). He gives a clear view of how filters can make your world smaller.
But my real issue with search is that of discovery. Search is good for finding what you are missing, not what you are looking for…
Recently, I was looking for a gift. I didn’t exactly know what I was looking for. I had concepts.: Artisinal. Elegant. Minimal. Maybe Metal. Perhaps finely woodworked. Special.
Using that specific query, Google pointed me to a content farm (wasn’t Panda and the Revenge of Panda supposed to kill that stuff?). A fully unsatisfactory experience. And mind you, I am not blaming Google for the algorithmic disappointment. What they try to do is incredibly difficult and has amazing complexity. It is orders of magnitude more difficult than any technology project ever embarked upon. But the real disconnect is that I cannot express what I am looking for in any way that is truly structured. I have attributes. I have concepts. But I have no language to express what I am looking for because I don’t know what it is. I am looking for an intrinsic value, an essence. It is as if I am looking for a product that embodies the BMW motorcycle in Zen and the Art of Motorcycle Maintenance: An Inquiry into Values (affiliate link, again). I am looking for quality.
Is it possible for Google (or Bing) to infer and understand such a nebulous and subjective an essence as quality? Because the algorithm is machine driven, machine measured and objectively informed by click data, an algorithm cannot assess what it is serving up as a result, but rather only a fact that based on the parameters embodied within the algorithm, that a particular page is our best mathematical guess that it matches your query. But the engine has no idea of the intrinsic value of the result. Search is still in its nascent stages. It is a baby, and it has much to learn. Perhaps it will require us getting to the point where Google’s algorithm is in some state of sentience, perhaps it will evolve with deeper human influence on the algorithm, or perhaps a better way to get nuanced feedback into the algorithm.
Search today is good for things that are lost or need to be found. It doesn’t help you discover. Who wants to make a discovery engine?