« PREVIOUS ENTRY
Space Invaders block-prints!

“Pornhounds are friendlier,” and other data-mining trivia

There’s a story in a recent issue of Time about data mining. Apart from the usual big-brotheresque material, a couple of points struck me as really kooky, including:

A major hotel chain discovered that guests who opted for X-rated flicks spent more money and were less likely to make demands on the hotel staff, according to privacy consultant Larry Ponemon. These low-maintenance customers were rewarded with special frequent-traveler promotions. Victoria’s Secret stopped uniformly stocking its stores once MicroStrategy showed that the chain sold 20 times as many size-32 bras in New York City as in other cities …

A loan company using predictive-analysis software from Sightward, based in Bellevue, Wash., discovered that the No. 1 indicator of whether Web applicants will go through with a loan rather than merely check current quotes was whether they voluntarily identified their gender on the website.

What interests me about data-mining is that it throws all the old scientific warnings out the window. Scientists caution us that merely finding a link between two things doesn’t mean they have any logical connection. Correlation, they insist, is not causation.

In contrast, data mining is all about finding zillions and zillions of new correlations, in a desperate bid to cash in on them. Screw the scientific method; it’s like a sort of conspiracy theory on a mass scale — finding as many loopy threads as possible to knit together the chaos of the world. Except of course, many of those loopy threads actually do turn out to be useful. For whatever reason, knowing someone’s gender — and knowing that the person is willing to reveal it to you — means they really want a loan. Who knew?

The point is: Correlation may not be causation, but who cares? If you’re scientist, you want to prove X causes Y, because you’re trying to figure out the laws of nature. Marketers, on the other hand, have no such standard of proof. They find out that people who rent porn are friendly customers. Who cares why? It’s still useful info. Subrational processes are more useful than we think they are — and our machines are proving it.


blog comments powered by Disqus

Search This Site


Bio:

I'm Clive Thompson, a writer on science, technology, and culture. This blog collects bits of offbeat research I'm running into, and musings thereon.

Currently, I'm a contributing writer for the New York Times Magazine and a columnist for Wired magazine. I also write for Fast Company and Wired magazine's web site, among other places. Email or AOL IM me (pomeranian99) to say hi or send in something strange!

More of Me

Twitter
Tumblr
Flickr


Recent Entries

A long German word for “noticing when ads are being customized based on your surfing history”

Gay squid sex

“El Ajedrecista” — an analog chess-playing computer from 1912

Hacking the Model T

“How did you find my site?” and Vannevar Bush’s memex

» visit the Collision Detection archives

Clive Thompson's Tumblr
a bunch of stuff

May 20, 2011 » 02:28 PM

From Christopher Kennedy’s very droll book “Neitzsche’s Horse”.

July 28, 2010 » 07:35 AM
“Wr” - S

July 06, 2010 » 10:05 AM

My Xbox broke, and I was trying to Google some possible technical solutions, when I noticed that Google appears to be encouraging me to make a typo. I suppose it’s possible that Google’s algorithms know that typing “wont” instead of “won’t” would produce better results.

June 29, 2010 » 05:00 PM

On the other hand, when I tried the test for multitasking, I was pretty abysmal. I performed worse than people who identify themselves as heavy multitaskers, and those who identify as low multitaskers.

June 29, 2010 » 04:58 PM

I finally got around to trying out the interactive “test your distractability and multitasking” page at the New York Times, which they put up alongside their story earlier this month about how computer distractions are eroding our lives. 

According to the test, I guess I have good focus — I’m not very distractable! 

» visit my Tumblr

Recent Comments

Photos

» see all of my photos on Flickr

Collision Detection: A Blog by Clive Thompson