RIN3GUY said:
So just what are these music testing companies, and how many of them are there? I want to apply to work for them! Their scientific theories and methodologies may need to be scrutinized, questioned and reevaluated, and I wonder if there is variation between the way different companies conduct testing and tabulate the results they hand over to stations.
There are several dozen companies that do this kind of testing for radio stations; they also do perceptual testing, format searches, talent one-on-ones, focus groups, etc. Some also do "call-out" research on currents (although the use of phones is being changed for outbound recruited web-based testing).
The people at those companies are skilled researchers, with knowledge of statistics, polling, etc. They use specialized software like Cornerston's Analyst to tabulate the individual responses, and can produce results sorted, ranked or classified in many ways.
Neither radio stations nor the research companies need "scrutiny" by someone whose first assertion on this thread was that sampling less than 1% of a universe is invalid.
It's sort of like trying to explain that tons of aluminum and plastic should not be able to fly without taking a look at the Bernoulli Effect and the specific properties of the Earth's atmosphere.
For example, how much of an unfamiliar song gets heard when it is tested?
Song hooks are generally about 8 seconds long. When electronic measurement ("dials") are
used, most people enter their score within the first 5 to 6 seconds. If the song is unfamiliar, they indicate (a button on dials, a "tick box" on a paper scored test) that they don't know it; this response is faster and more immediate than the process of deciding how much we like or don't like a familiar song.
And just how long would it take for a group of people to test 1200 songs if there are a couple hundred or more that because of lack of airplay exposure they are unfamiliar with??
Two 2 1/2 hour sessions for an "in person test". A finite number of days is given if web testing is used. On the web, the hooks that can be heard are longer but there as soon as a person votes, it moves on. 5 seconds to 6 seconds is all it takes for most songs. People give unfamiliar songs even less time as they
know they don't know the song so the decision is easier than deciding on a 1 to 100 score.
Stations seldom test songs that don't have sufficient airplay. In a gold based format, they would not test an unplayed song, ever. In current based formats, generally enough play so regular listeners to the station would have heard a song 5 to 7 times will start to produce meaningful results.
However, many stations "test" currents by means of Media MOnitors "M Score" which shows how PPM meter panelists react to the song over many plays in different times and dayparts. Negative reaction which does not move towards positives means a song is killed.
Dismissing or downgrading a song simply because it is initially unfamiliar is an unacceptable way to conduct a test, IMO. Every song has to be new and untried sometime, particularly with younger audiences.
We are talking about Classic Hits stations. The keyword is "hits". That means unless a song had, initially and years ago a lot of exposure, it ain't a classic hit.
Those of us in radio know what happens when a station plays loads of unfamiliar or low scoring songs. It's ugly, and people get fired and formats get changed.