rbrucecarter5 said:
It still seems, though, that the testing is not scientific.
Sure it is. The objective is to take a proportional and representative sample of the listener base to a station (or a format) and find out, within the format, what songs should be played and not played, and among the former, which should be played the same amount or more or less.
There is no double blind control group. It seems that each station is absolutely determined "I will stay in this active rock format no matter what. I will not play a single song outside of that format.
A music test is kind of like doing monitor points for a directional array; if anything is "off" you make small adjustments afterwards. But you don't change power, you don't change frequency, you don't change transmitter site after doing "points."
What you call a "double blind" is really what is called a "format search." In that process, a number of music genres are evaluated by a broad range of people in a market to see if there is an opening or opportunity. I've done format searches with as few as six alternative music styles tested, and with as many as 17.
But a station does not look for a new format if it is doing well... even just "moderately well". That's because a format change generally causes billings to reset to zero, and you are guaranteed operating losses for the year of the change due to very slowly building revenue and the higher costs of promoting a new format, personnel changes, etc. And you have no guarantee
that the format will work since the concept may be great, but the execution may not attract enough listeners.
I will find the 50 songs that fit my format, and these people will pick them and they will be perfect. I will not program to a single listener below 18 or above 34 - I don't want them. My demographic will be perfect and will match the mold. I will not be guilty on non-conformity.
No, that is not it at all. Let's use a mining analogy... you have a gold mine, and one vein is very productive and the extraction of gold yields a great profit. There are a number of smaller veins that you don't mine, though, because the cost of getting the gold out exceeds the value of the metal extracted and sold.
When radio stations do music research they go for the core listener in a format. Let's say a station is CHR... appealing to 12 to 34 year olds, predominantly females. The core for sales, though, is Women 18-34 and you can't get teen money in radio no matter how hard you try. So you research the 18-34 women, and to make sure the door is open to teens as they mature, and you include some 16 to 18 year olds. And to not be totally negative to men, you bring in males as a third of the 18-34 sample.
We know that CHR has under-16 appeal, and over-34 appeal but we also know that the key is to get the core... both to guarantee sales and to successfully program the station against competition. We know that if we get the 16-34 sample described we will get lots of overflow.
There is no need to sample outside the core because it could be dangerous: some songs that early teens like may be despised by the core and some songs the over-35's do like may be totally negative to the 16-24 segment... so the knowledge of what those songs are is not actionable.
I will present to advertisers the perfect demographic and the perfect play list. Anybody not fitting into my stations mold is strange, outmoded, and does not deserve radio service."
No, it's simpler: anyone who does not like the core songs and core artists of my format is not going to listen anyway, so I won't survey them.
It all sounds a bit totalitarian, dystopic, and completely dominated by a fanatical paranoia about squeezing every last dollar from potential sponsors - the heck with the listener, creativity, and individuality.
Radio stations use ratings to set prices. Agencies use ratings to hammer prices. But the ratings metric more or less determines how much a station can bill.
It's not about "squeezing dollars" at the program side; that is a sales function once you have ratings.
In programming, music research is almost always done to fine tune the existing format. You test the songs you play. You test some songs that you might play. You test some songs the competitor plays. You test a song or two that were in movies just in case. You try to test every song that your listeners would like. The end result is that you know, every time you test, what the core likes, and, using things like cluster / factor analysis, what the subsets of the audience like (here the subsets are not based on age, but on music tastes... an alternative station may have four or five dueling subests and you are looking to form a coalition based on commonalities).
Radio is a push medium, not a pull-based customized Pandora stream or a personal iPod playlist. The hard thing to do today is to produce a blend that is, in the long run, better and easier than the alternatives for many moments in listeners' days and lives. You do that by adjusting the existing product to keep it responsive to listener needs.