michael hagerty said:
C: Auditorium tests are an effective way of asking your desired audience what they do and don't want to hear.
Here's an anecdote.
When I did my first music test over 30 years ago, I decided I would take the list and score the songs based on my "gut feel" for how good they were and how much I thought listeners liked them.
Now, this was a station doing a Hot AC format that was #1 in 18-49 Women in a 30+ station market. It had a 12 share in 12+, too. It was way ahead of anything else in a comparable format.
When I got the results, I was within 10% of the "real score" on less than a quarter of the songs. I incorrectly identified about 25% of the songs as passable hits when they were, in fact, toxic and negative.
Obviously, the ratings improved after the test. And I discarded all the crap about "golden ear" PDs I had heard for two decades.
We used testing to launch an FM format flip a bit later, and got as high as a 33.5 share in that same market in one survey and a 42 share with a separate company.
It's really a lot better when the listeners tell you what they like. I thought I knew, but I really didn't... it was just the radio ego trip thing and it was dangerous.