• Get involved.
    We want your input!
    Apply for Membership and join the conversations about everything related to broadcasting.

    After we receive your registration, a moderator will review it. After your registration is approved, you will be permitted to post.
    If you use a disposable or false email address, your registration will be rejected.

    After your membership is approved, please take a minute to tell us a little bit about yourself.
    https://www.radiodiscussions.com/forums/introduce-yourself.1088/

    Thanks in advance and have fun!
    RadioDiscussions Administrators

L.A. TIMES Article: Arbitron PPM Vs. Diary Measurement

This is not news.
But I do get squirmy when the tail is wagging the dog.
Some of the biggest names in the business are saying here "well this company that we pay millions a year to measure audiences has changed the way they measure therefore we need to adjust the way we program. Still doesn't sit well with me.
I do agree with Liberman. Too small a sample.
 
Buckethead said:
This is not news.
But I do get squirmy when the tail is wagging the dog.
Some of the biggest names in the business are saying here "well this company that we pay millions a year to measure audiences has changed the way they measure therefore we need to adjust the way we program. Still doesn't sit well with me.
I do agree with Liberman. Too small a sample.

Of course, it was radio that indicated a change in Arbitron was needed. Advertisers wanted faster measurement, some form of electronic passive measurement and a measurement of impressions. Radio supported Arbitron's development, going back to the early 90's, of the PPM

The cost of maintaining a panel and using electronic measurement resulted in station's paying about 60% more for PPM; it is unlikely that sample size will increase to any useful extent.
 
The article stated that, on average, 2,800 people carry the meters and are recorded each month. How does this compare to the diaries? Is it a large or smaller sample?
 
justpassingthough said:
The article stated that, on average, 2,800 people carry the meters and are recorded each month. How does this compare to the diaries? Is it a large or smaller sample?

The sample can't be compared.

LA had about 7000 diaries per 12 week rating survey, or around 600 per week. The PPM has around 3000 meters in daily use, every day, all year. That's 3000 for a day, or for a week, or for a month or for a year.

An individual day or week has 5 times as many meters as there were diaries. A month has twice as many... but there were about 25,ooo diaries tabulated each year.

The PPM is a panel... people stay on for up to two years. The diary was a weekly sample, with no continuity. So it is hard to compare panels with new, finite samples each week.

In either case, the sample is as large as the client base can afford. We will not see it increase anytime soon by any significant number (10% is not a real sample increase... to reduce margin of error to any degree, it takes 50% to 100% sample increases [and I have painfully simplified this observation]).
 
Excuse my ignorance if this has been beaten to death in a thread I've either conveniently forgotten about or have never read (nor researched) but are the people selected for PPM data collection chosen completely by random or is there a pool of knowingly interested participants it's drawn out of? I've been selected for diary work in the past when that was the norm on several occasions (both TV and radio) but have never been contacted to wear the PPM meter.

No conspiracy theory, just curiosity.
 
Robnoxious said:
Excuse my ignorance if this has been beaten to death in a thread I've either conveniently forgotten about or have never read (nor researched) but are the people selected for PPM data collection chosen completely by random or is there a pool of knowingly interested participants it's drawn out of? I've been selected for diary work in the past when that was the norm on several occasions (both TV and radio) but have never been contacted to wear the PPM meter.

The PPM is a panel based system or methodology. The panel is, in theory, about 3000 persons in LA; recruitment is by household/dwelling unit and not by individual. A family can remain on the panel for up to two years, but if any member is non-compliant the entire household is removed. Incentives are given for the hours in use for each meter in a household, determined by the motion detector in each meter.

Recruitment is a combination of phone calls and, of recent, in person recruitment. A percentage of the panel is recruited from Cell Phone Only (CPO) households. Prerecruitment procedures may include a letter to the home with a web link for further information. Households are recruited in proportion to a set of what are called stratification variables. The simplest is that if 43% of the market is Hispanic, the same percentage of panelists will be Hispanic. In addition to ethnicity, the panel is close to a precise mirror on age cells, gender, geographical distribution, and a dozen or so other factors such as income. In the major Hispanic markets, the sample is balanced for those who are English and those who are Spanish dominant.

A new twist is something called GeoZones, rolling out now. The total survey metro (LA and Orange counties in this case) is divided into many, many zones and each is sampled proportional to population, age distribution, ethnicity, etc.

Arbitron draws its recruit lists as close to random as possible (in accordance with the concept of a random probability sample) within the constraints of probability. Address based recruiting is part of the procedure to insure that unlisted homes are included as well.

While there is no pool of respondents, Arbitron knows that the panel will turn over abut 8% a month and thus they are always recruiting. A household that leaves is replaced with another household with similar characteristics, so Arbitron is always looking for new recruits.
 
Maybe it's just laziness on Arbitron's part, but it seems too high a premium on the multi-member households.
It's easier to reach 3000 when you shoot for 5 member homes instead of one member homes.
The 30-40 year old single professionals with a higher disposable income are systematically discarded from the start.
Do you not suppose the tendency toward multi-member family panelists skews the numbers?

How can it not skew the numbers?

Most of my friends are single upper income professionals with no children. None of them listen to KISS FM. Their tastes are not reflected by the PPM. And Arbitron is not interested in measuring a single member household.
A house full of kids and teens and young 20's, well KISS FM makes sense, and a houseful of people is what Arbitron wants to measure.

KUSC is doing well because it makes good background music at stores and in homes where mommies are trying to get their babies to take a nap.
Huge TSL.

Its not about what people are listening to, it's about what people are carrying meters.

I am however encouraged by the GeoZones effort.
That has been a major flaw in the past where a station does not show up at all in certain zip codes where they do in fact have listeners.
 
Buckethead said:
Maybe it's just laziness on Arbitron's part, but it seems too high a premium on the multi-member households.
It's easier to reach 3000 when you shoot for 5 member homes instead of one member homes.
The 30-40 year old single professionals with a higher disposable income are systematically discarded from the start.
Do you not suppose the tendency toward multi-member family panelists skews the numbers?

How can it not skew the numbers?

Most of my friends are single upper income professionals with no children. None of them listen to KISS FM. Their tastes are not reflected by the PPM. And Arbitron is not interested in measuring a single member household.
A house full of kids and teens and young 20's, well KISS FM makes sense, and a houseful of people is what Arbitron wants to measure.

KUSC is doing well because it makes good background music at stores and in homes where mommies are trying to get their babies to take a nap.
Huge TSL.

Its not about what people are listening to, it's about what people are carrying meters.

I am however encouraged by the GeoZones effort.
That has been a major flaw in the past where a station does not show up at all in certain zip codes where they do in fact have listeners.

Above is situational, though. Most of my friends are in their 30s, upper income professionals, no children, etc and we listen to KIIS, along with KAMP, KROQ, KYSR, KPWR. A survey of just your friends would be the most flawed survey ever. Most people assume that what they like and what their friends like is popular (unless you're a hipster and you hope the opposite is true).

It is encouraging to see they're trying to use GeoZones to rectify some of the problems with the survey, though.
 
Alright point taken. My friends and I must live in an area that until GeoZoning has not been getting measured in proportion to the population. Because if it had been then our station of choice would have registered on PPM in our zip code. Perhaps if that accuracy had been in place when the PPM was implemented then perhaps the format wouldn't have changed.
This gets to my point about the tail wagging the dog.
 
Buckethead said:
Maybe it's just laziness on Arbitron's part, but it seems too high a premium on the multi-member households.

There is no premium on multi-member households / dwelling units. The proportion of single member households in the market should be in accordance with the proportion in the sample.

The 30-40 year old single professionals with a higher disposable income are systematically discarded from the start.

In LA, with 12-39 being over 50% Hispanic, the percentage of over-30's in a single household is likely very small, and of itself not a significant factor in radio ratings.

Most of my friends are single upper income professionals with no children.

As has been pointed out, you are discussing your group of friends, not the universe in LA. If we use our personal anecdotal evidence, all surveys would be wrong. I, for example, can't think of one 30-something who lives alone now or in the recent past, save for the occasional temporarily un-partnered person who fairly quickly remedied that situation. Yet I know they exist; they even do sitcoms about them!

None of them listen to KISS FM.

Kiss-FM is targeted at 18-34 females, and probably does not even consider the group you speak of in that it is likely not mainstream in LA, and likely an area where rather eclectic or, at lest, non-mainstream tastes are prevalent.

Their tastes are not reflected by the PPM.

If you read from the bottom up, they certainly are.

And Arbitron is not interested in measuring a single member household. A house full of kids and teens and young 20's, well KISS FM makes sense, and a houseful of people is what Arbitron wants to measure.

"Household" and "dwelling unit" are used together or "dwelling unit" is used alone. Perhaps it is my error in using the easier-to-type "household" predominantly. In any case, the definition is simply a place where one or more people resides, and that is what Arbitron seeks. In fact, for panel administration, a single person is easier to manage as individual behaviour does not cause a whole group of people to be cut from the panel as it would in a multi-person unit.

When I spoke about recruitment being at the household / dwelling unit level, that does not exclude single member "families" or dwelling unit occupants. The point is that everyone living in a unit, whether 1 or 15, must participate or nobody participates... all recruitment is based on "everyone who is there" and a single individual at a multi-person household / du will not be recruited alone.

KUSC is doing well because it makes good background music at stores and in homes where mommies are trying to get their babies to take a nap. Huge TSL.

Among 18-49, where the mom's of babies would virtually all be, KUSC ranks 52nd in TSL. That's about 40% below the median TSL.

Its not about what people are listening to, it's about what people are carrying meters.

It's always been about the participant in ratings, whether metered or holding a diary or the recipient of a phone call or a knock on the door, going back to the 30's.

I am however encouraged by the GeoZones effort.
That has been a major flaw in the past where a station does not show up at all in certain zip codes where they do in fact have listeners.

A zone does not guarantee that any individual ZIP code will have meters, although groups of ZIPs with comparable characteristics (ethnicity, age distribution, income / property values, etc.) will be grouped to form zones. with 3000 meters, at about 3 to 4 per household (whatever the average is) there are more ZIPs than dwelling units sampled, so some ZIPs will have zero measurement.
 
justpassingthough said:
DavidEduardo, thanks for your contributions and for always explaining the convoluted crap to those of us not in the know!

Thank you for the props. It's tough to try to condense what we know as The Purple Book, which is the Description of Metodology, into a few paragraphs and I'm glad that the "view from 30,000 feet" is useful.
 
Status
This thread has been closed due to inactivity. You can create a new thread to discuss this topic.


Back
Top Bottom