General information
The MSG 2022-11 Nationally Representative Batch 20 sample cohort is characterized by the following:
| Batch code | 30 |
| Vendor | MSG |
| Sample description | Nationally representative |
| Date drawn | November 2022 |
| Date of first mailing | January 17, 2023 |
| Batch size | 5000 |
| Experiment(s) | Half received existing invitation letter, half received new version of invitation letter |
Recruitment rates
All the recruitment rates below conform to AAPOR specifications. Please note that the Initial Response Rate reported in table 1 are based on AAPOR RR1. More information about the AAPOR response rates can be found at the Aapor web site.
Mailout and phone follow up of initial survey
The initial mail survey is a standard paper and pencil mail survey, but the respondents are given the option to respond online. The response rate of this is computed like any mail survey.
| Total sample | 5,000 |
| Eligible refusals and noncontacts (R) | |
| Refused to participate | 0 |
| Incomplete interviews | 9 |
| Refusals and noncontacts with unknown eligibility (U) | |
| Nothing returned | 3,886 |
| Unreachable by phone | 0 |
| Ineligible | |
| Undeliverable by mail | 0 |
| Responses (I) | 1,105 |
| Initial Response Rate (I/(I + R + U)) | 22.1% |
Consent to participate
The initial mail survey asks respondents whether they would be interested in participating in the Understanding America Study. Everyone who answers affirmatively and who receives a login code is considered to have provided consent. The recruitment rate is then calculated as the number of people who receive a login code divided by the total number of eligible responses to the mail survey.
| Total sample | 1,105 |
| Eligible refusals and noncontacts (R) | |
| Refused to participate | 378 |
| Refusals and noncontacts with unknown eligibility (U) | 0 |
| Responses (I) | 727 |
| Recruitment Rate (I/(I + R + U)) | 65.8% |
Initial participation
The profile rate (PROR) is the fraction of the individuals who consented who completed My Household and thus became a panel member.
| Total sample | 727 |
| Eligible refusals and noncontacts (R) | |
| Logged on to survey, did not complete any item | 0 |
| Partially completed the My Household survey | 42 |
| Did not log on | 213 |
| Responses (I) | 472 |
| Profile Rate (I/(I + R)) | 64.9% |
Overall recruitment rate
The overall recruitment rate (ORR) is the product of the response rates computed above (initial response rate, recruitment rate, and profile rate):
ORR = IRR * RECR * PROR = 0.221 * 0.658 * 0.649 = 9.4%
Active panel
As in any panel, we monitor attrition. Because individuals often simply stop responding without actively withdrawing from the panel and without us being able to contact them, we adopt the criterion that an individual is considered to be an active panel member if they participated in any survey in the last year (counting back from today, that is, May 27, 2023). A panel member who is not an active panel member but has not been removed yet from the panel is an inactive panel member.
| Total sample | 472 |
| Eligible refusals and noncontacts (R) | |
| Voluntary drop-out | 1 |
| Temporarily unavailable | 0 |
| Individuals removed for miscellaneous reasons | 0 |
| Refusals and noncontacts with unknown eligibility (U) | |
| Inactive panel member | 46 |
| Ineligible | |
| Deceased | 0 |
| Ineligible for another reason | 0 |
| Responses (I) | 425 |
| Retention Rate (I/(I + R + U) | 90% |
Cumulative response rate
The cumulative response rate (CUMRR) up to and including retention is the product of the response rates computed above (initial response rate, recruitment rate, profile rate, and retention rate):
CUMRR = IRR * RECR * PROR * RETR = 0.221 * 0.658 * 0.649 * 0.9 = 8.5%