The UAS uses multiple approaches to ensure high quality data. Surveys include checks for implausible answers and inconsistencies in the programmed questionnaires. UAS researchers make generous use of randomizations, which both serve to detect possible order effects as well as straightlining. In addition, we record question timings for each survey that may be used to detect speeding.

From time to time, the UAS helpdesk receives and rejects requests from individuals who are not qualified to join the panel because they live in a household that was not selected in our recruitment sample (e.g. a friend of a participant who does not live at the same address). To ensure adherence to our sampling protocol, UAS participants who request to add additional household members to the panel (members not included in the initial household enumeration) are required to provide evidence that the individual lives at the selected sample address. In addition, UAS staff regularly verify addresses to mail information and items to participants. If a participant address does not match the household address, an inquiry is made and action taken if necessary.

There are other threats to data quality which are also rare, and for these situations we have created the Data Flag File. Very occasionally the UAS has removed participants, or participant data, from the UAS to protect data quality. One example is a participant who began helpfully doing surveys for themselves and their spouse when the spouse’s health began to decline. Another example was a participant who did not speak English or Spanish, so another household member had been translating for them. In cases like these, which affect data quality, the UAS takes action to correct the situation, educates participants, and closes accounts as needed. When compromised data can be removed from the system, we do so. However, historical survey data files and data products may still include data contributed by these individuals. For this reason, researchers working with existing UAS data are encouraged to use the Flag File to identify any data that has been flagged for removal.

The Flag File includes the relevant UASID, as well as the period in which the problem occurred (if no period is provided, this indicates that the respondent's data should be ignored in its entirety; if only a start date is provided, all respondent's data on or after that date should be ignored). This allows investigators to identify surveys that were and were not affected.

Download Flag File (coming soon)