Saturday, November 16,
2002
|
|
7:00 - 9:00 a.m.
|
Breakfast (for hotel registrants) |
|
Atrium - Embassy Suites Hotel |
|
| |
|
|
8:00 a.m.- 5:00 p.m.
|
REGISTRATION |
|
Room 14 |
|
|
| |
|
|
14. |
Invited Session: Beyond Cognitive
Interviewing: Split-Sample Comparisons |
|
9:00 - 10:30 a.m.
Room 12/13 |
Chair: Mick Couper, University of Michigan, USA |
| |
|
| |
Getting Beyond Pretests and Cognitive
Interviewing: The Case for More Split-ballot Pilot Studies
Jack Fowler,
University of Massachusetts,
Center for Survey Research, USA |
| |
|
| |
The SIPP Methods Panel Project: Using Field Experiments to Improve
Instrument Design
Jeff Moore, Joanne Pascale, Julia Klein Griffiths, Anna Chan and Pat
Doyle, U.S. Census Bureau |
| |
|
| |
Discussant: Dan Kaspryzk, Mathematica Policy Research, USA |
| |
|
|
15. |
Invited Session: Questionnaire Development in
Specific Domains |
|
9:00 - 10:30 a.m.
Room 10 and 11 |
Chair: Diane O'Rourke Consultant, USA |
| |
|
| |
Development and Testing of Internet Questionnaires
Reginald Baker and Scott Crawford, MSInteractive |
| |
|
| |
Children as Respondents: Developing, Evaluating, and Testing
Questionnaires for Children
Edith de Leeuw and Natacha Borgers, Utrecht University, The Netherlands
Astrid Strijbos-Smits, Statistics Netherlands |
| |
|
| |
Discussant: Sandra Berry, Rand Corporation, USA |
| |
|
|
16. |
Contributed Session: Establishment Survey QDET
Methods: Issues and Current
Practices Around the
World - I |
|
9:00 - 10:30 a.m.
Room 8 and 9 |
Chair: Fran Featherston, National Science Foundation, USA |
| |
|
| |
Experiences Implementing Establishment Survey Questionnaire Development
and Testing at Selected U.S. Government Agencies
Karen Goldenberg,
U. S. Bureau of Labor Statistics
Amy Anderson and
Diane Willimack,
U.S. Census Bureau
Stanley Freedman and
Robert Rutchik, U.S. Energy Information
Administration
Luann Moy,
U.S. General Accounting Office |
| |
|
| |
Establishment Survey Instrument Development and Testing in an Integrated
Survey Environment at Statistics Canada
Frances Laffey, Statistics Canada |
| |
|
| |
Discussant: Clyde Tucker, U.S. Bureau of Labor Statistics |
| |
|
|
10:30 - 10:45 a.m. - BREAK
Convention Center Second Floor Foyer |
|
|
10:45 a.m. - 12:15 p.m.
Poster Session
Rooms 4 and 5 |
| |
|
|
A. |
Evaluating Questionnaire Revisions in a Survey
of Immunization Providers |
| |
Katherine Ballard-LeFauve |
| |
Lee Giesbrecht |
| |
and Elizabeth Anderson |
| |
Abt Associates, USA |
| |
|
|
B. |
Questionnaire Development by Using Semi-structured
and Cognitive Interviews |
| |
Mary Boynton (scb) |
| |
|
|
C. |
National Foreign Language Assessment and
Linguistic Diversity: The FL-NAEP Language Survey and Background
Questionnaire and the Case of "Heritage" Spanish Language Students in the
U.S. |
| |
Katherine Richardson Bruna |
| |
Michael Fast |
| |
and Nina VanDyke |
| |
American Institutes for Research, USA |
| |
|
|
D. |
Reformatting a Self-administered Questionnaire Based
on Item Nonresponse |
| |
Fran Chevarley (AHRQ) |
| |
|
|
E. |
Do Cognitive Interviews Improve Education Surveys |
| |
Young Chun |
| |
and Kevin Carter |
| |
American Institutes for Research, USA |
| |
|
|
F. |
Web Survey Comments: Does Length Impact Quality? |
| |
Carrie Christianson DeMay |
| |
Jonathan Kurlander |
| |
Kristofer Fenlason |
| |
Data Recognition Corporation, USA |
| |
|
|
G. |
Using Cognitive Follow-up Interviews to Develop the
2002 Census of Agriculture Report Form |
| |
Nancy Dickey |
| |
and Zulma Riberas |
| |
U.S. National Agriculture Statistical Service |
| |
|
|
H. |
Developing Measures of a Complex Theory of Brand
Loyalty for Use on the Internet |
| |
Jean Durall |
| |
and Melinda Smith de Borrero |
| |
Knowledge Networks, USA |
| |
|
|
I. |
An Application of the Three Step Test-Interview (TSTI):
A Validation Study of the Dutch and Norwegian Versions of the Illegal
Aliens Scale |
| |
Tony Hak |
| |
Kees van der Veer |
| |
and Reidar Ommundsen |
| |
|
|
J. |
The Use of Constrastive Questions: Effects and
Solutions |
| |
Bregie Holleman |
| |
and Huub van den Bergh |
| |
|
|
K.
|
Quest, A Generic XML-and Metadata-Based
Questionnaire Management System |
| |
Wolfgang Koller |
| |
and Guenther Zettl (Statistik) |
| |
|
|
L.
|
Developing Questions to Measure the
Victimization of Developmentally Disabled Respondents in the National
Crime Victimization Survey |
| |
Denise Lewis |
| |
and Kathleen Creighton |
| |
U.S. Census Bureau |
| |
|
|
M. |
Development of a Multitrait Scaling Macro: A
Construct Validity Tool |
| |
Louise Hiller |
| |
and Roger Holder |
| |
University of Birmingham, UK |
| |
|
|
N.
|
Measuring Barriers to Employment:
Development and Evaluation Questionnaire |
| |
Daniel McMillin |
| |
Edwin Sasaki |
| |
Laura Hecht |
| |
and Kenneth Nyberg (csubak) |
| |
|
|
O. |
A Cognitive Analysis of
Passionate Love |
| |
Victor de Munck ( Bestweb) |
| |
|
|
P. |
Improving Mail Surveys of
Establishments: Testing the Effect of Incentives on Questionnaire
Completion and Data Quality |
| |
Danna Moore |
| |
and John Tarnai |
| |
Washington State University, USA |
| |
|
|
Q. |
Use of Focus Groups in
Questionnaire Design |
| |
Melvin Prince |
| |
and Mark Davies |
| |
|
|
R. |
Cognitive Laboratory Experiences: On Pre-testing
Computerized Questionnaires and Data Quality |
| |
Ger Snijkers |
| |
Statistics Netherlands |
| |
|
|
S. |
Tradeoffs and Rating Scales: How They Compare in
Measuring the Priorities of Diverse Populations |
| |
Nathaniel Stone (Communication.gc) |
| |
|
|
T. |
How Good is Good? Comparing
Numerical Ratings of Response Options for Two Versions of the
Self-Assessed Health Statistics Question |
| |
Barbara Foley Wilson |
| |
Barbara Altman |
| |
and Karen Whitaker |
| |
U.S. National Center for Health Statistics |
| |
|
|
U. |
Comparing open-ended and closed-ended questions |
| |
Merlijn Wouters |
| |
|
|
12:15 - 2:00 p.m.
Conference Luncheon
Atrium - Embassy Suites Hotel |
| |
|
|
18. |
Invited Session: Comparisons of Question Evaluation
Methods
|
|
2:00 - 3:30 p.m.
Room 12 and 13 |
Chair: Jennifer Rothgeb, U.S. Census Bureau, USA |
| |
|
| |
Does Question Pretesting Make a Difference? An Empirical Test Using a
Field Survey Experiment?
Barbara Forsyth, Westat, Inc. USA
Jennifer Rothgeb, U.S. Census Bureau
Gordon Willis, National Cancer Institute, National Institutes of Health,
USA |
| |
|
| |
Procedures for Testing Self-Administered Questionnaires: Cognitive
Interview and Field Test Comparisons
Don Dillman, Washington State University, USA
Cleo Redline, National Science Foundation, USA |
| |
|
| |
Discussant: Pamela Campanelli, Survey Methods Consultant, U.K. |
| |
|
|
19. |
Contributed
Session: Assisting the Respondent in the Recall Task: Methods and
Results |
|
2:00 - 3:30 p.m.
Room 10 and 11 |
Chair: Stanley Presser, University of Maryland, USA |
| |
|
| |
Calendar Survey Methods: Association Between Verbal Behaviors and Data
Quality
Robert Belli, University of Nebraska, USA |
| |
|
| |
The Time-line: The Effects of an Experimental Aided Recall Technique in a
Real Life Survey
Wander van der Vaart, Vrije University, Amsterdam |
| |
|
| |
Relating Questionnaire Design to Survey Accuracy And Response Rate With
RGI
S. James Press, University of California at Riverside, USA
Judith Tanur, State University of New York at Stony Brook, USA |
| |
|
| |
Discussant: Paul Biemer, RTI - International, USA |
| |
|
|
20. |
Contributed Session: Establishment Survey QDET
Methods: Issues and
Current Practices Around the
World - II
|
|
2:00 - 3:30 p.m.
Room 8 and 9 |
Chair: Karen Goldenberg U.S. Bureau of Labor Statistics |
| |
|
| |
Expert Review Followed by Interviews with Editing Staff — Effective First
Steps in the Testing Process for Business Surveys
Olwen Rowlands, Jack Eldridge and Sarah Williams, Office for National
Statistics, U.K.
|
| |
|
| |
The Review of the French Survey on R&D in Business Enterprises
Dominique Francoz, Ministry of Youth, Education, Research and New
Technologies, France
|
| |
|
| |
Coherence Analysis as a Tool for
Questionnaire Evaluation in Enterprise Statistics
Johan Erikson, Statistics Sweden |
| |
|
| |
Discussant: Cynthia Clark, U.S. Census Bureau |
| |
|
|
21. |
Contributed Session: Special
Populations
|
|
2:00 - 3:30 p.m.
Room 7 |
Chair: Margaret Africa, Statistics South Africa |
| |
|
| |
What Types of Survey Items Can Elicit Valid Responsesfrom Fourth and
Eighth Grade Students? Mette Huberman and Roger Levine |
| |
|
| |
Minimizing Item Non Response in Telephone Surveys of People with
Disabilities
Karen CyBulski, Julie Fishtein, and Anne Ciemnecki, Mathematica Policy
Research, USA |
| |
|
| |
Discussant: Edith de Leeuw, Utrecht University, the Netherlands |
| |
|
|
3:30 - 3:45 p.m.
Break
Convention Center Second Floor Foyer |
| |
|
|
22. |
Invited Session: Case Studies Using
Multiple Methods for Questionnaire Evaluation |
|
3:45 - 5:15 p.m.
12 and 13 |
Chair: Karen Bogen, Johns Hopkins University, USA |
| |
|
| |
Improving the Clarity of Closely Related Concepts
Nora Cate Schaeffer and Jennifer Dykema, University of Wisconsin-Madison,
USA |
| |
|
| |
Design, Testing and Evaluation of Stated Preference Questionnaires
Michael Kaplowitz, Frank Lupi, and John Hoehn, Michigan State University,
USA |
| |
|
| |
Discussant: Rachel Casper, RTI - International, USA |
| |
|
|
23.
|
Contributed Session: Methods and
Issues in Developing Multilanguage, Multicultural Questionnaires
|
|
3:45 - 5:15 p.m.
10 and 11 |
Chair: Elizabeth Martin, U.S. Census Bureau |
| |
|
| |
Developing Bilingual Questionnaires For Use in an Indigenous Population:
Experiences From New Zealand in The Development of The 2001 Maori Language
Survey
Lyn Potaka and Suzanne Cochrane, Statistics New Zealand |
| |
|
| |
Issues in Translating Surveys: Methods and Approaches
Sylvia Kay Fisher, U.S. Bureau of Labor Statistics
Eleanor Gerber, U.S. Census Bureau |
| |
|
| |
Questionnaire Translation and Questionnaire Design
Janet A. Harkness, ZUMA, Germany
Alisú Schoua-Glusberg,
Beth-Ellen Pennell, University of Michigan,USA |
| |
|
| |
Discussant: Manuel de la Puente, U.S. Census Bureau |
| |
|
|
24.
|
Contributed Session: Cognitive
Interviewing Methods - I |
|
3:45 - 5:15 p.m.
8 and 9 |
Chair: Kristen Hughes, U.S. Census Bureau |
| |
|
| |
Not Your Grandparent's Cognitive Testing: Exploring Innovative Methods in
Making Cognitive Evaluation of Questions More Efficient and Easier to Use
Carol Cosenza, University of Massachusetts-Boston, USA
|
| |
Cognitive Laboratory Methods: Current Best Practices
Gers Snijkers, Statistics Netherlands |
| |
|
| |
The Three-Step Test-Interview (TSTI)
Kees van der Veer, Vrije University, Amsterdam, the Netherlands
Tony Hak, U.S. Census Bureau
Harrie Jansen, Addiction Research Institute, the Netherlands |
| |
|
| |
Discussant: Cleo Redline, National Science Foundation, USA |
| |
|
|
25.
|
Contributed Session: Internet - II |
|
3:45 - 5:15 p.m.
Room 7 |
Chair: Fred Conrad, University of Michigan, USA |
| |
|
| |
Satisfaction Scales in a CAWI Survey on University Teaching Evaluation
Luigi Fabbris, University of Padua, Italy |
| |
|
| |
Using the Multimedia Capabilities of Web-enabled Probability-based Survey
Methodology to Gather Vaccination Information for the National
Immunization Program
William McCready, Michael Dennis and Lisa Thalji, Knowledge Networks,USA |
| |
|
| |
Web as Questionnaire Designing Tool: Is There a Limit?
Katja Lozar Manfreda, University of Ljubljana,
Valentina Hlebec and Vasja Vehovar |
| |
|
| |
Discussant: Dianne Anderson, Iowa State University, USA |
| |
|
|
Sunday, November 17, 2002 |
| |
|
|
8:00 a.m.- 12 noon
|
REGISTRATION |
|
Convention Center Second Floor Foyer |
|
|
8:00 - 8:45 a.m.
|
Breakfast |
|
Atrium, Embassy Suites Hotel (for registered guests) |
|
| |
|
|
| |
|
|
26. |
Invited Session: International Issues in
Questionnaire Development |
|
9:00 - 10:30 a.m.
12 and 13 |
Chair: Lilli Japec |
| |
|
| |
Evolution And Adaptation of Questionnaire Development, Evaluation And
Testing Methods in Establishment Surveys
Diane Willimack, U.S. Census Bureau
Lars Lyberg, Statistics Sweden
Jean Martin, Office for National Statistics, U.K.
Lilli Japec, Statistics Sweden
Patricia Whitridge |
| |
|
| |
Developing Cross-National Survey Instruments
Tom Smith, NORC, University of Chicago, USA |
| |
|
| |
Discussant: Gustav Harldsen, Statistics Norway |
| |
|
|
27. |
Contributed Session: Cognitive Interviewing Methods
- II |
|
9:00 - 10:30 a.m.
10 and 11 |
Chair: Ashley Landreth |
| |
|
| |
A Comparison of Focus Group and One-on-one Cognitive Interviewing for
Questionnaire Evaluation
Kristen Miller, U.S. National Center for Health Statistics |
| |
|
| |
Interviewer Debriefing by E-mail
Birgit Henningsson, Statistics Sweden |
| |
|
| |
Pretesting the American Time Use Survey
Lisa Lee and Catherine Haggerty, NORC. USA
Diane Herz and Lisa Schwartz, U.S. Bureau of Labor Statistics |
| |
|
| |
Discussant: Ger Snijkers, Statistics Netherlands |
| |
|
|
28. |
Invited/Contributed Session: Interaction Analysis,
Question Sequencing, and Behavior Coding to Improve Questionnaire
Performance |
|
9:00 - 10:30a.m.
8 and 9 |
Chair: Jim Esposito |
| |
|
| |
The Diagnostic Approach: Evaluating Survey Questions by Analyzing Patterns
of Behavior Codes and Transcripts of Question-answer Sequences
Johannes van der Zouwen and Johannes H. Smit, Vrije Universiteit,
Amsterdam |
| |
|
| |
Evaluating Questionnaires by Analyzing Question-answer Sequences
Wil Dijkstra and Yfke Ongena, Vrije Universiteit, Amsterdam |
| |
|
| |
What's the Interviewer Have to Do with It?: Interviewer Behavior and
Response Rates
Kathryn Downey-Sargent, Elisha Smith, Barbara O'Hare, The Arbitron
Company, USA |
| |
|
| |
Discussant: Nora Cate Schaeffer, University of Wisconsin |
| |
|
|
29. |
Contributed Session: Technical
Documentation |
|
9:00 - 10:30
a.m.
Room 7 |
Chair:
Debbie Collins, U.K. |
| |
|
| |
On the Documentation and Analysis of Electronic Questionnaires
Jelke Bethlehem and Anco Hundepool, Statistics Netherlands |
| |
|
| |
New Tools for the Documentation of Questionnaire Development
Frauke Kreuter, UCLA, USA
Rainer Schnell, University of Konstanz, Germany |
| |
|
| |
Discussant: Patricia Doyle, U.S. Census Bureau |
| |
|
|
10:30 -10:45 a.m.
Break
Convention Center Second Floor Foyer |
| |
|
|
30. |
Invited Session: Statistical Methods for Developing
and Evaluating Questionnaires |
|
10:45 a.m. - 12:15 p.m.
Room 12 and 13 |
Chair: Jana Asher, Carnegie Mellon University, USA |
| |
|
| |
A Scientific Approach to Questionnaire Development
William Saris, William van der Veld, Irmtraud Gallhofer and Irmgard Corten,
University of Amsterdam, The Netherlands |
| |
|
| |
The Use of Latent Class Analysis for Identifying Flawed Questions
Paul Biemer, RTI-International, USA |
| |
|
| |
Discussant: Colm O’Muircheartaigh, NORC, University of Chicago, USA |
| |
|
|
31. |
Contributed Session: Innovative Methods
from the Netherlands and Israel |
|
10:45 a.m. - 12:15 p.m.
10 and 11 |
Chair: Nancy Mathiowetz, JPSM, University
of Maryland |
| |
|
| |
How to Investigate Interaction Patterns Between Partners in a Large-scale
Survey: the Development of the Dutch Family Monitor
Dirkjan Beukenhorst and Deirdre Giesen, Statistics Netherlands |
| |
|
| |
Informed Consent: The Assessment of Competency in Elderly Persons with
Cognitive Impairments
Johannes Smit, , Astrid Vellinga, Evert van Leeuwen, Willem van Tilburg,
and Cees Jonker,
Vrije University, Amsterdam, the Netherlands |
| |
|
| |
Interrater Reliability in an Imperfect Field Setting
Dror Walk, Rachel Fleishman, Gad Mizrahi, and Miriam Bar-Giora, JDC-Brookdale
Institute of Gerontology and Human Development, Israel |
| |
|
| |
Discussant: Peter Mohler, ZUMA, Germany |
| |
|
|
32. |
Contributed Session: Dependent Interviewing |
|
10:45 a.m. - 12:15 p.m.
Room 8 and 9 |
Chair: Johannes van der Zouwen, Free University, The Netherlands |
| |
|
| |
Pre-printing Effects in Official Statistics, an Experimental Study
Anders Holmberg, Statistics Sweden |
| |
|
| |
Alternative Methods for Exploring Confidentiality Issues Related to
Dependent Interviewing
Joanne Pascale, Thomas Mayer and Julia Klein Griffiths, U.S. Census Bureau |
| |
|
| |
Survey Design Techniques for Web Interviews
Adriaan Hoogendoorn, Free University, The Netherlands |
| |
|
| |
Discussant: Eleanor Singer, University of Michigan, USA |
| |
|
|
12:15 - 2:00 p.m.
Conference Luncheon or Box Lunch
Atrium - Embassy Suites Hotel |
| |
|