{"product_id":"advances-in-questionnaire-design-development-evaluation-and-testing-isbn-9781119263623","title":"Advances in Questionnaire Design, Development, Evaluation and Testing","description":"\u003cp\u003e\u003cb\u003eA new and updated definitive resource for survey questionnaire testing and evaluation\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003eBuilding on the success of the first Questionnaire Development, Evaluation, and Testing (QDET) conference in 2002, this book brings together leading papers from the Second International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2) held in 2016.  The volume assesses the current state of the art and science of QDET; examines the importance of methodological attention to the questionnaire in the present world of information collection; and ponders how the QDET field can anticipate new trends and directions as information needs and data collection methods continue to evolve.\u003c\/p\u003e \u003cp\u003eFeaturing contributions from international experts in survey methodology, \u003ci\u003eAdvances in Questionnaire Design, Development, Evaluation and Testing\u003c\/i\u003e includes latest insights on question characteristics, usability testing, web probing, and other pretesting approaches, as well as:   \u003c\/p\u003e \u003cul\u003e \u003cli\u003eRecent developments in the design and evaluation of digital and self-administered surveys\u003c\/li\u003e \u003cli\u003eStrategies for comparing and combining questionnaire evaluation methods\u003c\/li\u003e \u003cli\u003eApproaches for cross-cultural and cross-national questionnaire development\u003c\/li\u003e \u003cli\u003eNew data sources and methodological innovations during the last 15 years\u003c\/li\u003e \u003cli\u003eCase studies and practical applications\u003c\/li\u003e \u003c\/ul\u003e \u003cp\u003e\u003ci\u003eAdvances in Questionnaire Design, Development, Evaluation and Testing\u003c\/i\u003e serves as a forum to prepare researchers to meet the next generation of challenges, making it an excellent resource for researchers and practitioners in government, academia, and the private sector. \u003c\/p\u003e \u003cp\u003eList of Contributors xvii\u003c\/p\u003e \u003cp\u003ePreface xxiii\u003c\/p\u003e \u003cp\u003e\u003cb\u003ePart I Assessing the Current Methodology for Questionnaire Design, Development, Testing, and Evaluation 1\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e\u003cb\u003e1 Questionnaire Design, Development, Evaluation, and Testing: Where are We, and Where are We Headed? 3\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eGordon B. Willis\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e1.1 Current State of the Art and Science of QDET 3\u003c\/p\u003e \u003cp\u003e1.2 Relevance of QDET in the Evolving World of Surveys 11\u003c\/p\u003e \u003cp\u003e1.3 Looking Ahead: Further Developments in QDET 16\u003c\/p\u003e \u003cp\u003e1.4 Conclusion 19\u003c\/p\u003e \u003cp\u003eReferences 20\u003c\/p\u003e \u003cp\u003e\u003cb\u003e2 Asking the Right Questions in the Right Way: Six Needed Changes in Questionnaire Evaluation and Testing Methods 25\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eDon A. Dillman\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e2.1 Personal Experiences with Cognitive Interviews and Focus Groups 25\u003c\/p\u003e \u003cp\u003e2.2 My 2002 Experience at QDET 29\u003c\/p\u003e \u003cp\u003e2.3 Six Changes in Survey Research that Require New Perspectives on Questionnaire Evaluation and Testing 33\u003c\/p\u003e \u003cp\u003e2.4 Conclusion 42\u003c\/p\u003e \u003cp\u003eReferences 43\u003c\/p\u003e \u003cp\u003e\u003cb\u003e3 A Framework for Making Decisions about Question Evaluation Methods 47\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eRoger Tourangeau, Aaron Maitland, Darby Steiger, and Ting Yan\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e3.1 Introduction 47\u003c\/p\u003e \u003cp\u003e3.2 Expert Reviews 48\u003c\/p\u003e \u003cp\u003e3.3 Laboratory Methods 51\u003c\/p\u003e \u003cp\u003e3.4 Field Methods 55\u003c\/p\u003e \u003cp\u003e3.5 Statistical Modeling for Data Quality 59\u003c\/p\u003e \u003cp\u003e3.6 Comparing Different Methods 63\u003c\/p\u003e \u003cp\u003e3.7 Recommendations 67\u003c\/p\u003e \u003cp\u003eReferences 69\u003c\/p\u003e \u003cp\u003e\u003cb\u003e4 A Comparison of Five Question Evaluation Methods in Predicting the Validity of Respondent Answers to Factual Items 75\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eAaron Maitland and Stanley Presser\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e4.1 Introduction 75\u003c\/p\u003e \u003cp\u003e4.2 Methods 76\u003c\/p\u003e \u003cp\u003e4.3 Results 79\u003c\/p\u003e \u003cp\u003e4.4 Discussion 84\u003c\/p\u003e \u003cp\u003eReferences 85\u003c\/p\u003e \u003cp\u003e\u003cb\u003e5 Combining Multiple Question Evaluation Methods: What Does tt Mean When the Data Appear to Conflict? 91\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJo d’Ardenne and Debbie Collins\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e5.1 Introduction 91\u003c\/p\u003e \u003cp\u003e5.2 Questionnaire Development Stages 92\u003c\/p\u003e \u003cp\u003e5.3 Selection of Case Studies 93\u003c\/p\u003e \u003cp\u003e5.4 Case Study 1: Conflicting Findings Between Focus Groups and Cognitive Interviews 95\u003c\/p\u003e \u003cp\u003e5.5 Case Study 2: Conflicting Findings Between Eye-Tracking, Respondent Debriefing Questions, and Interviewer Feedback 97\u003c\/p\u003e \u003cp\u003e5.6 Case Study 3: Complementary Findings Between Cognitive Interviews and Interviewer Feedback 100\u003c\/p\u003e \u003cp\u003e5.7 Case Study 4: Combining Qualitative and Quantitative Data to Assess Changes to a Travel Diary 104\u003c\/p\u003e \u003cp\u003e5.8 Framework of QT Methods 110\u003c\/p\u003e \u003cp\u003e5.9 Summary and Discussion 110\u003c\/p\u003e \u003cp\u003eReferences 114\u003c\/p\u003e \u003cp\u003e\u003cb\u003ePart II Question Characteristics, Response Burden, and Data Quality 117\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e\u003cb\u003e6 The Role of Question Characteristics in Designing and Evaluating Survey Questions 119\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJennifer Dykema, Nora Cate Schaeffer, Dana Garbarski, and Michael Hout\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e6.1 Introduction 119\u003c\/p\u003e \u003cp\u003e6.2 Overview of Some of the Approaches Used to Conceptualize, Measure, and Code Question Characteristics 120\u003c\/p\u003e \u003cp\u003e6.3 Taxonomy of Question Characteristics 127\u003c\/p\u003e \u003cp\u003e6.4 Case Studies 132\u003c\/p\u003e \u003cp\u003e6.5 Discussion 141\u003c\/p\u003e \u003cp\u003eAcknowledgments 147\u003c\/p\u003e \u003cp\u003eReferences 148\u003c\/p\u003e \u003cp\u003e\u003cb\u003e7 Exploring the Associations Between Question Characteristics, Respondent Characteristics, Interviewer Performance Measures, and Survey Data Quality 153\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJames M. Dahlhamer, Aaron Maitland, Heather Ridolfo, Antuane Allen, and Dynesha Brooks\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e7.1 Introduction 153\u003c\/p\u003e \u003cp\u003e7.2 Methods 157\u003c\/p\u003e \u003cp\u003e7.3 Results 174\u003c\/p\u003e \u003cp\u003e7.4 Discussion 182\u003c\/p\u003e \u003cp\u003eDisclaimer 191\u003c\/p\u003e \u003cp\u003eReferences 191\u003c\/p\u003e \u003cp\u003e\u003cb\u003e8 Response Burden: What is it and What Predicts It? 193\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eTing Yan, Scott Fricker, and Shirley Tsai\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e8.1 Introduction 193\u003c\/p\u003e \u003cp\u003e8.2 Methods 197\u003c\/p\u003e \u003cp\u003e8.3 Results 202\u003c\/p\u003e \u003cp\u003e8.4 Conclusions and Discussion 206\u003c\/p\u003e \u003cp\u003eAcknowledgments 210\u003c\/p\u003e \u003cp\u003eReferences 210\u003c\/p\u003e \u003cp\u003e\u003cb\u003e9 The Salience of Survey Burden and Its Effect on Response Behavior to Skip Questions: Experimental Results from Telephone and Web Surveys 213\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eFrauke Kreuter, Stephanie Eckman, and Roger Tourangeau\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e9.1 Introduction 213\u003c\/p\u003e \u003cp\u003e9.2 Study Designs and Methods 216\u003c\/p\u003e \u003cp\u003e9.3 Manipulating the Interleafed Format 219\u003c\/p\u003e \u003cp\u003e9.4 Discussion and Conclusion 224\u003c\/p\u003e \u003cp\u003eAcknowledgments 226\u003c\/p\u003e \u003cp\u003eReferences 227\u003c\/p\u003e \u003cp\u003e\u003cb\u003e10 A Comparison of Fully Labeled and Top-Labeled Grid Question Formats 229\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJolene D. Smyth and Kristen Olson\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e10.1 Introduction 229\u003c\/p\u003e \u003cp\u003e10.2 Data and Methods 236\u003c\/p\u003e \u003cp\u003e10.3 Findings 243\u003c\/p\u003e \u003cp\u003e10.4 Discussion and Conclusions 253\u003c\/p\u003e \u003cp\u003eAcknowledgments 254\u003c\/p\u003e \u003cp\u003eReferences 255\u003c\/p\u003e \u003cp\u003e\u003cb\u003e11 The Effects of Task Difficulty and Conversational Cueing on Answer Formatting Problems in Surveys 259\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eYfke Ongena and Sanne Unger\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e11.1 Introduction 259\u003c\/p\u003e \u003cp\u003e11.2 Factors Contributing to Respondents’ Formatting Problems 262\u003c\/p\u003e \u003cp\u003e11.3 Hypotheses 267\u003c\/p\u003e \u003cp\u003e11.4 Method and Data 268\u003c\/p\u003e \u003cp\u003e11.5 Results 275\u003c\/p\u003e \u003cp\u003e11.6 Discussion and Conclusion 278\u003c\/p\u003e \u003cp\u003e11.7 Further Expansion of the Current Study 281\u003c\/p\u003e \u003cp\u003e11.8 Conclusions 282\u003c\/p\u003e \u003cp\u003eReferences 283\u003c\/p\u003e \u003cp\u003e\u003cb\u003ePart III Improving Questionnaires on the Web and Mobile Devices 287\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e\u003cb\u003e12 A Compendium of Web and Mobile Survey Pretesting Methods 289\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eEmily Geisen and Joe Murphy\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e12.1 Introduction 289\u003c\/p\u003e \u003cp\u003e12.2 Review of Traditional Pretesting Methods 290\u003c\/p\u003e \u003cp\u003e12.3 Emerging Pretesting Methods 294\u003c\/p\u003e \u003cp\u003eReferences 308\u003c\/p\u003e \u003cp\u003e\u003cb\u003e13 Usability Testing Online Questionnaires: Experiences at the U.S. Census Bureau 315\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eElizabeth Nichols, Erica Olmsted-Hawala, Temika Holland, and Amy Anderson Riemer\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e13.1 Introduction 315\u003c\/p\u003e \u003cp\u003e13.2 History of Usability Testing Self-Administered Surveys at the US Census Bureau 316\u003c\/p\u003e \u003cp\u003e13.3 Current Usability Practices at the Census Bureau 317\u003c\/p\u003e \u003cp\u003e13.4 Participants: “Real Users, Not User Stories” 320\u003c\/p\u003e \u003cp\u003e13.5 Building Usability Testing into the Development Life Cycle 323\u003c\/p\u003e \u003cp\u003e13.6 Measuring Accuracy 327\u003c\/p\u003e \u003cp\u003e13.7 Measuring Efficiency 331\u003c\/p\u003e \u003cp\u003e13.8 Measuring Satisfaction 335\u003c\/p\u003e \u003cp\u003e13.9 Retrospective Probing and Debriefing 337\u003c\/p\u003e \u003cp\u003e13.10 Communicating Findings with the Development Team 339\u003c\/p\u003e \u003cp\u003e13.11 Assessing Whether Usability Test Recommendations Worked 340\u003c\/p\u003e \u003cp\u003e13.12 Conclusions 341\u003c\/p\u003e \u003cp\u003eReferences 341\u003c\/p\u003e \u003cp\u003e\u003cb\u003e14 How Mobile Device Screen Size Affects Data Collected in Web Surveys 349\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eDaniele Toninelli and Melanie Revilla\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e14.1 Introduction 349\u003c\/p\u003e \u003cp\u003e14.2 Literature Review 350\u003c\/p\u003e \u003cp\u003e14.3 Our Contribution and Hypotheses 352\u003c\/p\u003e \u003cp\u003e14.4 Data Collection and Method 355\u003c\/p\u003e \u003cp\u003e14.5 Main Results 361\u003c\/p\u003e \u003cp\u003e14.6 Discussion 368\u003c\/p\u003e \u003cp\u003eAcknowledgments 369\u003c\/p\u003e \u003cp\u003eReferences 370\u003c\/p\u003e \u003cp\u003e\u003cb\u003e15 Optimizing Grid Questions for Smartphones: A Comparison of Optimized and Non-Optimized Designs and Effects on Data Quality on Different Devices 375\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eTrine Dale and Heidi Walsoe\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e15.1 Introduction 375\u003c\/p\u003e \u003cp\u003e15.2 The Need for Change in Questionnaire Design Practices 376\u003c\/p\u003e \u003cp\u003e15.3 Contribution and Research Questions 378\u003c\/p\u003e \u003cp\u003e15.4 Data Collection and Methodology 380\u003c\/p\u003e \u003cp\u003e15.5 Main Results 386\u003c\/p\u003e \u003cp\u003e15.6 Discussion 392\u003c\/p\u003e \u003cp\u003eAcknowledgments 397\u003c\/p\u003e \u003cp\u003eReferences 397\u003c\/p\u003e \u003cp\u003e\u003cb\u003e16 Learning from Mouse Movements: Improving Questionnaires and Respondents’ User Experience Through Passive Data Collection 403\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eRachel Horwitz, Sarah Brockhaus, Felix Henninger, Pascal J. Kieslich, Malte Schierholz, Florian Keusch, and Frauke Kreuter\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e16.1 Introduction 403\u003c\/p\u003e \u003cp\u003e16.2 Background 404\u003c\/p\u003e \u003cp\u003e16.3 Data 409\u003c\/p\u003e \u003cp\u003e16.4 Methodology 410\u003c\/p\u003e \u003cp\u003e16.5 Results 415\u003c\/p\u003e \u003cp\u003e16.6 Discussion 420\u003c\/p\u003e \u003cp\u003eReferences 423\u003c\/p\u003e \u003cp\u003e\u003cb\u003e17 Using Targeted Embedded Probes to Quantify Cognitive Interviewing Findings 427\u003cbr\u003e\u003c\/b\u003e\u003ci\u003ePaul Scanlon\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e17.1 Introduction 427\u003c\/p\u003e \u003cp\u003e17.2 The NCHS Research and Development Survey 431\u003c\/p\u003e \u003cp\u003e17.3 Findings 433\u003c\/p\u003e \u003cp\u003e17.4 Discussion 445\u003c\/p\u003e \u003cp\u003eReferences 448\u003c\/p\u003e \u003cp\u003e\u003cb\u003e18 The Practice of Cognitive Interviewing Through Web Probing 451\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eStephanie Fowler and Gordon B. Willis\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e18.1 Introduction 451\u003c\/p\u003e \u003cp\u003e18.2 Methodological Issues in the Use of Web Probing for Pretesting 452\u003c\/p\u003e \u003cp\u003e18.3 Testing the Effect of Probe Placement 453\u003c\/p\u003e \u003cp\u003e18.4 Analyses of Responses to Web Probes 455\u003c\/p\u003e \u003cp\u003e18.5 Qualitative Analysis of Responses to Probes 459\u003c\/p\u003e \u003cp\u003e18.6 Qualitative Coding of Responses 459\u003c\/p\u003e \u003cp\u003e18.7 Current State of the Use of Web Probes 462\u003c\/p\u003e \u003cp\u003e18.8 Limitations 465\u003c\/p\u003e \u003cp\u003e18.9 Recommendations for the Application and Further Evaluation of Web Probes 466\u003c\/p\u003e \u003cp\u003e18.10 Conclusion 468\u003c\/p\u003e \u003cp\u003eAcknowledgments 468\u003c\/p\u003e \u003cp\u003eReferences 468\u003c\/p\u003e \u003cp\u003e\u003cb\u003ePart IV Cross-Cultural and Cross-National Questionnaire Design and Evaluation 471\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e\u003cb\u003e19 Optimizing Questionnaire Design in Cross-National and Cross-Cultural Surveys 473\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eTom W. Smith\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e19.1 Introduction 473\u003c\/p\u003e \u003cp\u003e19.2 The Total Survey Error Paradigm and Comparison Error 474\u003c\/p\u003e \u003cp\u003e19.3 Cross-Cultural Survey Guidelines and Resources 477\u003c\/p\u003e \u003cp\u003e19.4 Translation 478\u003c\/p\u003e \u003cp\u003e19.5 Developing Comparative Scales 480\u003c\/p\u003e \u003cp\u003e19.6 Focus Groups and Pretesting in Cross-National\/Cultural Surveys 483\u003c\/p\u003e \u003cp\u003e19.7 Tools for Developing and Managing Cross-National Surveys 484\u003c\/p\u003e \u003cp\u003e19.8 Resources for Developing and Testing Cross-National Measures 485\u003c\/p\u003e \u003cp\u003e19.9 Pre- and Post-Harmonization 486\u003c\/p\u003e \u003cp\u003e19.10 Conclusion 488\u003c\/p\u003e \u003cp\u003eReferences 488\u003c\/p\u003e \u003cp\u003e\u003cb\u003e20 A Model for Cross-National Questionnaire Design and Pretesting 493\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eRory Fitzgerald and Diana Zavala-Rojas\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e20.1 Introduction 493\u003c\/p\u003e \u003cp\u003e20.2 Background 493\u003c\/p\u003e \u003cp\u003e20.3 The European Social Survey 495\u003c\/p\u003e \u003cp\u003e20.4 ESS Questionnaire Design Approach 496\u003c\/p\u003e \u003cp\u003e20.5 Critique of the Seven-Stage Approach 497\u003c\/p\u003e \u003cp\u003e20.6 A Model for Cross-National Questionnaire Design and Pretesting 497\u003c\/p\u003e \u003cp\u003e20.7 Evaluation of the Model for Cross-National Questionnaire Design and Pretesting Using the Logical Framework Matrix (LFM) 501\u003c\/p\u003e \u003cp\u003e20.8 Conclusions 512\u003c\/p\u003e \u003cp\u003eReferences 514\u003c\/p\u003e \u003cp\u003e\u003cb\u003e21 Cross-National Web Probing: An Overview of Its Methodology and Its Use in Cross-National Studies 521\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eDorothée Behr, Katharina Meitinger, Michael Braun, and Lars Kaczmirek\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e21.1 Introduction 521\u003c\/p\u003e \u003cp\u003e21.2 Cross-National Web Probing – Its Goal, Strengths, and Weaknesses 523\u003c\/p\u003e \u003cp\u003e21.3 Access to Respondents Across Countries: The Example of Online Access Panels and Probability-Based Panels 526\u003c\/p\u003e \u003cp\u003e21.4 Implementation of Standardized Probes 527\u003c\/p\u003e \u003cp\u003e21.5 Translation and Coding Answers to Cross-Cultural Probes 532\u003c\/p\u003e \u003cp\u003e21.6 Substantive Results 533\u003c\/p\u003e \u003cp\u003e21.7 Cross-National Web Probing and Its Application Throughout the Survey Life Cycle 536\u003c\/p\u003e \u003cp\u003e21.8 Conclusions and Outlook 538\u003c\/p\u003e \u003cp\u003eAcknowledgments 539\u003c\/p\u003e \u003cp\u003eReferences 539\u003c\/p\u003e \u003cp\u003e\u003cb\u003e22 Measuring Disability Equality in Europe: Design and Development of the European Health and Social Integration Survey Questionnaire 545\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eAmanda Wilmot\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e22.1 Introduction 545\u003c\/p\u003e \u003cp\u003e22.2 Background 546\u003c\/p\u003e \u003cp\u003e22.3 Questionnaire Design 548\u003c\/p\u003e \u003cp\u003e22.4 Questionnaire Development and Testing 553\u003c\/p\u003e \u003cp\u003e22.5 Survey Implementation 560\u003c\/p\u003e \u003cp\u003e22.6 Lessons Learned 563\u003c\/p\u003e \u003cp\u003e22.7 Final Reflections 566\u003c\/p\u003e \u003cp\u003eAcknowledgments 567\u003c\/p\u003e \u003cp\u003eReferences 567\u003c\/p\u003e \u003cp\u003e\u003cb\u003ePart V Extensions and Applications 571\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e\u003cb\u003e23 Regression-Based Response Probing for Assessing the Validity of Survey Questions 573\u003cbr\u003e\u003c\/b\u003e\u003ci\u003ePatrick Sturgis, Ian Brunton-Smith, and Jonathan Jackson\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e23.1 Introduction 573\u003c\/p\u003e \u003cp\u003e23.2 Cognitive Methods for Assessing Question Validity 574\u003c\/p\u003e \u003cp\u003e23.3 Regression-Based Response Probing 577\u003c\/p\u003e \u003cp\u003e23.4 Example 1: Generalized Trust 579\u003c\/p\u003e \u003cp\u003e23.5 Example 2: Fear of Crime 580\u003c\/p\u003e \u003cp\u003e23.6 Data 581\u003c\/p\u003e \u003cp\u003e23.7 Discussion 586\u003c\/p\u003e \u003cp\u003eReferences 588\u003c\/p\u003e \u003cp\u003e\u003cb\u003e24 The Interplay Between Survey Research and Psychometrics, with a Focus on Validity Theory 593\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eBruno D. Zumbo and José-Luis Padilla\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e24.1 Introduction 593\u003c\/p\u003e \u003cp\u003e24.2 An Over-the-Shoulder Look Back at Validity Theory and Validation Practices with an Eye toward Describing Contemporary Validity Theories 595\u003c\/p\u003e \u003cp\u003e24.3 An Approach to Validity that Bridges Psychometrics and Survey Design 602\u003c\/p\u003e \u003cp\u003e24.4 Closing Remarks 606\u003c\/p\u003e \u003cp\u003eReferences 608\u003c\/p\u003e \u003cp\u003e\u003cb\u003e25 Quality-Driven Approaches for Managing Complex Cognitive Testing Projects 613\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eMartha Stapleton, Darby Steiger, and Mary C. Davis\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e25.1 Introduction 613\u003c\/p\u003e \u003cp\u003e25.2 Characteristics of the Four Cognitive Testing Projects 614\u003c\/p\u003e \u003cp\u003e25.3 Identifying Detailed, Quality-Driven Management Approaches for Qualitative Research 615\u003c\/p\u003e \u003cp\u003e25.4 Identifying Principles for Developing Quality-Driven Management Approaches 616\u003c\/p\u003e \u003cp\u003e25.5 Applying the Concepts of Transparency and Consistency 617\u003c\/p\u003e \u003cp\u003e25.6 The 13 Quality-Driven Management Approaches 618\u003c\/p\u003e \u003cp\u003e25.7 Discussion and Conclusion 632\u003c\/p\u003e \u003cp\u003eReferences 634\u003c\/p\u003e \u003cp\u003e\u003cb\u003e26 Using Iterative, Small-Scale Quantitative and Qualitative Studies: A Review of 15 Years of Research to Redesign a Major US Federal Government Survey 639\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJoanne Pascale\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e26.1 Introduction 639\u003c\/p\u003e \u003cp\u003e26.2 Measurement Issues in Health Insurance 641\u003c\/p\u003e \u003cp\u003e26.3 Methods and Results 645\u003c\/p\u003e \u003cp\u003e26.4 Discussion 660\u003c\/p\u003e \u003cp\u003e26.5 Final Reflections 663\u003c\/p\u003e \u003cp\u003eReferences 664\u003c\/p\u003e \u003cp\u003e\u003cb\u003e27 Contrasting Stylized Questions of Sleep with Diary Measures from the American Time Use Survey 671\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eRobin L. Kaplan, Brandon Kopp, and Polly Phipps\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e27.1 Introduction 671\u003c\/p\u003e \u003cp\u003e27.2 The Sleep Gap 672\u003c\/p\u003e \u003cp\u003e27.3 The Present Research 674\u003c\/p\u003e \u003cp\u003e27.4 Study 1: Behavior Coding 675\u003c\/p\u003e \u003cp\u003e27.5 Study 2: Cognitive Interviews 678\u003c\/p\u003e \u003cp\u003e27.6 Study 3: Quantitative Study 682\u003c\/p\u003e \u003cp\u003e27.7 Study 4: Validation Study 686\u003c\/p\u003e \u003cp\u003e27.8 General Discussion 689\u003c\/p\u003e \u003cp\u003e27.9 Implications and Future Directions 692\u003c\/p\u003e \u003cp\u003eReferences 692\u003c\/p\u003e \u003cp\u003e\u003cb\u003e28 Questionnaire Design Issues in Mail Surveys of All Adults in a Household 697\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eDouglas Williams, J. Michael Brick, W. Sherman Edwards, and Pamela Giambo\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e28.1 Introduction 697\u003c\/p\u003e \u003cp\u003e28.2 Background 698\u003c\/p\u003e \u003cp\u003e28.3 The NCVS and Mail Survey Design Challenges 699\u003c\/p\u003e \u003cp\u003e28.4 Field Test Methods and Design 704\u003c\/p\u003e \u003cp\u003e28.5 Outcome Measures 706\u003c\/p\u003e \u003cp\u003e28.6 Findings 708\u003c\/p\u003e \u003cp\u003e28.7 Summary 716\u003c\/p\u003e \u003cp\u003e28.8 Discussion 716\u003c\/p\u003e \u003cp\u003e28.9 Conclusion 719\u003c\/p\u003e \u003cp\u003eReferences 720\u003c\/p\u003e \u003cp\u003e\u003cb\u003e29 Planning Your Multimethod Questionnaire Testing Bento Box: Complementary Methods for a Well-Balanced Test 723\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eJaki S. McCarthy\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e29.1 Introduction 723\u003c\/p\u003e \u003cp\u003e29.2 A Questionnaire Testing Bento Box 725\u003c\/p\u003e \u003cp\u003e29.3 Examples from the Census of Agriculture Questionnaire Testing Bento Box 733\u003c\/p\u003e \u003cp\u003e29.4 Conclusion 743\u003c\/p\u003e \u003cp\u003eReferences 744\u003c\/p\u003e \u003cp\u003e\u003cb\u003e30 Flexible Pretesting on a Tight Budget: Using Multiple Dependent Methods to Maximize Effort-Return Trade-Offs 749\u003cbr\u003e\u003c\/b\u003e\u003ci\u003eMatt Jans, Jody L. Herman, Joseph Viana, David Grant, Royce Park, Bianca D.M. Wilson, Jane Tom,\u003c\/i\u003e \u003ci\u003eNicole Lordi, and Sue Holtby\u003c\/i\u003e\u003c\/p\u003e \u003cp\u003e30.1 Introduction 749\u003c\/p\u003e \u003cp\u003e30.2 Evolution of a Dependent Pretesting Approach for Gender Identity Measurement 752\u003c\/p\u003e \u003cp\u003e30.3 Analyzing and Synthesizing Results 759\u003c\/p\u003e \u003cp\u003e30.4 Discussion 764\u003c\/p\u003e \u003cp\u003eAcknowledgments 766\u003c\/p\u003e \u003cp\u003eReferences 766\u003c\/p\u003e \u003cp\u003eIndex 769\u003c\/p\u003e  \u003cp\u003e\u003cb\u003ePAUL C. BEATTY\u003c\/b\u003e is Chief of the Center for Behavioral Science Methods at the U.S. Census Bureau. \u003c\/p\u003e\u003cp\u003e\u003cb\u003eDEBBIE COLLINS\u003c\/b\u003e is a Senior Research Director at the National Centre for Social Research, UK. \u003c\/p\u003e\u003cp\u003e\u003cb\u003eLYN KAYE\u003c\/b\u003e is a consultant in Survey Research Methods, and previously Statistics New Zealand's Senior Researcher. \u003c\/p\u003e\u003cp\u003e\u003cb\u003eJOSE???LUIS PADILLA\u003c\/b\u003e is Professor of Methodology of Behavioral Sciences at University of Granada, Spain. \u003c\/p\u003e\u003cp\u003e\u003cb\u003eGORDON B. WILLIS\u003c\/b\u003e is Cognitive Psychologist at the National Cancer Institute, National Institutes of Health, USA. \u003c\/p\u003e\u003cp\u003e\u003cb\u003eAMANDA WILMOT\u003c\/b\u003e is a Senior Study Director at Westat, USA.   \u003c\/p\u003e\u003cp\u003e\u003cb\u003eA new and updated definitive resource for survey questionnaire testing and evaluation\u003c\/b\u003e\u003cb\u003e\u003c\/b\u003e \u003c\/p\u003e\u003cp\u003eBuilding on the success of the first Questionnaire Development, Evaluation, and Testing (QDET) conference in 2002, this book brings together leading papers from the Second International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2) held in 2016. The volume assesses the current state of the art and science of QDET; examines the importance of methodological attention to the questionnaire in the present world of information collection; and considers how the QDET field can anticipate new trends and directions as information needs and data collection methods continue to evolve. \u003c\/p\u003e\u003cp\u003eFeaturing contributions from international experts in survey methodology, \u003ci\u003eAdvances in Questionnaire Design, Development, Evaluation and Testing\u003c\/i\u003e includes latest insights on question characteristics, usability testing, web probing, and other pretesting approaches, as well as: \u003c\/p\u003e\u003cul\u003e \u003cli\u003eRecent developments in the design and evaluation of digital and self-administered surveys\u003c\/li\u003e \u003cli\u003eStrategies for comparing and combining questionnaire evaluation methods\u003c\/li\u003e \u003cli\u003eApproaches for cross-cultural and cross-national questionnaire development\u003c\/li\u003e \u003cli\u003eNew data sources and methodological innovations\u003c\/li\u003e \u003cli\u003eCase studies and practical applications\u003c\/li\u003e \u003c\/ul\u003e \u003cp\u003e\u003ci\u003eAdvances in Questionnaire Design, Development, Evaluation and Testing\u003c\/i\u003e serves as a forum to prepare researchers to meet the next generation of challenges, making it an excellent resource for researchers and practitioners in government, academia, and the private sector.\u003c\/p\u003e","brand":"Wiley","offers":[{"title":"Default Title","offer_id":47988696645861,"sku":"NP9781119263623","price":123.95,"currency_code":"USD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/1842\/7735\/files\/9781119263623.jpg?v=1761781233","url":"https:\/\/k12savings.com\/products\/advances-in-questionnaire-design-development-evaluation-and-testing-isbn-9781119263623","provider":"K12savings","version":"1.0","type":"link"}