You are here

Psychological Testing
Share
Share

Psychological Testing
A Practical Approach to Design and Evaluation



February 2005 | 368 pages | SAGE Publications, Inc

"Psychological Testing by Theresa J. B. Kline is an accessible, easy-to-read book that effectively communicates the current concepts, trends, and controversies in the field of psychological testing. Readers are provided with an in-depth analysis of psychometrics in a format that will keep their attention and that they will be able to relate to the significance of psychological testing across numerous areas such as schools, businesses, clinical settings, military, or government." -Todd L. Chmielewski, PsycCRITIQUES, December 7, 2005 VOL. 50, NO. 49, ARTICLE 12

Psychological Testing: A Practical Approach to Design and Evaluation offers a fresh and innovative approach to students and faculty in the fields of testing, measurement, psychometrics, research design, and related areas of study. Author Theresa J.B. Kline guides readers through the process of designing and evaluating a test, while ensuring that the test meets the highest professional standards. The author uses simple, clear examples throughout and fully details the required statistical analyses. Topics include—but are not limited to—design of item stems and responses; sampling strategies; classical and modern test theory; IRT program examples; reliability of tests and raters; validation using content, criterion-related, and factor analytic approaches; test and item bias; and professional and ethical issues in testing.

With the student in mind, Kline has created features that ease them into more difficult ideas, always stressing the practical use of theoretical concepts. Features include

  • A step-by-step approach to designing a test, including construct identification, construct operationalization, collecting data, item assessment, and reliability and validity techniques
  • Examples of data analyses with printouts and interpretation
  • Up-to-date coverage of psychometric topics, such as difference scores, change scores, translation, computer adaptive testing, reliability and validity generalization, professional and ethical guidelines, and references
  • IRT program outputs (dichotomous and multiple response)
  • Coverage of traditional topics in the context of how they would be used, such as standard errors and confidence intervals
  • Sampling approaches and their strengths and weaknesses, as well as response rates and missing data management

Psychological Testing is perfectly suited as a main text for upper-level undergraduate and graduate Testing or Psychometrics courses in departments of Psychology, Education, Sociology, Management, and in the Human Services disciplines. Professional researchers, educators, and consultants will also want to add this to their libraries for up-to-date coverage of test design and evaluation techniques.

"Professor Kline's attempts to de-mystify complex measurement concepts are beautifully simplified and illustrated in her countless illustrations of practical and relevant problems for the mathematically-challenged student. This book is also a must-have for those who simply do not have the desire for the theoretical jargon used in similar textbooks but are interested in the important conceptual and practical aspects of measurement as they apply in their disciplines."
—Arturo Olivarez, Jr., Texas Tech University

"Kline's Psychological Testing provides a well-written treatment of the critical issues in designing and evaluating psychometric instruments. This book will be very useful to advanced undergraduate students, graduate students, and researchers."
—Richard Block, Montana State University


 
Preface
 
The Assessment of Individuals: The Critical Role and Fundamentals of Measurement
Measurement in the Physical Sciences

 
Measurement in the Social Sciences

 
Historical Highlights of Measurement

 
Statistics Background

 
The First Step: Identifying the Construct

 
Links Between Constructs

 
Construct Cleanliness

 
Single versus Multiple Constructs

 
Summary and Next Step

 
Problems and Exercises

 
 
Designing and Writing Items
Empirical, Theoretical and Rational Approaches to Item
Empirical, Theoretical and Rational Approaches to Item

 
Literature Search

 
Subject Matter Experts

 
How Many Items?

 
Attitudinal Items: Early Work in Item Generation

 
Assessing Behaviors

 
Pilot Testing

 
Summary and Next Step

 
Problems and Exercises

 
 
Designing and Scoring Responses
Open-Ended Responses

 
Closed-Ended Questions

 
Example 1: Proportional Differences for a Single Variable

 
Example 2: Proportional Differences for Two Variables

 
Dichotomous Responses

 
Multiple Choice Tests

 
Continuous Responses

 
Ipsative versus Normative Scales

 
Difference and Change Scores

 
Summary and Next Step

 
Problems and Exercises

 
 
Collecting Data: Sampling and Screening
Probability Sampling

 
Non-Probability Sampling

 
Sample Sizes

 
Missing Data

 
Preparing to Analyze Your Data

 
Summary and Next Step

 
Problems and Exercises

 
 
Classical Test Theory: Assumptions, Equations, Limitations and Item Analyses
Classical Test Theory

 
Theory of True and Error Scores: Description and Assumptions

 
Ramifications and Limitations of Classical Test Theory Assumptions

 
Item Analysis within CTT: Approaches, Statistical Analyses, and Interpretation

 
Descriptive Statistics

 
Summary

 
Problems and Exercises

 
 
Modern Test Theory: Assumptions, Equations, Limitations and Item Analyses
Modern Test Theory

 
Models

 
One-Parameter Logistic Model

 
Two-Parameter Logistic Model

 
Three-Parameter Logistic Model

 
Multiple-response IRT Models

 
Parameter Estimation

 
Scoring Respondents

 
Model Fit

 
Assumptions

 
Ramifications of the Assumptions of Modern Test Theory

 
Practical Advantages of Modern Test Theory

 
Limitations of Modern Test Theory

 
Computer Programs

 
Practical Considerations

 
Summary

 
Next Steps

 
Problems and Exercises

 
 
Reliability of Test Scores and Test Items
Test-retest Reliability

 
Alternative Forms Reliability

 
Measures of Internal Consistency

 
Setting Confidence Intervals

 
Reliability of a Composite

 
Difference Scores - A Reliability Concern

 
Practical Questions

 
Summary and Next Steps

 
Problems and Exercises

 
 
Reliability of Raters
Inter-Rater Reliability Indices

 
Reliability Generalization

 
Modern Test Theory Approaches to Reliability

 
Summary and Next Steps

 
Problems and Exercises

 
 
Assessing Validity Using Content and Criterion
Methods

 
Asking the Test Takers

 
Asking the Subject Matter Experts

 
Assessments Using Correlation and Regression: Criterion-Related Studies

 
Classification Approaches to Test Score Validation

 
Group Differences and Test Bias

 
Extending the Inferences of Criterion-Related Validity Studies

 
Summary

 
Problems and Exercises

 
 
Assessing Validity Via Item Internal Structure
Principal Components Analysis

 
Common Factor Analysis

 
Common Factor Analysis using Analysis of Covariance

 
Structures

 
Some Other Issues in Factor Analysis

 
Practical Issues

 
Concluding Comments on Internal Structure and Validity

 
Threats to the Validity of Scores

 
Multitrait-Multimethod Assessment

 
Closing Comments on Test Score Validity

 
Summary

 
Problems and Exercises

 
 
Ethics and Professional Issues in Testing
Professional Standards and Guidelines

 
Ethical Procedures and Protocols

 
Test Administration

 
Integrity Testing

 
Computerized Testing

 
Coaching, Testwiseness, and Re-takes

 
Testing Legislation

 
Test Item Bias and Adverse Impact

 
Translation Issues

 
Electronic Presentation and Capture

 
Summary

 
Problems and Exercises

 
 
Brief Reviews of Some Selected Tests and Concluding Comments
Information about Existing Tests

 
Some Intelligence Tests

 
Academic Achievement Tests

 
Structured Personality Tests

 
Career Interest/Guidance Instruments

 
Chapter Summary

 
A Quick Book Review

 
Concluding Comments

 
Problems and Exercises

 
 
Appendices
 
References
 
Index

Professor Kline’s attempts to de-mystify complex measurement concepts are beautifully simplified and illustrated in her countless illustrations of practical and relevant problems for the mathematically-challenged student. This book is also a must-have for those who simply do not have the desire for the theoretical jargon used in similar textbooks, but are interested in the important conceptual and practical aspects of measurement as they apply in their disciplines.

Arturo Olivarez, Jr.
Texas Tech University

Kline’s Psychological Testing provides a well-written treatment of the critical issues in designing and evaluating psychometric instruments. This book will be very useful to advanced undergraduate students, graduate students, and researchers.

Richard Block
Montana State University

"[This book] fills an important niche...It is ideally suited to professional psychologists wishing to construct or evaluate a psychological test.  Dr. Kline's sensible advice will serve them well."

Stuart J. Mckelvie
Professor of Psychology at Bishop's University
Canadian Psychology

Psychological Testing: A Practical Approach to Design and Evaluation by Theresa J. B. Kline is an easy-to-read, upper-level textbook covering topics related not only to basic psychological testing practices but also to methodological research components. The author is very effective at presenting relevant issues, facts, descriptions, examples, and statistics in a logical and concise manner. She describes and critiques several commonly used tests and the subtleties involved in test administration, as well as exploring the ethical issues surrounding the process. Readers with varying degrees of knowledge in the field will come away with a clear picture of the wide-ranging effects of psychological testing. The result is a conceptually stratified look at numerous complex measurement theories and psychometric concepts. ... Whereas some textbooks dealing with testing address statistics by giving it a chapter, Kline opts to integrate in-depth statistical analysis wherever appropriate to the topic being presented. This method is very effective, as it gives the reader the complete picture in a single snapshot. ... Psychological Testing by Theresa J. B. Kline is an accessible, easy-to-read book that effectively communicates the current concepts, trends, and controversies in the field of psychological testing. Readers are provided with an in-depth analysis of psychometrics in a format that will keep their attention and that they will be able to relate to the significance of psychological testing across numerous areas such as schools, businesses, clinical settings, military, or government.

Todd L. Chmielewski
PsycCRITIQUES December 7, 2005 Vol. 50, No. 49, Article 12

Psychological Testing  is an accessible, easy-to-read book that effectively communicates the current concepts, trends, and controversies in the field of psychological testing. Readers are provided with an in-depth analysis of psychometrics in a format that will keep their attention and that they will be able to relate to the significance of psychological testing across numerous areas such as schools, businesses, clinical settings, military, or government.
-- PsycCRITIQUES

PsycCRITIQUES
American Psychological Association
Key features
  • Offers a step-by-step approach to designing a test, construct identification, construct operationalization, collecting data, and item assessment.
  • Discusses traditional topics in the context of how they would be used (e.g.: standard errors; confidence intervals; F. Sampling approaches and their strengths and weaknesses; and response rates and missing data management.)
  • Stresses the practical use of theoretical concepts.
  • Features up-to-date coverage of psychometric topics, including difference scores, change scores, translation, computer adaptive testing, reliability and validity generalization, and professional and ethical guidelines and references.
  • Provides readers with IRT program outputs (dichotomous and multiple response
  • Includes examples of data analyses with printouts and interpretation, as well as test reviews.

Sage College Publishing

You can purchase or sample this product on our Sage College Publishing site:

Go To College Site

This title is also available on SAGE Research Methods, the ultimate digital methods library. If your library doesn’t have access, ask your librarian to start a trial.