2. Mastery Learning
What problems are associated with mastery learning?
d. all of the above
3. Standards 2
Which of the following in not a basic approach for developing criterion-referenced standards?
4. Standards 3
How should criterion-referenced standards be specified?
b. by defining a class or domain of tasks that should be performed by the individual
5. Mastery Learning 2
What is the order of the basic steps in mastery learning?
c. establishing behavioral objectives, pretesting, instruction, and posttesting
6. Mastery Learning 3
What name is given to specifically written goals with directions for how to attain them?
c. behavioral objectives
What name is given to a test score indicating that a person actually met the criterion but the field test indicated he did not?
a. false positive
8. Mastery Learning 6
Which of the following contains compatible words?
b. mastery test, criterion, cutoff score
9. CRT 9
Before allowing students to participate in a gymnastics unit, a teacher administered a safety rules test with the requirement that everyone score above 80%. This is an example of what type of test?
10. Criterion 2
False positives result when subjects truly ________ the criterion, but the field test indicates they ________.
a. meet; did not
What statistic is often calculated with criterion-referenced reliability and validity?
What level of measurement is most often associated with criterion-referenced measurement?
What statistical test used with CRTs is actually the number of agreements divided by the total number of classifications made?
c. proportion of agreement
14. Statistical Analysis 2
What does kappa consider that proportion of agreements (P) does not?
15. Statistical Analysis 3
What test statistic would be examined by determining how many students met the cutoff score and how many did not meet the cutoff score for a test on day 1 and again on day 2?
d. stability reliability
16. Statistical Analysis 4
What test statistic would be evaluated by determining how many students met the cutoff score and how many did not meet the cutoff score on two different tests of cardiovascular fitness?
c. equivalence reliability
17. Standards 4
A high school volleyball coach determines that each player must be able to serve 8 out of 10 serves into the court in overhand fashion. This is an example of a
a. judgmental standard
What is the process of interpreting information to make a judgment or interpretation of its meaning called?
Which of the following is not an example of an alternative assessment technique?
b. completing a 1 mi run/walk test
20. Assessment 3
Which of the following statements concerning alternative assessment is not true?
a. Alternative assessment lends itself to the use of norm-referenced standards.
21. Assessment 6
Which of the following test characteristics is considered unimportant when dealing with alternative assessment techniques?
d. none of the above
22. Assessment 8
What procedure would be recommended to ensure reliable scoring of alternative assessments?
c. developing well-defined, explicit performance criteria
What can you do to help counter bias in alternative assessments?
c. collect several types of data
What clarifies student expectations when using alternative assessment?
e. providing explicit directions to the student
What do you want to increase most as the consequences of alternative assessments increase?
d. the validity of the measurement
To whom are you referring when discussing meaningfulness in alternative assessments?
27. Portfolio 2
A portfolio consists of
b. examples of student work
Which of the following doesn't belong with the others?
c. norm-referenced assessment
Which of the following is not an alternative assessment measurement technique?
d. true/false tests
What is the most commonly used measurement technique used in alternative assessment?
What type of standards are most often associated with alternative assessment and why?
a. criterion-referenced, because of the subjectivity involved
What important testing principle would be violated most by using successful completion of the FITNESSGRAM testing program as the primary factor to determine the final grade for students completing a touch football unit?
33. Grading 3
Ideally, which of the following should be most reflected in a student's grade?
d. the achievement of the student
34. Grading 4
Which of the following are problems in grading on improvement?
d. all of the above
35. Grading 6
What is the biggest disadvantage of using arbitrary standards in grading?
36. Grading 7
What best describes grading?
c. a summative evaluation
37. Grading 9
Which statement would most likely be made by a teacher using an absolute grading system?
b. All scores below 70% of the maximum will be considered failures.
Which of the following is not one of the four basic steps in the process of grading?
d. revising course objectives based on results
Subjectivity in determining grades negatively affects which of the following attributes most seriously?
The lack of a clear definition of what a particular grade means negatively affects which of the following attributes most seriously?
Which domain of human experience is most unique to individuals involved in teaching about and assessing physical activity?
Which of the following is the least important consideration in determining objectives?
b. whether the necessary facilities are available to meet the objective
What is the advantage of considering a grade to be a measurement rather than an evaluation?
a. It is less susceptible to a particular teacher's expectations.
44. Domains 2
Which of the following class units would most likely have more weight placed on objectives from the affective domain than the other units?
a. dance unit (co-ed)
What should be your first step in the grading process?
e. determine instructional objectives
Using natural breaks in a distribution rather than sticking with a predetermined percentage of each grade to be given recognizes what fallibility of measurement?
Which of the following is of first concern when you have an essay examination to grade?
48. Validity 2
What type of validity is enhanced by having a fellow teacher review the items on the test?
a. content validity
49. Item Analysis
For a 50-item test given to 140 students, approximately how many of the answer sheets would be used in an item analysis?
50. Test Characteristic
What do item characteristics' difficulty (P) and discrimination (r or D) affect?
c. both a and b
51. Item Analysis 2
One hundred students are in each of the upper and lower groups. Fifty students in the upper group and eighty students in the lower group got a question correct. What is the index of difficulty of this question?
52. Item Analysis 3
One hundred students are in each of the upper and lower groups. Fifty students in the upper group and eighty students in the lower group got a question correct. What is the index of discrimination of this question?
53. Test Characteristic 2
What characteristic of a written test would be most enhanced if every student were equally skilled in test taking?
54. Test Characteristic 3
What major advantage do multiple-choice questions have over true/false items?
b. Guessing is less of a factor.
55. Test Characteristic 4
Which of the following is most important for an achievement test?
b. the discrimination index
56. Testing 2
Ideally, how difficult should the items be that comprise written achievement tests?
b. Most items should be of middle difficulty.
57. Testing 3
Poor item discrimination leads to
58. Item Analysis 5
If six of eight pupils answered a question correctly, what is the index of difficulty of the question?
59. Test Characteristic 5
Which of the following factors will ensure that a test is objective?
a. a well-defined scoring method for the test
60. Test Characteristic 6
What characteristic does an item that is answered correctly by a larger number of good students than poor students display?
b. positive discrimination
61. Test Characteristic 8
If you could obtain only one piece of information about a test, what would you like to see?
e. validity coefficient
62. Testing 4
What major advantage do multiple-choice questions have over essay items?
d. Objectivity is greater with multiple-choice items.
63. Testing 5
Other things being equal, increasing the number of items on a test also increases
64. Testing 6
Which of the following is an important advantage of the multiple-choice test?
a. wide sampling
65. Test Characteristic 9
What characteristic is measured by the Kuder-Richardson formulas?
66. Item Analysis 7
One hundred fifty students have taken your written test. Approximately how many answer sheets should you use to conduct an item analysis by hand?
67. Testing 8
What increases when additional items are added to a written test?
68. Essay 2
What is the major difference between objective and essay items?
a. Objective items are more reliable.
69. Multiple Choice 2
What is the best way to make a multiple-choice question less difficult?
c. use heterogeneous responses
70. Testing 9
What type of objective test item is most seriously affected by blind guessing?
71. Essay 3
Which of the following should not be done when grading essay exams?
c. sort the papers into three to five rough piles according to a quick inspection of the overall paper
Which of the following considerations in constructing a written test should be fairly well established before the course begins?
a. the emphasis to be given various topics
Generally, how many questions could be included on a test so that about 90% of a class of high school or college students would be expected to complete the test in 1 hr?
d. 60 multiple-choice or 120 true/false
Using which of the following testing formats is most likely to lead to the use of good test construction techniques?
d. objective tests
A teacher is scheduled to give an examination to four classes on December 1. The teacher begins coaching duties on December 1. If the four classes have been covering the same material in class and average 25 pupils each, what type of test should the teacher administer?
c. multiple-choice; more time to construct the test than to correct it
76. Test Characteristics
Which is most likely to increase as the variance increases on a written test?
c. reliability of the test
77. Test Characteristics 2
What can be said about a test item that discriminates negatively?
d. It is not valid.
78. Item Analysis 9
With what type of test is item analysis typically used?
d. depends on the nature of the test
79. Test Characteristics 3
If a table of specifications calls for 20% of the 50 questions on a test to measure recall (knowledge) and 30% of them to measure strategy, how many of the test items should deal with recall (knowledge) of strategy?
If 20 of 40 in the upper group and 20 of 40 in the lower group choose the correct answer to a multiple-choice question with five possible responses, what would the index of discrimination be for the item?
81. Item Analysis10
When is an item considered to have good discrimination power?
c. both of the above
What type of survey would yield very consistent but inaccurate results?
c. a survey with high bias and high precision
An open scale survey question gives the respondent
c. the opportunity to write an answer
A table of specifications for a written test helps to determine
a. what to test for
Which of Bloom's categories of educational objectives is most like Ebel's category of factual information?
86. Item Analysis11
To help reduce test anxiety, a question with which index of difficulty might appear as the first item on the test?
87. Item Analysis12
Which of the following is not considered to be a semi-objective type question?
88. Test Characteristics 4
Which of the following words would least likely appear in a true/false test item that was keyed as false?
What is the least important information to include in the directions for a matching test item?
b. the point value of the question
90. Taxonomy 2
Use of novel situations in the construction of written test questions is associated most closely with which of Bloom's educational objectives?
91. Item Analysis13
What index of discrimination would be most likely for an intrinsically ambiguous question?
92. Item Analysis14
If the difficulty index for a test item is .60 and there are 50 students in the high group and 50 students in the low group, what is the maximum discrimination index this item could achieve?
93. Reliability 3 2
What assumption reduces the usefulness of the K-R 21formula for estimating the reliability of a written test?
b. All items are of equal difficulty.
With what domain of human experience are questionnaires most closely associated?
95. Questionnaire 2
An open-ended item on a questionnaire is most like which type of written test item?
96. Questionnaire 3
What technique is suggested to determine how well new questionnaire items function?
b. pilot studies
What is the most important ancillary device in helping to obtain the highest response rate for a questionnaire?
d. a cover letter
98. Questionnaire 4
Which of the following is least likely to ensure that a questionnaire is valid?
a. keeping it as short as possible
What best describes a dichotomous categorical survey question?
b. a yes/no or true/false answer
100. Questionnaire 5
Which of the following is not an advantage of open-ended items on a questionnaire?
d. They reduce ambiguity.
101. Questionnaire 6
When would an open-ended item be more appropriate than a closed-ended item on a questionnaire?
c. when categorization is difficult
What is saved by setting up a "postage-due" arrangement with the post office for returned questionnaires?
103. Questionnaire 7
If you interviewed some questionnaire respondents and asked them essentially the same questions that appeared on the questionnaire, what would you be measuring?
104. Validity 2 2
Developing a table of specifications helps ensure what type of validity?
105. Validity 3
What is a major threat to the validity of subjective test items?
106. Essay 4
What major advantage do forced-choice test items have over essay test items?
107. Test Characteristics 5
What type of ambiguity would you like a test to reflect?
b. extrinsic ambiguity
108. Test Characteristics 6
What does it mean when a test item reflects extrinsic ambiguity?
d. Poorer students had difficulty answering the item.
109. Reliability 4 2
What effect do intrinsically ambiguous items have on a test's reliability?
d. They reduce the test's reliability.
110. Multiple Choice 3
What should you do when constructing multiple-choice test items?
b. make the stem in the form of a question
111. Essay 5
Analytically scoring an essay test rather than globally scoring an essay test
b. reduces potential bias
Careful test writing, planning, administrating will
d. two of the above
A test should consist of items of what level of difficulty?
c. average difficulty
What would you like to know if you could learn only one thing about an achievement test item?
116. Questionnaire 8
Open-ended questionnaire items have what potential problem?
117. Questionnaire 9
What advantage do closed-ended questionnaire items have over open-ended questionnaire items?
c. ease of scoring
What is the most important aspect of the respondents to your questionnaire?
d. the representativeness of the population
What is the most important aspect of your questionnaire?
120. Item Analysis15
The following information was obtained on a recent item analysis. The correct option to this sample item was c. Option A: difficulty = .14 and discrimination = -.10. Option B: difficulty = .20 and discrimination = -.24. Option C: difficulty = .48 and discrimination = .48. Option D: difficulty = .18 and discrimination = -.01. Estimate the quality of the above item.
e. good item