I85PREP
⌘ K
CBI study materials
CBI study resources

CBI practice questions

One question at a time. Build your CBI understanding.

First 50 of 200 questions. Each one lists the choices, the correct answer, and an explanation. The checker at the top of this page saves progress in this browser when it is available.

Continue in the practice tool above to load more questions, 50 at a time.

Question 1Education

In competency-based education (CBE), a student advances to the next unit primarily on the basis of which criterion?

  1. Demonstrated mastery of defined competencies Correct answer.
  2. Rank within the cohort's norm-referenced distribution
  3. Accumulated hours of classroom seat time
  4. Completion of a fixed number of calendar weeks

Explanation

CBE organizes progression around explicit competencies that learners must demonstrate, so time becomes a variable rather than the constant. Seat time, calendar duration, and norm-referenced ranking belong to traditional or comparative models, not to mastery-based advancement.

Question 2Education

A program maps each course to a set of observable, measurable statements describing what graduates should be able to do. In accreditation language, these statements are called:

  1. Faculty workload units
  2. Admission prerequisites
  3. Course syllabi
  4. Program learning outcomes Correct answer.

Explanation

Program learning outcomes state what graduates should know and be able to do, and they anchor assessment and curriculum mapping. Syllabi, prerequisites, and workload units are administrative or planning documents that do not define graduate capabilities.

Question 3Education

Which assessment practice best exemplifies formative assessment?

  1. A final examination that determines the course grade
  2. A standardized placement test administered before enrollment
  3. A low-stakes quiz whose results guide the instructor's next lesson Correct answer.
  4. A licensure exam required for professional practice

Explanation

Formative assessment is conducted during learning to generate feedback that shapes instruction and student effort. Final exams, placement tests, and licensure exams are summative or gatekeeping uses that judge achievement at a point in time.

Question 4Education

Constructive alignment in curriculum design requires that learning outcomes, teaching and learning activities, and assessment tasks be:

  1. Delivered by the same instructor across all sections
  2. Mutually consistent so that assessment measures the stated outcomes Correct answer.
  3. Weighted equally in the calculation of the final grade
  4. Sequenced strictly from lecture to laboratory to examination

Explanation

Constructive alignment means designing activities and assessments that require students to practice and demonstrate the specified outcomes. Sequencing, instructor continuity, and grade weighting are logistical choices unrelated to the alignment principle.

Question 5Education

A curriculum committee wants students to design an original research proposal. Which assessment task is most constructively aligned with that outcome?

  1. Students summarize a published article in 200 words
  2. Students observe a laboratory session and submit attendance
  3. Students pass a multiple-choice test on research terminology
  4. Students draft and defend a research proposal with rationale and methods Correct answer.

Explanation

Assessing an outcome of designing a proposal requires students to actually produce and justify a proposal, including design decisions. Recognition of terms, summary writing, or attendance taps lower-level or unrelated behaviors that cannot evidence original design capability.

Question 6Education

In Bloom's revised taxonomy, which cognitive process category sits at the top of the hierarchy?

  1. Apply
  2. Analyze
  3. Evaluate
  4. Create Correct answer.

Explanation

The revised taxonomy orders processes as remember, understand, apply, analyze, evaluate, and create, placing create highest. Evaluate sits just below create, and analyze and apply are lower in the hierarchy.

Question 7Education

An instructor writes the objective: "Students will be able to compare two regression models and justify the choice for a given dataset." Which Bloom level does the verb 'justify' chiefly signal?

  1. Evaluate Correct answer.
  2. Apply
  3. Remember
  4. Understand

Explanation

Justifying a choice requires judging against criteria, which maps to the evaluate category. Remembering, understanding, and applying involve recalling, explaining, or using procedures rather than rendering a defensible judgment.

Question 8Education

A test blueprint (table of specifications) is used mainly to:

  1. Verify that each item has exactly four options
  2. Ensure item coverage matches content areas and cognitive levels in intended proportions Correct answer.
  3. Rank students from highest to lowest score
  4. Convert raw scores into letter grades

Explanation

A blueprint specifies the content domains and cognitive demands to be sampled and the number or weight of items for each cell, supporting content validity. Ranking, grade conversion, and option counts are separate scoring or formatting concerns.

Question 9Education

A multiple-choice item has a discrimination index of −0.25. What does this indicate?

  1. The item measured a different construct consistently across groups
  2. The item's keyed answer was misprinted for the whole group
  3. Higher-scoring students were less likely than lower-scoring students to answer it correctly Correct answer.
  4. The item was too easy for nearly all examinees

Explanation

Discrimination compares performance of high and low scorers; a negative value means the stronger students did worse on the item, a red flag for keying or clarity problems. Difficulty is a separate index, and misprinting would typically affect all examinees similarly rather than invert the high-low pattern.

Question 10Education

Which action most directly improves the reliability of a classroom summative assessment?

  1. Increasing the number of well-written items sampling the same domain Correct answer.
  2. Reducing the assessment to a single high-stakes essay
  3. Removing the scoring rubric to allow holistic judgment
  4. Administering the test only to the top-performing section

Explanation

Reliability rises when a test samples the domain with more quality items, because measurement error averages out across observations. Shorter tests, unstructured scoring, and restricted samples all reduce consistency of measurement.

Question 11Education

A rubric that describes performance levels with concrete behavioral descriptors is most valuable because it:

  1. Converts qualitative judgments into norm-referenced ranks
  2. Clarifies expectations and supports consistent scoring across raters Correct answer.
  3. Guarantees that all students reach the top level
  4. Eliminates the need for any moderation of scores

Explanation

Descriptive rubrics make criteria explicit to learners and standardize rater judgments, improving inter-rater agreement. They do not guarantee attainment, remove the value of moderation, or create norm-referenced rankings.

Question 12Education

Two raters score the same set of portfolios and their scores agree closely. This evidence primarily supports which property of the scores?

  1. Construct irrelevance
  2. Predictive validity
  3. Content validity
  4. Inter-rater reliability Correct answer.

Explanation

Agreement between independent raters on the same performances is the definition of inter-rater reliability. Validity concerns whether scores mean what they claim, and construct irrelevance refers to contamination by extraneous factors.

Question 13Education

In the ADDIE model of instructional design, which phase produces the measurable objectives, assessment strategy, and sequencing of instruction?

  1. Analysis
  2. Evaluation
  3. Design Correct answer.
  4. Implementation

Explanation

The design phase specifies objectives, assessment approaches, and instructional sequence based on the needs identified earlier. Analysis gathers needs and learner data, implementation delivers the instruction, and evaluation judges results.

Question 14Education

A needs assessment for a new certificate program should begin by:

  1. Writing the final examination items
  2. Selecting the learning management system
  3. Gathering evidence about the gap between current and desired learner or workforce performance Correct answer.
  4. Booking classrooms for the first cohort

Explanation

Needs assessment establishes whether a performance gap exists and what causes it, which justifies and shapes the program. Platform selection, item writing, and room booking are downstream design and logistics decisions.

Question 15Education

Which statement correctly distinguishes a goal from an objective in course design?

  1. A goal is measurable, while an objective is a general statement of intent
  2. A goal is a broad aspiration, while an objective is a specific, measurable learner outcome Correct answer.
  3. Both terms are interchangeable in accreditation documentation
  4. An objective describes instructor activity, while a goal describes student activity

Explanation

Goals express broad intended directions, whereas objectives state specific, observable, and measurable learner performance. The remaining options invert the distinction, conflate the terms, or misattribute the focus to instructors.

Question 16Education

An objective reads: "Students will appreciate the ethical dimensions of data use." What is the main design problem with this objective?

  1. It names an internal state that cannot be observed or directly assessed Correct answer.
  2. It specifies no cognitive level at all
  3. It omits the assessment method to be used
  4. It is too specific to be taught in one course

Explanation

Appreciation is an internal disposition, so it cannot be observed directly; the objective should name an observable performance such as analyzing a case or defending a position. Specificity, assessment method, and level are secondary issues here.

Question 17Education

Which item-writing flaw is present in this multiple-choice item: "Which of the following is NOT a benefit of formative assessment?"

  1. A keyed answer that is grammatically inconsistent
  2. Options that are heterogeneous in length
  3. A stem that is too long
  4. A negatively worded stem that can confuse examinees Correct answer.

Explanation

Negative stems ask examinees to reverse their usual reading and often produce errors unrelated to content knowledge, so they should be avoided unless the construct requires them. Length, option heterogeneity, and grammar are separate concerns not evident from the stem alone.

Question 18Education

A distractor on a multiple-choice item is functioning poorly when it:

  1. Is chosen by some examinees in every score group
  2. Plausibly relates to a common misconception
  3. Attracts more low scorers than high scorers
  4. Is selected by almost no examinees, including low scorers Correct answer.

Explanation

A distractor that almost nobody selects contributes no information and effectively reduces the item to fewer options. Attracting low scorers more than high scorers is desirable discrimination, and plausibility tied to misconceptions is a design strength.

Question 19Education

A university wants to compare student learning across sections of the same course. Which practice best supports this comparison?

  1. Using a common set of learning outcomes and shared scoring criteria across sections Correct answer.
  2. Comparing average class sizes between sections
  3. Allowing each instructor to set entirely independent outcomes
  4. Ranking sections by the instructors' years of experience

Explanation

Comparable evidence requires shared outcomes and common scoring standards so that differences reflect learning rather than differing expectations. Independent outcomes, class size, and instructor seniority do not provide equivalent measures of achievement.

Question 20Education

In a program assessment cycle, the step that follows collecting and analyzing evidence of student learning is to:

  1. Replace the program's learning outcomes with course grades
  2. Use the findings to make documented improvements and reassess Correct answer.
  3. Publish the raw scores without interpretation
  4. Discontinue the assessment until the next accreditation visit

Explanation

Closing the loop means acting on assessment results through specific changes and then re-evaluating whether the changes worked. Publishing uninterpreted data, substituting grades, or suspending assessment breaks the improvement cycle.

Question 21Education

A student with a documented disability requests extended testing time. Under typical accessibility practice, the appropriate response is to:

  1. Administer the test without the accommodation to preserve fairness
  2. Waive the assessment entirely for that student
  3. Lower the passing standard for the whole cohort
  4. Provide the approved accommodation while keeping the same construct and standards Correct answer.

Explanation

Accommodations remove barriers related to a disability without altering what is being measured or the performance standard. Waiving assessment, changing standards for everyone, or denying the accommodation either compromises the construct or discriminates.

Question 22Education

Universal Design for Learning (UDL) recommends offering multiple means of representation, action and expression, and engagement primarily to:

  1. Replace learning outcomes with learner preferences
  2. Limit accommodations to students with formal documentation
  3. Reduce barriers for diverse learners by designing flexibility in from the start Correct answer.
  4. Standardize every learner's path through identical materials

Explanation

UDL builds variability into curriculum design so that diverse learners can access content, demonstrate learning, and stay engaged without retrofitting. It does not standardize pathways, replace outcomes, or restrict flexibility to documented cases.

Question 23Education

A course uses a pre-test and post-test of equal difficulty. The mean gain from pre to post is interpreted as evidence of:

  1. The reliability of the scoring rubric
  2. The representativeness of the item bank
  3. The test's internal consistency
  4. Learning associated with the instructional period Correct answer.

Explanation

A pre-post gain with equivalent forms estimates change in performance over the instructional interval, which is used as evidence of learning. Internal consistency, rubric reliability, and item-bank representativeness are separate psychometric properties not measured by a mean gain.

Question 24Education

A standardized achievement test yields a score reported as a percentile rank of 75. This means the examinee:

  1. Scored at or above 75 percent of the norm group Correct answer.
  2. Demonstrated mastery of 75 percent of the competencies
  3. Answered 75 percent of the items correctly
  4. Has a 75 percent probability of passing the course

Explanation

A percentile rank locates a score within a norm group, indicating the percentage of examinees scoring at or below it. It is not a percent-correct figure, a probability, or a mastery index against a criterion.

Question 25Education

Which scenario best illustrates a criterion-referenced interpretation of a score?

  1. A learner's score is compared with the national average
  2. A learner's score is converted to a standard score with mean 100
  3. A learner is judged competent because performance met all listed safety standards Correct answer.
  4. A learner is placed in the top decile of the cohort

Explanation

Criterion-referenced interpretation compares performance to an absolute standard rather than to other people. Top-decile placement, national-average comparison, and standard-score conversion are all norm-referenced or relative interpretations.

Question 26Education

A curriculum committee is mapping a new general-education course. They must distinguish a course goal from a course objective. Which statement functions as an objective rather than a goal?

  1. The course aims to foster lifelong curiosity about government.
  2. By the end of the term, students will write a policy memo citing at least three primary sources. Correct answer.
  3. Students will value the role of civic engagement in a democratic society.
  4. Students will develop a broad appreciation of public policy.

Explanation

An objective is specific, measurable, and time-bound, describing observable student performance. Only the policy-memo statement specifies an end point, a product, and a criterion that can be assessed. Goals are broader aspirational statements of intent without measurable performance criteria.

Question 27Education

A faculty member drafts this objective: "Students will understand the causes of the French Revolution." A reviewer flags the verb. What is the most defensible revision?

  1. Students will explain three economic causes of the French Revolution in a short essay. Correct answer.
  2. Students will know about the French Revolution.
  3. Students will appreciate the French Revolution.
  4. Students will be aware of the French Revolution's importance.

Explanation

The verb 'understand' names an internal state that cannot be observed directly, so the objective is not measurable as written. Replacing it with an observable performance such as 'explain in a short essay' gives evidence that can be judged. Adding a specified number of causes and a product further sharpens the criterion.

Question 28Education

An instructional designer is writing objectives for a laboratory safety module. Which verb pair belongs to the lower levels of Bloom's revised taxonomy rather than the higher ones?

  1. Identify and describe Correct answer.
  2. Analyze and compare
  3. Evaluate and critique
  4. Design and construct

Explanation

In the revised taxonomy, remembering and understanding are the foundational levels, represented by verbs such as identify and describe. Evaluating, analyzing, and creating sit above them. The other pairs draw on higher-order processes that require more complex cognitive work.

Question 29Education

A program director wants to document how a capstone course contributes to a program-level outcome about quantitative reasoning. Which approach best aligns course assessment with program assessment?

  1. Collect capstone rubric scores on the quantitative-reasoning criterion and review them alongside other courses' evidence. Correct answer.
  2. Administer a commercial standardized test to capstone students only.
  3. Survey graduating seniors about whether they feel confident with numbers.
  4. Rely on the capstone instructor's overall course grades.

Explanation

Program assessment should use evidence tied directly to the outcome being examined. Scoring capstone work with a rubric criterion that matches the quantitative-reasoning outcome produces interpretable evidence that can be aggregated with other courses. Course grades and satisfaction surveys blend many factors and cannot isolate the outcome.

Question 30Education

An assessment coordinator is building a table of specifications for a certification exam. The blueprint should primarily specify which of the following?

  1. The names of the subject-matter experts who review items
  2. The relative weighting of content domains and cognitive levels across items Correct answer.
  3. The publisher of the exam delivery platform
  4. The passing score required for certification

Explanation

A table of specifications maps the content domains and cognitive levels to the proportion of items on the test. This ensures the exam samples the intended construct in a balanced, defensible way. The passing standard is set separately through standard-setting procedures, not through the blueprint.

Question 31Education

A certification board wants an exam that samples broadly across a large content domain, with many items so that scores are stable. Which item format best fits this purpose?

  1. A small set of oral defense questions
  2. A portfolio of workplace artifacts
  3. A single extended essay scored holistically
  4. A large pool of selected-response items Correct answer.

Explanation

Selected-response items can be written in large numbers and sampled broadly across a domain, which supports content coverage and score reliability. Extended essays, oral defenses, and portfolios are valuable for complex performance but are costly to score and yield few sampling points. Broad, stable sampling therefore favors many selected-response items.

Question 32Education

An item on a certification exam has a difficulty index (p-value) of 0.95. What is the most accurate interpretation for the test developer?

  1. The item is appropriately difficult for a certification decision.
  2. The item is too easy to contribute much information and may need revision. Correct answer.
  3. The item discriminates well between high and low scorers.
  4. The item has negative discrimination and should be discarded immediately.

Explanation

A p-value of 0.95 means about 95 percent of examinees answered correctly, so the item provides little information about differences among candidates. Very easy items are not necessarily flawed, but they rarely help separate competent from less competent examinees. Difficulty and discrimination are separate indices, so the p-value alone says nothing about discrimination.

Question 33Education

A test developer computes a point-biserial correlation of 0.42 for an item. What does this value most directly indicate?

  1. The item's content is unrelated to the test blueprint.
  2. The test's internal consistency is below an acceptable level.
  3. Examinees who answered the item correctly tended to earn higher total scores. Correct answer.
  4. The item is too easy for the target population.

Explanation

The point-biserial correlation indexes item discrimination by relating item performance (correct versus incorrect) to total test score. A positive value of 0.42 indicates that stronger examinees were more likely to answer correctly. Difficulty, content alignment, and overall reliability are separate concerns that this statistic does not establish.

Question 34Education

A test is administered twice to the same group with a two-week interval, and the correlation between the two sets of scores is 0.88. Which property does this coefficient estimate?

  1. Criterion validity
  2. Inter-rater agreement
  3. Content validity
  4. Test-retest reliability Correct answer.

Explanation

Test-retest reliability is estimated by correlating scores from two administrations of the same test to the same people after an interval. A coefficient of 0.88 suggests the scores are reasonably stable over two weeks. Inter-rater agreement concerns consistency across scorers, while validity concerns whether the test measures the intended construct.

Question 35Education

A scoring team uses a rubric to rate student presentations. To estimate inter-rater reliability, which design is most appropriate?

  1. Have one rater score all presentations twice on different days.
  2. Correlate presentation scores with students' prior grade point averages.
  3. Have two raters independently score the same set of presentations and compare their ratings. Correct answer.
  4. Administer a written quiz on presentation content after each talk.

Explanation

Inter-rater reliability concerns consistency between different scorers, so two raters must independently judge the same performances. Comparing their ratings, for example with a correlation or percentage of exact agreement, quantifies that consistency. Having one rater score twice addresses intra-rater consistency rather than agreement between raters.

Question 36Education

A certification program reports scores as pass or fail against a predetermined standard. Which interpretation of a passing result is most consistent with this design?

  1. The candidate's score fell within the middle of the distribution.
  2. The candidate demonstrated the knowledge and skills required by the standard. Correct answer.
  3. The candidate performed better than the average candidate in the testing session.
  4. The candidate scored higher than a fixed percentage of the norm group.

Explanation

A pass-fail decision against a predetermined standard is a criterion-referenced interpretation: it describes what the candidate can do relative to the standard. Norm-referenced interpretations compare a candidate with other examinees. Because every candidate can pass if all meet the standard, the decision does not depend on the score distribution.

Question 37Education

A score report states that an examinee earned a scale score of 510. Which statement correctly describes what this score represents?

  1. The score is a transformed value placed on a reporting scale for interpretation. Correct answer.
  2. The examinee answered exactly 51 percent of items correctly.
  3. The examinee placed in the 51st percentile of the norm group.
  4. The examinee's true ability is known precisely as 510.

Explanation

A scale score is a transformed raw score placed on a reporting metric so that scores from different forms or administrations can be compared and interpreted. It is not a percentage correct or a percentile rank. All test scores contain measurement error, so a scale score is an estimate rather than a precise measure of true ability.

Question 38Education

A student with a documented disability is entitled to extended time on a timed test. Which practice best preserves the validity of the assessment while providing the accommodation?

  1. Reduce the number of items so the student finishes within the standard time.
  2. Exempt the student from the timed portions of the assessment.
  3. Score the student's responses against a lower standard.
  4. Provide the extra time without changing the content or the scoring criteria. Correct answer.

Explanation

Accommodations are intended to remove barriers related to a disability without altering what the test measures. Providing extended time while keeping the same content and scoring criteria preserves the construct being assessed. Changing the items, exempting sections, or lowering the standard alters the construct and undermines comparability.

Question 39Education

An instructor applies Universal Design for Learning when designing a new course. Which action best reflects the principle of multiple means of action and expression?

  1. Offering optional study sessions before each exam
  2. Posting lecture slides online after each class
  3. Allowing students to demonstrate mastery through a written report, an oral presentation, or a recorded video Correct answer.
  4. Providing the syllabus in both print and screen-reader-compatible digital formats

Explanation

Multiple means of action and expression concern how students demonstrate what they know, so offering varied response formats such as written, oral, or video products applies this principle. Providing accessible formats addresses multiple means of representation. Study sessions and posted slides support access to content but do not vary how students express learning.

Question 40Education

A team is designing a formative assessment for a weekly statistics lab. Which feature most clearly distinguishes it as formative rather than summative?

  1. It is scored and recorded in the gradebook as a major grade.
  2. It is compared against a national norm group.
  3. It is administered at the end of the course.
  4. It provides feedback that students use to improve before the final assessment. Correct answer.

Explanation

Formative assessment is used during learning to generate feedback that guides improvement, whereas summative assessment evaluates achievement at the end. The defining feature is the use of results to inform teaching and learning, not the format or the stakes. Recording a major grade or comparing to norms describes summative or norm-referenced uses.

Question 41Education

An instructor wants students to self-regulate their learning during a project. Which assessment practice best supports this goal?

  1. Withholding the criteria until after the project is submitted
  2. Providing a rubric at the start and having students use it to check drafts against criteria before submission Correct answer.
  3. Announcing that peer review is optional and ungraded
  4. Assigning a single final grade with no interim feedback

Explanation

Sharing criteria in advance and having students apply them to their own drafts builds self-monitoring and self-regulation. Students can identify gaps and revise before submitting, which is the essence of assessment for learning. Withholding criteria or omitting feedback removes the information students need to regulate their work.

Question 42Education

A department wants to know whether its new peer-review protocol improves the quality of student writing. Which design provides the strongest evidence of an effect?

  1. Survey students about whether they liked the peer-review protocol.
  2. Compare writing scores of a class using the protocol with those of a comparable class not using it. Correct answer.
  3. Count how many students submitted drafts on time.
  4. Ask instructors to recall whether writing seemed better than usual.

Explanation

Comparing an intervention group with a comparable comparison group provides evidence that differences in writing quality are associated with the protocol rather than with other factors. Surveys, instructor impressions, and submission counts do not measure writing quality or control for alternative explanations. A comparison design therefore offers the strongest available evidence among these options.

Question 43Education

A teacher analyzes a multiple-choice item and finds that high-achieving students chose distractor C more often than low-achieving students did. What is the most likely explanation?

  1. The item should be retained without any change.
  2. Distractor C may be miskeyed or ambiguously worded and warrants review. Correct answer.
  3. Distractor C is functioning as intended.
  4. The item's difficulty index is too high.

Explanation

A well-functioning distractor should attract more low-achieving than high-achieving examinees. When stronger students disproportionately choose a distractor, the likely cause is a miskey or ambiguous wording rather than genuine misconception. This pattern calls for content review and possible revision of the item or key.

Question 44Education

An instructor is writing multiple-choice items for a professional ethics exam. Which practice best improves item quality?

  1. Using 'all of the above' as the fourth option
  2. Writing distractors that reflect common misconceptions held by trainees Correct answer.
  3. Making the correct answer consistently the longest option
  4. Including double negatives to test careful reading

Explanation

Distractors drawn from documented misconceptions are plausible and help distinguish genuine understanding from guessing. 'All of the above' options and length cues let testwise examinees answer without knowing the content. Double negatives introduce construct-irrelevant difficulty and reduce clarity.

Question 45Education

A program's assessment committee has collected rubric data from three courses and identified that students consistently score low on interpreting data visualizations. What is the most appropriate next step in the assessment cycle?

  1. Discard the data because they came from multiple courses.
  2. Implement targeted changes, such as added instruction on data visualization, and reassess later. Correct answer.
  3. Raise the passing standard for the program.
  4. Publish the findings and close the cycle.

Explanation

The assessment cycle closes only when findings lead to action and later re-evaluation. Identifying a specific weakness should prompt changes in curriculum or instruction followed by reassessment to see whether improvement occurred. Publishing without action, discarding valid data, or raising standards does not address the identified learning gap.

Question 46Education

A licensing board wants to set the minimum passing score for a new examination. Which approach is most defensible?

  1. Set the cut score so that exactly 70 percent of candidates pass.
  2. Adopt the cut score used by a different profession's exam.
  3. Convene a panel of qualified judges to judge item-by-item the performance required for competent practice. Correct answer.
  4. Set the cut score at the mean score of the first administration.

Explanation

A criterion-referenced standard should reflect the knowledge and skills required for competent practice, which is why panels of qualified judges use methods such as the modified Angoff procedure. Fixing a pass rate or anchoring to the mean makes the standard depend on the candidate group rather than on competence. Borrowing another profession's standard ignores differences in the role and its demands.

Question 47Education

A teacher wants to reduce measurement error when scoring essay exams. Which practice contributes most directly to that goal?

  1. Assigning all essays to a single rater with no rubric
  2. Using a detailed analytic rubric and scoring one criterion at a time Correct answer.
  3. Reading all essays in one sitting without breaks
  4. Grading essays in the order students are seated

Explanation

Measurement error in essay scoring is reduced when raters apply explicit criteria consistently, and analytic rubrics that separate criteria make judgments more stable. Scoring one criterion at a time also limits halo effects across criteria. Unstructured holistic judgments and fatigue-inducing conditions increase error.

Question 48Education

An instructor is aligning a course's assessments with its learning outcomes. Which action most directly supports alignment?

  1. Mapping each assessment to the outcome it measures and checking that all outcomes are assessed Correct answer.
  2. Selecting assessments based on what is easiest to grade
  3. Adding more quizzes to increase the number of grades
  4. Using the same assessment format for every outcome

Explanation

Alignment means that assessments measure the stated outcomes and that every outcome is assessed at an appropriate cognitive level. A mapping between assessments and outcomes makes gaps and mismatches visible. Adding grades, choosing easy formats, or using a single format may leave some outcomes unassessed.

Question 49Education

A student's observed score on a placement test is 62, and the standard error of measurement is 4. Which interpretation is most appropriate?

  1. The student certainly scored between 62 and 66.
  2. The test has no measurement error because the score is reported.
  3. A reasonable confidence interval around the observed score is roughly 54 to 70. Correct answer.
  4. The student's true score is exactly 62.

Explanation

The standard error of measurement describes the variability of observed scores around a true score. A confidence interval is formed by adding and subtracting a multiple of the standard error, so about two standard errors above and below 62 gives roughly 54 to 70. The observed score is an estimate, not the true score, and no test is free of measurement error.

Question 50Education

A faculty team wants to check whether its new rubric measures the intended writing construct rather than neatness or handwriting. Which evidence would most directly support this?

  1. Confirming that the rubric uses a four-point scale
  2. Checking that the rubric has many criteria
  3. Asking students whether they liked the rubric
  4. Correlating rubric scores with a separate validated writing measure Correct answer.

Explanation

Validity evidence for a scoring rubric includes relationships with other measures of the same construct. A strong correlation with an independent validated writing measure supports the claim that the rubric captures writing rather than extraneous features. Number of criteria, student satisfaction, and scale length do not establish what the rubric measures.