Item Development and Analysis Worksheet

Item Development and Analysis Worksheet

Item Development and Analysis Worksheet

 

Student Name:                                                                        Section:   PSYC421-

 

 

 

 

 

PART 1: Writing Multiple Choice Test Items

 

 

 

Develop one multiple choice question that covers content from each of the four chapters listed below.  When writing your sample questions, please keep in mind the specifications regarding item construction discussed in the textbook.  Also, remember the importance of carefully crafted distractor options.  Finally, please limit the number of response options to 4 (1 correct response and 3 distractors), and avoid the options of “all of the above,” none of the above,” or the like.  Be sure to indicate which of the response options is the correct one.

 

 

 

Chapter 3 Multiple Choice Question (2.5 points)

 

An estimate of the relaibility of a speed test is a measure of ?

 

 

 

A) the consistancy of flood

 

B) the consistancy of response

 

C) the consistancy of the response speed

 

D) the consistancy of the response of intensity

 

 

 

 

 

Chapter 4 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Chapter 5 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Chapter 6 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

PART 2: Item Analysis: Item Difficulty Index(Cohen et al., 2013, pg. 263)

 

 

 

A test is only as good as its questions!  When researchers, test constructors, and educators create items for ability or achievement tests, we have a responsibility to evaluate the items and make sure that they are useful and high-quality.  The process that we use to evaluate test items is known as Item Analysis.  When bad items are identified and eliminated from a test, that increases the efficiency, reliability and validity of the entire test!    One way that we can distinguish among good and bad items is with the Item Difficulty Index.

 

 

 

Part 2A: Calculating Item Difficulty

 

 

 

Using the data below, calculate the Item Difficulty Index for the first 6 items onQuiz 1 from a recent section of PSYC101.  For each item, “1” means the item was answered correctly and “0” means it was answered incorrectly. Type your answers in the spaces provided at the bottom of the table. (1 pt. each)

 

PSYC101 Quiz 1 Item Distribution and Total Scores
Examinee	Item 1	Item 2	Item 3	Item 4	Item 5	Item 6	Total Score
Andre	1	1	1	1	1	1	16
Allison	1	1	1	1	0	0	7
Heather	1	1	1	1	0	0	10
Corey	1	1	0	1	1	1	17
Christina	0	0	1	1	0	1	3
Jeffrey	0	1	1	1	0	0	11
Shawn	1	1	1	1	0	1	14
Dana	0	0	1	1	0	1	10
Megan	1	1	1	1	0	1	13
David	0	1	1	1	0	1	12
Isabel	0	0	0	1	0	0	4
Lance	1	1	1	1	0	0	9
Aliyah	1	1	1	1	0	1	15
Blaire	0	1	1	1	0	1	12
Gabriel	0	0	1	1	0	0	6
Item Difficulty	53.333	73.333	86.667	100	13.333	60

 

 

 

 

 

 

 

 

 

Part 2B: Calculating Optimal Item Difficulty (.5 pt. each)

 

 

 

1.      For a test item with two response options (e.g., true/false), what is the probability of selecting the correct answer by chance?

 

%

 

 

 

2.      Calculate the optimum level of difficulty for a test questions with two response options.

 

%

 

 

 

3.      For a test item with three response options, what is the probability of selecting the correct answer by chance?

 

%

 

 

 

4.      Calculate the optimum level of difficulty for a test questions with three response options.

 

%

 

 

 

5.      For a test item with four response options, what is the probability of selecting the correct answer by chance?

 

%

 

 

 

6.      Calculate the optimum level of difficulty for a test questions with four response options.

 

KINDLY ORDER NOW FOR A CUSTOM-WRITTEN, PLAGIARISM-FREE PAPER