glass
pen
clip
papers
heaphones

I ALREADY STARTED SOME OF THE QUESTION

I ALREADY STARTED SOME OF THE QUESTION

Item Development and Analysis Worksheet

 

 

 

 

 

Student Name:                                                                        Section:   PSYC421-

 

 

 

 

 

PART 1: Writing Multiple Choice Test Items

 

 

 

Develop one multiple choice question that covers content from each of the four chapters listed below.  When writing your sample questions, please keep in mind the specifications regarding item construction discussed in the textbook.  Also, remember the importance of carefully crafted distractor options.  Finally, please limit the number of response options to 4 (1 correct response and 3 distractors), and avoid the options of “all of the above,” none of the above,” or the like.  Be sure to indicate which of the response options is the correct one.

 

 

 

Chapter 3 Multiple Choice Question (2.5 points)

 

An estimate of the relaibility of a speed test is a measure of ?

 

 

 

A) the consistancy of flood

 

B) the consistancy of response

 

C) the consistancy of the response speed

 

D) the consistancy of the response of intensity

 

 

 

 

 

Chapter 4 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Chapter 5 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Chapter 6 Multiple Choice Question (2.5 points)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

PART 2: Item Analysis: Item Difficulty Index(Cohen et al., 2013, pg. 263)

 

 

 

A test is only as good as its questions!  When researchers, test constructors, and educators create items for ability or achievement tests, we have a responsibility to evaluate the items and make sure that they are useful and high-quality.  The process that we use to evaluate test items is known as Item Analysis.  When bad items are identified and eliminated from a test, that increases the efficiency, reliability and validity of the entire test!    One way that we can distinguish among good and bad items is with the Item Difficulty Index.

 

 

 

Part 2A: Calculating Item Difficulty

 

 

 

Using the data below, calculate the Item Difficulty Index for the first 6 items onQuiz 1 from a recent section of PSYC101.  For each item, “1” means the item was answered correctly and “0” means it was answered incorrectly. Type your answers in the spaces provided at the bottom of the table. (1 pt. each)

 

PSYC101 Quiz 1 Item Distribution and Total Scores
Examinee Item 1 Item 2 Item 3 Item 4 Item 5 Item 6 Total Score
Andre 1 1 1 1 1 1 16
Allison 1 1 1 1 0 0 7
Heather 1 1 1 1 0 0 10
Corey 1 1 0 1 1 1 17
Christina 0 0 1 1 0 1 3
Jeffrey 0 1 1 1 0 0 11
Shawn 1 1 1 1 0 1 14
Dana 0 0 1 1 0 1 10
Megan 1 1 1 1 0 1 13
David 0 1 1 1 0 1 12
Isabel 0 0 0 1 0 0 4
Lance 1 1 1 1 0 0 9
Aliyah 1 1 1 1 0 1 15
Blaire 0 1 1 1 0 1 12
Gabriel 0 0 1 1 0 0 6
Item
Difficulty
53.333 73.333 86.667 100 13.333 60  

 

 

 

 

 

 

 

 

 

Part 2B: Calculating Optimal Item Difficulty (.5 pt. each)

 

 

 

1.      For a test item with two response options (e.g., true/false), what is the probability of selecting the correct answer by chance?

 

%

 

 

 

2.      Calculate the optimum level of difficulty for a test questions with two response options.

 

%

 

 

 

3.      For a test item with three response options, what is the probability of selecting the correct answer by chance?

 

%

 

 

 

4.      Calculate the optimum level of difficulty for a test questions with three response options.

 

%

 

 

 

5.      For a test item with four response options, what is the probability of selecting the correct answer by chance?

 

%

 

 

 

6.      Calculate the optimum level of difficulty for a test questions with four response options.

 

%

 

 

 

7.      For a test item with five response options, what is the probability of selecting the correct answer by chance?

 

%

 

 

 

8.      Calculate the optimum level of difficulty for a test questions with five response options.

 

%

 

 

 

 

 

PART 3: Item Analysis: Item Discrimination Index(Cohen et al., 2013, pg. 265–266)

 

 

 

Another way that test creators can distinguish between good and bad items is with an analysis called the Discrimination Index.  The discrimination index measures how well an individual test item distinguishes between high scorers and low scores on the test.  An item is considered to be “good” if most of the high scorers get it right, and most of the low scorers get it wrong.

 

 

 

Interpreting the Discrimination Index (d)

 

·         The discrimination index can range from -1.0 to 1.0.

 

·         The closer d is to 1.0, the better the item discriminates between high and low scorers

 

·         The closer d is to 0, the more poorly the item discriminates between high and low scorers.

 

·         An item with a negative discrimination index is considered a “negative discriminator” because more low scorers get the item correct than high scorers.

 

·         A discrimination index of 1.0 means all the high scorers got the item correct and all of the low scorers got it incorrect.

 

·         A discrimination index of -1.0 means all of the low scorers got the item correct and all of the high scorers got it incorrect.

 

·         Items with d’s close to 0 or with negative d’s ought to be eliminated from the test!

 

Calculating the Item Discrimination Index (d)

 

 

 

Calculate the item discrimination index (d) for the 7 hypothetical test items presented below.  Type your answers in the spaces provided at the right of the table (1 pt. each).

 

 

 

Item # U L n d
Item 1 21 17 25  
Item 2 23 7 25  
Item 3 25 0 25  
Item 4 3 24 25  
Item 5 22 3 25  
Item 6 0 25 25  
Item 7 19 6 25  

 

 

 

 

 

Based on your calculations above, answer the following questions (1 pt. each).

 

 

 

1.      Which item discriminates the best?

 

 

 

2.      Which item discriminates most poorly?

 

 

 

3.      Based on your analysis, identify which two items would you choose to eliminate from this test and explain why you would eliminate each.

 

 

 

 

 

Part 4: Item Characteristic Curves (Cohen et al., pg. 268–270)

 

 

 

Another method that test creators can use to assess the usefulness of test items is with Item Characteristic Curves.  Item characteristic curves provide a graphical depiction of examinees’ performance on individual test items.  As indicated in the figure below, Total Test Score is plotted on the x-axis of the curve, while proportion of examinees who got the item correct is plotted on the y-axis

 

 

 

 

 

 

 

 

Using the figure above, provide a written description of how test items A–D discriminate among examinees at various levels of performance.  In your responses, discuss why each item would be considered a “good” or a “bad” item.  EXAMPLE: “This item discriminates well among high scores, but doesn’t discriminate well among low scorers.  So this item would be considered a good item because it discriminates at the highest levels of performance.” (2 pt. each)

 

 

 

Item A:

 

 

 

Item B:

 

 

 

Item C:

 

 

 

Item D:

 

 

 

Item E:

 

 

 

 

 

Part 5: Qualitative Item Analysis (Cohen et al., pg. 272–274)

 

 

 

Qualitative item analysis refers to a set of non-statistical procedures used to gather information about the usefulness of test items.  These analyses typically involve interviews, panel discussions, questionnaires and other forms of verbal exchange with test-takers to explore how individual test items work.

 

 

 

As an online student, you have a very different test-taking experience than residential students.  Based on your readings from Chapter 8, identify 4 topics related to online test taking, and create 4 qualitative questions that you could ask online test-takers to gain an understanding of their experiences with test-taking.  Also, as students at a Christian institution of higher education, course assignments/assessments are supposed to give students an opportunity to integrate course content with their Christian worldview.  Given the topic of faith and learning, create one qualitative question that you could ask test-takers.

 

 

 

 

 

 

 

 

 

Qualitative Item Analysis
Topic (1 pt. each) Sample Question for Test-Takers (1 pt. each)
 

 

 

 
 

 

 

 
 

 

 

 
 

 

 

 
 

 

 

 

 

 

 

 

 

 

 

Assignment Scoring

 

 

 

Part 1 Subtotal:

 

 

 

Part 2 Subtotal:

 

 

 

Part 3 Subtotal:

 

 

 

Part 4 Subtotal:

 

 

 

Part 5 Subtotal:

 

 

 

TOTAL SCORE: 

 

  • attachment

    psyc421_item_development-analysis_worksheet_1.pdf

Order Solution Now

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

In the dynamic world we currently live in, it’s becoming increasingly difficult for students to balance academics, co-curricular activities and entertainment among others. Students are required to submit countless assignments in a short time frame. These assignments should not be taken lightly as they form a major part of the grade when it comes to the end of the semester. Understanding the value of education and how these grades are important to students, Infinite Essays has made it its mission in life to offer customized essays to students at an affordable cost.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

There are plenty of reasons why you should order a paper with Infinite Essays. We have reliable writers who are also very competent. They have over the years managed to work under tight schedules and deadlines. Whenever you order an essay with Infinite Essays, you are guaranteed a fast turnaround of your project and this is done on time. Other than writing custom papers, our writers provide value added services that include academic assistance in the areas that they have specialized in. We ensure that the work that we offer is free of plagiarism. Infinite Essays does not condone plagiarism in whatsoever manner. Our writers are very experienced and can handle of sorts of formats such as Turabian, Chicago, Harvard as well as APA and MLA. Infinite Essays covers a wide range of topics. At the moment, we specialize with over 68 topics. We understand the importance of maintaining confidentiality when dealing with our clients. It’s for this reason that we will never reveal the identity of our clients to whoever may be interested. Finally, we offer the most competitive rates in the industry.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

Whenever you want to make an order with us, you will use our automated online ordering system. If you are having some difficulties of any sort, feel free to contact our live support and they will be more than happy to assist you. Ensure that you fill all the relevant information regarding your order. This is the area where you have to include the deadline of your assignment, the formatting style to be used and even the kind of academic paper you desire. The more information you give to our writers, the better.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

Brief explanations of how our services work 1. Provide us with the necessary instructions. Go to the Order Now page and click the order now button. This is the part where you have to attach all the relevant attachments. At the same time, remember to add the instructions sheet here. Once you are sure that you have submitted all relevant information, please submit the final draft to us. 2. The second step will involve paying for the services. This is where an invoice will be sent to you. However, the easiest process is clicking the payment link and following all the prompts that come along. At the moment, all payments are made through PayPal only. 3. Working on your paper. Once you have made the payment, we will assign the order to a writer who will follow the instructions. Remember that our writers will spend countless hour laboring to ensure that the work they provide is meticulously researched. 4. Download your paper. When the writer is finished with the assignment, they will submit it to our writers who will then go through the paper to ensure that the paper has followed all instructions and there are no grammatical errors. We will then forward a copy of the assignment to your email. 5. Tell your friends. We always happy to receive a referral. Whenever a friend tells us that you recommended our services to them, we will give you a 40 percent discount for your next order. Whenever you have provided us with the necessary details, we will forward them to qualified writers who will handle the assignment for you. Remember that the writers will begin working on the assignment immediately. This is the sole reason we encourage our clients to provide their exact specifications during the first time.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

Tackling an order may be challenging but we always offer the best. Before the assignment can be passed to you by our writers, it will be passed through a team of qualified editors and proofreaders to ensure that the paper is accurate and of the required quality. Once the editors are satisfied with the assignment, they will forward the assignment to your account and a copy to your email.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

Discounts We offer the best prices in the industry. We currently have a 20 percent discount for all of our customers. If you feel the budget is putting a strain on you, contact our live support and they might consider you case. We treat each case differently. Remember that our main goal is to continue with education transformation. At the moment, we only accept payments in form of PayPal.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline

Why Choose Us While there are many companies in the writing service industry claiming to offer platinum services, none can match the services offered by Infinite Essays. Some of our writers have been with us since 2010. The testimonials that have been written by some of our happy customers is an indication of the good services that we offer.

Click HERE to order a unique plagiarism free paper done by 

professional writers and delivered before your deadline