|APPR Planning Sheet 2011-2012
I have given students a Benchmark pretest for Science 8. They will retake the same test at the end of the year. The students will also be taking 10 week assessments to track progress. Test and data analysis are done on Castle Learning.
|Summary of Progress
I began this process during the summer of 2011 by writing the Benchmark test. Each quarter test is a variation on the Benchmark test, but testing only up to the information covered in class. The final exam was given completely online and was exactly the same as the Benchmark pretest. Questions were randomized for each student and ELL and IEP students were able to have questions read aloud using Castle Learning software.
There are a few key things that enable these assessments to be useful and not be a burden on teacher or student. To begin with, the test are all online. Everything else of value from these tests comes from this feature. Item analysis is immediate. Changes to instruction can begin the NEXT DAY based on results. This is the case for all my tests as well. I can do remedial instruction if I find students tested poorly on a specific topic.
Another key aspect of these tests is seeing who will test well on the final exam and may need extra help. This is different than seeing what items tested poorly which is student independent. Generally, the same students that failed or didn't show for the quarterly tests, failed or didn't show for the final exam. I have yet to connect my testing to state testing since they are not identical measures. I do expect they would be similar in many respects though.
I also make the tests low impact. The Benchmark pretest is only graded as to whether it was completed or not. They get full credit regardless of how they do. I find at the beginning of the year especially that students want to do well on tests. Quarter tests and the final exam are curved so that only students who guess randomly risk failing. I'm more interested in the data than failing students.
The questions for next year include whether to keep the tests at the change of quarters or place them elsewhere in the school year. I'd also like to follow student progress better through tests. I wish Castle Learning had some better statistics features.
Establishment of New Assessments
The following new assessments were added this year:
Pretest or Benchmark Test
Quarterly Assessment 1
Midterm: Quarterly Assessment 2
Quarterly Assessment 3
Final Exam (same as Benchmark Test)
Final Exam Administered Online
The Final Exam was successfully administered online.
Pre-Post Score Comparison
Paired t test results
Based on the results I can confidently say the Science 8 curriculum boosted test scores by an average of 23 points. Note, only those with a pre and post test scores have been included in order to do the paired t-test. I don't suspect this greatly changes the results. Only one student scored the same on both pre and post tests and no student scored worse on the post test than on the pretest. I will also admit that I have not determined the validity or reliability of the Benchmark test. Though the test is exactly the same I doubt students remember the questions from Septmember, but it is something to keep in mind.
Besides the change in means between the two tests; I also find the the standard deviations (SD) interesting. The smaller SD on the pretest shows that students all began at a similar level of ignorance. The larger SD on the posttest shows a disparity in knowledge: some learned more than others. There was a larger difference between high and low scores.
|Back to Main Page