tag:blogger.com,1999:blog-7719550.post7864806092770852024..comments2023-11-13T04:55:40.769-05:00Comments on Tuttle SVC: Computer Scoring Open Ended History QuestionsTom Hoffmanhttp://www.blogger.com/profile/08577165613934129833noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-7719550.post-34281576787617002362012-04-26T20:49:29.547-04:002012-04-26T20:49:29.547-04:00Hi Justin,
The problem is that the standards, cur...Hi Justin,<br /><br />The problem is that the standards, curriculum and tests are already being bent to conform to the assessment technologies. The CCSS standards *never* require a student to generate an independent interpretation of a text, and never require the student to make a connection outside the text (except with a specifically defined text). <br /><br />I don't actually believe this is because the employees of the testing companies who wrote these standards are such strict adherents to mid-20th century approaches to literary criticism. I think they did it to make the tests computer scorable.<br /><br />No other country limits the scope of their standards in this way.Tom Hoffmanhttps://www.blogger.com/profile/08577165613934129833noreply@blogger.comtag:blogger.com,1999:blog-7719550.post-30744352503995071762012-04-26T20:30:30.596-04:002012-04-26T20:30:30.596-04:00Hi Tom,
We'll trade comments today :)
If yo...Hi Tom, <br /><br />We'll trade comments today :)<br /><br />If you think that source based essays could potentially be part of the solution, then you should read the original study. This was one of the first to suggest that automated essay score predictors performed as reliably with those content-based questions as humans. <br /><br />Also, what do you think of this point: at present, 100% of these essays are read in about 90 second by rushed humans. What if 10% of essays (the training sample) were read for 5 or 7 minutes by humans, with much greater historical training, time to Google facts, etc? If students knew that there was a chance that their essay would be read by someone looking really closely, would that disincentive gaming behaviors? In my classroom, I graded 1 out of every 10 journal or homework assignments at random, and that was often enough to get good quality work on the whole...<br /><br />In this whole discussion, I think the key point is this: most of people's objections to computer score predictors are actually objections to standardized tests. <br /><br />(Also, I should say in all public forums, that an argument for more writing on standardized tests is not an argument for more standardized tests. We should have less and better testing, and use it more wisely).Justin Reichhttps://www.blogger.com/profile/10621922467284393498noreply@blogger.comtag:blogger.com,1999:blog-7719550.post-86755149777018838462012-04-26T19:17:31.581-04:002012-04-26T19:17:31.581-04:00Michael Doyle's authoritative history. Snort.Michael Doyle's authoritative history. Snort.Dinahttps://www.blogger.com/profile/01275714239191893740noreply@blogger.com