CATS scores' adjustments have no comparison

This morning H-L followed up on the celebration-despite-confusion surrounding the latest CATS scores due to the redesign of the test.

Some may find the celebration of folks at the school level disengenuous. I don't. I point it out - but it would not be fair to blame principals and teachers. You can't expect them to wait till next year to see if they should have celebrated this year. They need the motivation and momentum one gains from the recognition.

The Kentucky Board of Education builds the yardstick. The school folks live with it. When the news is bad, criticism abounds. When the news is good, they ought to celebrate.

Party on Wayne. Party on Garth.

The fact that the measure has lost some of its meaning is unfortunate. But there is reason to suspect that the slow but relatively steady progress of Kentucky students continues. It is not too hard to predict that next year's scores will once again show modest gains of a point or two over this years results.

The jump in scores this year should be seen as a one-time gift. OK...maybe two times if you count 1999/2000. But I happen to believe that those changes made the assessment stronger. I seriously doubt that the current changes have improved the instrument like the transition from KIRIS to CATS did.

PARENTS, EDUCATORS STILL CONFUSED BY CHANGES

Fayette County's Clays Mill Elementary School celebrated a recent score of 101.2 on state tests with the principal dying her hair blue, an academic coach kissing a cow and the librarian racing around on a motorcycle.

But this and many other school celebrations around the state may be premature.

The Commonwealth Accountability Testing System was completely redesigned this year, resulting in schools being unable to exactly compare scores to previous years.

The changes, including the addition of math and reading exams to several grades and more multiple-choice questions, led to the state assigning schools an extra score. The unadjusted score can help a school measure how far it is from reaching the state's goal of 100, or proficiency, by 2014. Each school also received an adjusted score that can be used for comparisons, but that number is an estimate and not a completely accurate measure of performance.

The two scores have caused confusion across the state.

Wayne Young, executive director of the Kentucky Association of School Administrators, said superintendents and principals have been put in the "hot seat with parents and teachers" in trying to explain the latest changes and the two-score system.

"They're generally disenchanted with having to slog through the explanation, which is tremendously confusing and complicated," he said. "'This doesn't mean this' and 'this means that.' It's just one more burden to bear." ...

But slog they must. I'm sure this doesn't help the principals' credibility with parents. You never want good news to be suspect.

Just in case Fayette County is looking at both scores for good news. "Fayette County is recognizing both scores, celebrating schools that moved to or passed 100 in their unadjusted scores, and those that made double-digit gains on their adjusted scores, said Superintendent Stu Silberman."

Counseling patience,

Rep. Jon Draud, R-Crestview Hills, education committee member and a former superintendent, said perhaps the state should have changed the name of the test to reduce confusion. He said test results next year will be a more accurate reflection of how Kentucky schools are performing.

"You have to wait until the next year's scores come in, then maybe you'll see that the rate of growth won't be any bigger than the past year," he said.

As long as we're celebrating...

How's the party going at Booker T Washington?

Remember Booker T?

Principal Peggy Petrilli recently left (or was forced out, depending upon who you ask) amid parent complaints and threatening emails. When the smoke cleared, Petrilli was gone and it's still unclear why.
So ... How'd they do?

KSN&C readers may recall that I played a little game of Las Vegas-style prognosticating with this years scores based on some preliminary indicators. Nothing too definitive. Smoke - if no fire.

I have predicted jumps somewhere around 7 points will result...based on scant hard data. I am expecting dips at the top, leaps at the bottom. An overall shift upward.

The over and under on Booker T Washington is 10; Harrison is 5; Fayette County is 8; The state is 7 ...

And there was a pop quiz along the way.

The CATS results for 2007 will show that the percentage of proficient readers at Booker T Washington Academy will...

a. decline
b. stay about the same
c. increase by less than 7 points
d. increase by a little more than 7 points
e. increase by more than 10 points
f. increase by more than 15 points

I said the correct answer would be.... f.

The Results?

In 2006, 53% of Booker T Washington's 4th graders scored Proficient or Distinguished in reading.

In 2007, that number grew to 69%.

+ 16%

Whew. That was close.

As for the Over and Under...
Booker T Washington's Combined Index in 2006 was 82.4 - In 2007 (You know...the score we can't compare) 90.5. If you took the Under, you won.

Harrision's Combined Index in 2006 was 60.4, now 75.6. The Over wins. By alot. A pretty good example of how being at the bottom produced a bigger boost. Also, this was my worst estimate to begin with.

Fayette County's 2007 Index went to 88.7, but was adjusted downward to 85.0. The combined Index for 2006 had been 79.8. So, take your pick. Unadjusted, Fayette County's covered, increasing by 8.9. The Over wins. Adjusted..not so much...increasing by 5.2.

The state Accountability Index was at 79.2 in 2006; to 81.8. Under.