Showing posts with label cpe. Show all posts
Showing posts with label cpe. Show all posts

Monday, January 31, 2011

ACT: Not the Only Measure of College Readiness

Council on Postsecondary Education honcho Bob King recently argued in the Herald-Leader that CPE's High School Feedback Report allows the state "to look more deeply into actual performance measured by an external, unbiased resource — the ACT exam."

King suggested that the ACT, by itself, was superior to predictions of college-readiness derived from combinations of data. Discounting graduation rates and average GPA in favor of a single test prompted our resident testing expert to retort.

NOTE: H-L seemed to struggle editing Skip's piece, so here's the unadulterated article the paper titled:

If I were to assert that a player who cannot make 56% of his free throws is not "ready" for the NBA, a fan would point out that there is much more to basketball than shooting free throws. An astute fan with a historic prospective would point out that Wilt Chamberlain, Shaquille O'Neal and a bevy of other current players would not be "ready" using that arbitrary standard. One facet of basketball does not make or break a player's "readiness."

Bob King, president of Kentucky's Council on Postsecondary Education, in a recent op-ed piece applies the council's arbitrary standard of using a single test score to determine whether a student is "ready" for regular course work in Kentucky's public universities. He implies a test score is a better predictor of grades in college than is a high school record. He then presents results from one high school that lump higher performing students (those with above average high school records) with lower performing ones in a misguided approach to justify his position. A test score, however, does not make or break a student's "readiness" for higher education.

Decades of research indicate: performance in academic courses in high school is the single best predictor of success in higher education; a combination of the high school record and test scores predict better than the high school record alone; and, how good the prediction is and how the components are combined vary depending on the institution. Although there is a general pattern of the primacy of the high school record, there is no one-fits-all model to predict grades in different courses or different institutions.

In addition to the thoroughly suspect notion of labeling a test score readiness, the council's use of a single score for placement purposes violates standards for the proper use of tests. Those standards include the following:

In educational settings, a decision or characterization that will have major impact on a student should not be made on the basis of a single test score. Other relevant information should be taken into account if it will enhance the overall validity of the decision.

In addition:

When test scores are intended to be used as part of the process for making decisions for educational placement, promotion, or implementation of prescribed educational plans, empirical evidence documenting the relationship among particular test scores, the instructional programs, and desire student outcomes should be provided. When adequate empirical evidence is not available, users should be cautioned to weight test results accordingly in light of other relevant information about the student.

Apparently, the council determines readiness by doing statistical analyses of ACT scores and grades in first year courses without regard to institution. A certain ACT score produces a 50/50 chance of getting certain grades, say C, or better. I could find no information about this or other investigations done by the council. And, although it is possible to present information about how good a model is, I could not find any information of that kind either.

To give a sense of the power of statistical models to predict first year grades I report analyses conducted years ago on University of Kentucky student samples. The question was whether results of KIRIS, the first commonwealth assessment related to school reform, could be used for admission and placement in a university.

If a model exactly predicts grades one can say that the model accounts for 100 % of what could be known. If a model cannot at all predict grades, one can say that 0% is accounted for. One way, then, to talk about the power of a statistical model is determine what percent the model predicts.
The table below gives those percents for different courses at UK for three different statistical models: High school record only, High School record + ACT scores and High School record + KIRIS scores.



The first thing to recognize is that the models are not particularly powerful. They rarely account for 25% of what could be known leaving 75% to be explained. That 75% may be differences in students' study habits, class attendance, interests, any of a thousand other variables or simply things not explained statistically.

The pattern of results, however, is clear. Adding an ACT score to a model containing GPA makes the prediction better but not greatly so. The same is true for KIRIS scores, too. Incidentally, that was without including the KIRIS writing sample.

These are not unusual results. They point, obviously, to gathering more information about a student before making a placement decision. Here is what ACT says:

ACT offers a variety of tools to ensure postsecondary students are quickly and accurately placed in courses appropriate to their skill levels. Assessment tools from ACT offer a highly accurate and cost-effective basis for course placement. By combining students' test scores with information about their high school coursework and their needs, interests, and goals, advisors and faculty members can make placement recommendations with a high degree of validity.

To that, I would add, for obvious reasons, it is desirable for an educational agency to use tests in exemplary ways.

The op-ed piece goes on to exhort parents to ask right questions, asks an undefined "we" to fear international test results, says admissions offices should align themselves with the council's readiness standards, and the still undefined "we" to serve teachers more effectively. Such exhortations would be more convincing if, in the first instance, the council could propose placement procedures based on a robust notion of "readiness" that in addition did not violate test score use standards.

Tuesday, May 26, 2009

American Anomaly Led to American Prosperity

"… the U.S. lead in educational attainments over the 20th century
has been a major factor, and perhaps THE major factor,
that accounts for the U.S. overtaking Europe
as the economic superpower of the 20th Century."
--Isaac Ehrlich

As a follow up to last week's CPE conference KSN&C has obtained a copy of Robert King's remarks.

Remarks
Kentucky Conference on the Scholarship of Teaching and Learning
Robert L. King, President
Council on Postsecondary Education
May 20-21, 2009

First, let me thank Adina for this opportunity to speak to you, and take a moment to specifically recognize Mike Seelig, our interim Vice President for Academic Affairs. Mike has been on loan to CPE for the past eight months and had made a profound, positive impact on our work, and on our relationship with our campuses. He has recognized our need to be less mysterious, and more connected to all of you. He has established an internship program where faculty from many of our campuses are spending a semester at CPE, learning about what we do and educating us about what you do and how we can help. In addition, Mike has recognized the importance of getting our staff out to your campuses to actually see and understand the unique circumstances and dynamics of each of our campuses and the communities they serve. Sadly, Mike has chosen his wife and his campus over CPE. So we will be losing him, but doing so with enormous gratitude for his leadership and keen insights, and for the positive changes he has implemented in the way we do business with all of you.

When I was first appointed Chancellor of the State University of New York nearly ten years ago, I attended a speech by the President of Duke University, Dr. Nan Keohane. In her speech she recounted that access to higher education in the United States had been, since the American Civil War, an anomaly in the world. While attendance at a University in Europe and Asia had historically been reserved for the sons of wealthy or politically connected families, the U.S. had chosen a different path, expanding access to anyone with the intellectual talent and determination to seek a college education. This notion of making higher education accessible to all did not occur in a single moment of enlightenment. The principle was imbedded in a series of actions taken at both the national and state level. It started in the 1860’s with the first Morrill Act which created America’s "Land Grant Colleges," and continued through the creation of the GI Bill at the end of World War II, the great civil rights laws of the 1960’s, and the ongoing support of publicly financed tuition assistance programs, and low interest college loans. All of these public policies, expressed in our laws, have worked together to give real meaning and substance to the notion of nearly unfettered access to higher education to anyone in America who seeks it.

Dr. Keohane’s observations about access caused me to ask whether or not there was a connection between this fact and the growth of the American economy? To answer the question I enlisted the assistance of a colleague, Dr. Isaac Ehrlich at the University of Buffalo, to help with the research. Part of what follows is a reflection of that research.

Let me start by asking you to sit back and imagine there was a G-8 in the year 1820. Had there been, the U.S. would not have been a member. The economic and military powers of the day would have included England, Russia, Japan, China, France, India, Spain, and Austria.




Imagine also that they have assembled for their annual meeting in Davos, Switzerland. Anti-globalization protesters had not yet been invented, but I know you can imagine all the pomp and ceremony as the Kings of England, France and Spain, the Emperors of Japan and China, and the Czar get together over cocktails. Czar Alexander leans over to King Louis XVIII and says: "So, Lou, what do you think we can do, either collectively or individually, to become relatively less prosperous and less powerful over the next couple hundred years?"

Obviously, such a conversation never took place, but that hypothetical suggestion is exactly what happened. In contrast, during that same period the United States grew from being a modest experiment into the economic and military power it is today. This result, however, was not a foregone conclusion or some predetermined outcome of history. I doubt anyone could have imagined back in 1820 such a remarkable story unfolding.

Consider, as well, the fact that all of the nations in the 1820 version of the G-8 were blessed with large populations, access to natural resources (either indigenously or through conquest), financial capital, established universities, established armies and various types of functioning economies. And none of the largest national economies of the day intended to relinquish their relative positions of wealth and power. So what happened? And why?

Professor Ehrlich’s research and my questions led us to study the public policy choices made in each of these nations, contrast them with policy choices made in the U.S., and to measure their economic impact simply expressed as the change in the size of each nation’s Gross Domestic Product over time.

The research led us to three principal factors which differentiated the behavior of the U.S. economy from those of the nineteenth century G-8 nations.

First, the U.S. embraced a free enterprise economy while the members of the old G-8 were experimenting with communism, and socialism, or perpetuating old systems of feudalism.
Second, the United States made secondary education (grades 9-12) universal in the early 1900’s, nearly forty years before any other nation.

And third, access to higher education was significantly broadened to people of all economic and social classes through a series of laws described earlier, bringing the treasure of higher education within reach of nearly every American who need only demonstrate the motivation to seek it.
My colleague, Isaac, is an advocate of what economist describe as the "Endogenous Theory" of growth. He contends that, "The reason persistent growth is enabled by human capital formation is that human capital, unlike conventional physical capital, has both the direct effect on the productivity of current labor and capital inputs, and an indirect effect on the production of more knowledge. A continuous accumulation of knowledge can thus lead to a self-sustaining growth in per capita income."

Using international OECD (Organization for Economic Co-Operation and Development) data assembled in 2002 on educational attainment some startling differences appear.



When I graduated from college in the late 1960’s, nearly 22% of Americans in my age group had a Bachelors degree or higher. That compares to 11% in England, 6% for France, 9% in Japan, 6% in Spain, etc. I must confess that I had never expected to see differences of this magnitude. When you multiply this difference across the span of an entire workforce, the differences in productivity, especially in an increasingly information based world, clearly explain how the U.S. grew so substantially, particularly in the 20th century.

In the U.S., it was not just the CEO or the company owner that possessed a college degree. The Human Resources professional, the marketing manager, the engineers on the factory floor, and the sales force had bachelor’s degrees. Even the machinist operating highly sophisticated pieces of manufacturing equipment will very likely have earned at least an Associate’s Degree from one of our community colleges.

The point is that America’s workforce has historically been more highly educated than any other nation in the world, and that education has translated into more innovation and productivity than any other nation throughout the twentieth century. Dr. Ehrlich has actually concluded that, "… the U.S. lead in educational attainments over the 20th century has been a major factor, and perhaps THE major factor, that accounts for the U.S. overtaking Europe as the economic superpower of the 20th Century."

I asked Professor Ehrlich if we could measure the difference in the growth of GDP during the period 1820 to 2000. While this was somewhat difficult to do given the differences in currencies and exchange rates, especially going back into the nineteenth century, he was able to come up with a reasonable representation, measured in constant 1990 U.S. dollars.




During the period indicated (he actually was able to develop the numbers for the period 1820 to 1994), the economy of the U.K. multiplied itself 27.6 times, France 27.3, Spain 38.3, Japan 111.8, India 12.7, Russia 36.1, and China 18.1.


In this same period, the U.S. multiplied its GDP 474 times.

Recent OECD data and studies confirm the value of the American experience. In fact, the 2004 OECD report states that, "…while financial capital investment is most strongly associated with growth at early stages of industrialization, the role of human capital increases with industrial development and overall level of educational attainment, and eventually becomes the strongest driver of economic growth."

The point of all this is that higher education has been intimately connected to the growth of the American economy, and that ties between it and private industry, support of entrepreneurship and scholarship, human capital formation and the commercialization of new knowledge must be at the center of any strategy to enhance America’s future. This is not to say that this is all that we are about, but that our Universities and colleges cannot and should not diminish the role we can play to enhance the human condition and our nation’s prosperity.

But the terms of engagement are changing. The gap I described earlier in terms of bachelor’s degree attainment has evaporated, and what was once America’s secret has been discovered and emulated across the globe.



If Professor Ehrlich’s conclusions are correct, the key to regaining America’s preeminence will be an undiluted focus on getting more of our citizens into and through our colleges and universities. By "through," I mean "graduated from."

This focus does not necessarily mean huge infusions of more money, although having some predictability and financial stability would be helpful. But before I get into some positive suggestions regarding what we can do to help achieve that focus, I want to share one more slide with you. It was inspired by a comment I hear repeated almost weekly by policy makers and ordinary citizens, and as a new comer, is striking in its penetration into the thinking of Kentuckians: on any topic of significance the sentences too frequently end with the words, "…but we are a poor State."

So I asked our staff to look at this educational attainment data, and to map improvement over time against per capita GDP.





As you can see, nations with significantly less wealth than Kentucky have advanced farther and faster than we. I don’t point this out to be critical, but rather to emphasize that the focus these nations have given to getting their populations educated, whether in their own universities, or ours, has been expressed in terms of national budget priorities, and an unrelenting focus on the importance of education to the economic future of their countries.

Pointing out these challenges is easy. Describing actions to bring that "unrelenting focus" to Kentucky is a task that I welcome. The question is what can we do, as advocates, as professionals, and as teachers to help our Commonwealth and its children secure the education they will need to enjoy a quality of life we desire for all our citizens?

Start with this: accept the notion that every member of the faculty of our two and four year institutions can play an instrumental role in increasing the numbers of students from all walks of life who successfully matriculate through the system, and graduate with a degree in a timely manner.

• First, we must make sure that our system of postsecondary education is accessible to every citizen who has the desire and ability to succeed. This means assuring anyone with the motivation to seek postsecondary education can do so without regard to their personal income. From our first generation students, to our citizens of color, to our returning adults, each needs to have access to a high quality postsecondary education, whether it be a certification in welding, a bachelor’s degree in teacher education, or a post-doctoral degree in physics.

• We have to be continually innovative in the way we offer our programs and deliver our courses to meet the changing needs of an increasingly diverse student population. We’ve got to do a better job providing outreach and support for high school guidance counselors, and their students, who need our support in transitioning into postsecondary education. And we need to provide more timely, informed and available advising for students seeking to transfer from KCTCS into any of the baccalaureate campuses in our state, and for adults seeking to complete a degree that may have been started years before, but interrupted by circumstance.

• We must commit ourselves to improving the quality and rigor of every course offering on every campus. Are we setting high expectations for our students, in their writing, their research, their capacity to demonstrate deep understanding of subject matter, or are we simply testing memorization of facts discussed in textbooks and lecture notes that have not been changed for years? Are we preparing our students for the new demands of a global economy? Are we approaching our courses as simple collections of subject matter content, or as tools to teach critical analysis and thinking, and developing the capacity to solve complex, multi dimensional, and multi disciplinary problems?

• We need to expand our connections with our P-12 colleagues and renew our commitment to quality teacher preparation, and to keeping K-12 teachers engaged as scholars throughout their careers. More than anyone in our State, you know that too many of our incoming freshmen are not ready for postsecondary work. Too many arrive on our campuses in need of remediation. Students, who in high school were receiving A’s and B’s, suddenly find themselves unable to perform college level work. Embarrassed, frustrated and confused, they often drop out. Slightly more than a quarter of the students who come to us earn a degree in four years, and fewer than half earn a degree in six years.

• Fortunately, the legislature just passed Senate Bill 1. The bill specifically calls on us to work directly with our K-12 educators to align their standards to levels of knowledge and performance expected of college freshmen at our campuses. To fulfill this responsibility we will also participate in providing professional development to our current corps of teachers, preparing them to teach to these new standards. And, as Marc Tucker suggested earlier today, we need to ensure that teaching becomes attractive to our best, brightest, and most committed students and then recruit them into the teaching profession.

You will make the difference in our success in all these areas. This mission to ignite the "relentless focus" that will be central to our capacity to improve the lives of Kentucky’s people is highly dependent on your commitment. Achieving a highly educated population and a stronger system of postsecondary education will not be accomplished in the halls of the capitol in Frankfort or in the meetings rooms at CPE. It will not happen in the offices of your presidents, or the board rooms on your campuses. It will happen in the classrooms, and in the thousands of personal interactions you have with your students, and in the inspiration you provide through your guidance and teaching. Thank you.

Saturday, February 28, 2009

Legislative leaders like CPE's tuition caps

This from the Herald-Leader:

FRANKFORT — The state's top two legislative leaders said Friday they are pleased with a tuition proposal from higher education's coordinating board and probably won't pursue a cap on tuition through legislation.

Earlier this week, the Council on Postsecondary Education proposed a tiered system for capping tuition increases in the coming school year. If approved, no state school could increase tuition by more than 5 percent.

Senate President David Williams, R-Burkesville, said ..."If they make a good-faith effort to continue to do that, I think the General Assembly won't address that issue in this session." House Speaker Greg Stumbo, D-Prestonsburg, said he agreed...

Under the council's proposal, the University of Kentucky and the University of Louisville could charge up to 5 percent more in the 2009-10 academic year.

The six regional universities — including Eastern Kentucky, Morehead State and Kentucky State — could increase tuition up to 4 percent, while the Kentucky Community and Technical College System could hike its rate 3 percent.

Council members will be asked to approve the recommended caps at their March 6 meeting....

Sunday, February 15, 2009

Tuition time

This from Nancy at C-J's Learning Curve:
Tuition -- and how much they will rise at public postsecondary institutions next fall -- will be the subject of a special meeting of the Kentucky Council on Postsecondary Education on Monday.

The council will not make any decisions at the meeting, which begins at 1:30 p.m. at the council's offices in Frankfort. Instead, the meeting will serve as a primer on institutional budgeting and tuition setting criteria.

It is expected the council will set ceilings for how high institution will be allowed to raise tuition for the coming academic year. The council is expected to vote on tuition parameters in March...

Wednesday, January 07, 2009

Judge dismisses lawsuit over appointment to higher ed board

This from Bluegrass Politics:

A Franklin Circuit judge dismissed a lawsuit Tuesday brought by one of former Republican Gov. Ernie Fletcher’s appointees to the Council on Postsecondary Education.

Franklin Circuit Judge Thomas D. Wingate ruled that Democratic Gov. Steve Beshear acted properly last year when he appointed someone else to the seat held by Virginia Fox...

Tuesday, December 09, 2008

CPE reveals Finalists

This from C-J:

A former chancellor of the New York State University System and the current chancellor of the Vermont State College System appear to be the two finalists to lead the Kentucky Council on Postsecondary Education.

Robert L. King, who at times sparked controversy during his tenure as the chancellor of the New York State University System, took part in a closed-door interview with the council in Lexington this week.

Vermont State College Chancellor Robert G. Clarke, who is also in
consideration for the job, said he could not comment on the search process when contacted by the Courier-Journal yesterday...
This from the New York Times:
Ending a public drama over his leadership, Robert L. King, the chancellor of the State University of New York, has told the trustees that he will step down on June 1.

Mr. King, a close friend and former aide to Gov. George E. Pataki, announced in January that he would take a six-month paid leave, and it had been widely understood that he would not return to head the 64-campus university system.

But facing an outcry over the sabbatical, during which he would have earned about
$170,000, Mr. King surprised SUNY's trustees and the governor by abruptly changing his mind before the board could vote on the package...

Mr. King said he was seeking the leave because of family pressures and a desire to strengthen his administrative skills by enrolling in Harvard Business School's executive program....

Thursday, December 04, 2008

Stop the Presses! CPE Does Its Own Due Diligence!

At last, somebody got the message. Rather than outsourcing their responsibilities, the members of the Council on Postsecondary Education has identified finalists, but delayed making a pick to give members time to dig into the backgrounds of their finalists.

That should serve as a model for all state agencies.

This from Ryan Alessi at H-L:
The Council on Postsecondary Education has narrowed its search for a president to two candidates but put off making a pick Wednesday until members could dig further into both men's backgrounds.

"We have continued to discuss two people that we're very interested in but we need to do more reference checking and discussion," said John R. Hall, the retired chairman of Ashland Inc. who is leading the council's search committee.

The two candidates met with the council Wednesday morning for the first time in closed-door meetings. Council members deliberated in private at Lexington's Embassy Suites Hotel for most of the afternoon before finally breaking up at 4 p.m.

Hall and other council members remained tight-lipped about the identities of the finalists, saying only that both men — who hail from the Northeast — are qualified to lead the group that sets state higher education policy...

Wednesday, October 29, 2008

Search for higher-ed chief proceeds

This from C-J:

State council meets candidates

The Kentucky Council on Postsecondary Education presidential search committee is interviewing about a dozen candidates interested in leading the state agency.

Between 10 and 12 candidates were scheduled to be interviewed in closed sessions at the Cincinnati Marriott Airport in Hebron, Ky., yesterday and today, said John Hall, chairman of the search committee.

"We're doing our best to come up with some good people," he said. "I feel good about the people we have. I think we have a very strong pool." ...