Competition opened yesterday for $350 million in federal money to design new ways of assessing what students learn. Rules for the contest make clear that the government wants to leave behind multiple-choice testing more often in favor of essays, multidisciplinary projects, and other more nuanced measures of achievement.

In the final regulations for the competition, the U.S. Department of Education says it seeks assessments that “more validly measure” students’ knowledge and skills than those that have come to dominate state testing in recent years. It wants tests that show not only what students have learned, but also how that achievement has grown over time and whether they are on track to do well in college. And all that, the regulations say, requires assessments that elicit “complex student demonstrations or applications” of what they’ve learned.

The money for the assessment competition is a slice of the $4.3 billion Race to the Top contest, which is financed with money from the economic-stimulus law passed last year.

Of the $350 million set aside for new tests, the Education Department plans to award one or two grants of up to $160 million each for “comprehensive assessment systems,” and one $30 million grant that is only for development of end-of-course tests at the high school level. All grants will run for four years. Applications are due June 23, and money will be awarded in September. The department is hosting a meeting in Minneapolis April 22 to offer help to potential applicants.

States must band together in groups, or “consortia,” of 15 or more to apply for the comprehensive - testing grant, with five states designated as “governing,” or leading, partners. Grant applicants for the high school testing program must also have five states designated as “governing,” but face no other minimum group-size requirement.

The comprehensive assessment systems developed with the federal money must be able to yield data that can be used to gauge how well teachers and principals are doing their jobs, how instruction and school programs can be improved, and how schools can be judged for federal accountability purposes, according to the 85-page set of regulations.

Tests must be able to measure if students are mastering a “common set of college- and career-ready” academic standards, and those standards must be adopted by the end of 2011. The National Governors Association and the Council of Chief State School Officers, with the support of 48 states, have led a move to write common standards, which are undergoing final revision. Federal officials have used states’ commitment to those standards as incentives in other programs, such as the main Race to the Top competition. ("'Race to Top' Standards Link Questioned," Dec. 9, 2009.)

In the assessment competition, states would have to put all the tests designed under that program into practice by the 2014-15 school year and figure out by then how well students would have to perform on them to be considered ready, at the high school level, for college or good jobs, or, in the earlier years, on track to be ready for those challenges.

Jack Jennings, whose Washington-based Center on Education Policy has studied the state testing required under the No Child Left Behind Act, said it’s important to get assessment right because so much rides on it.

“We’re relying to a great degree on tests to bring about improvements in schools, but we’ve come to understand that many of these tests are not the best,” he said. “If we are going to put this much weight on assessment, we really have to get much better tests, ones that measure higher-order skills and are more useful to teachers. Unless we get better tests, we should question the basic premise of standards-based reform, which is that you can adequately measure the attainment of standards.”

Nel Noddings, a professor emeritus of education at Stanford University, said she wondered whether the federal effort to improve testing wouldn’t be better spent helping teachers do what tests cannot.

“You just don’t need this sophisticated assessment stuff,” said Ms. Noddings, a former math teacher. “What you need is excellent teachers who stay in contact with their kids and work with them day after day. We’ve just gone test crazy.”

Not Identical

The high school testing grant differs in some ways from the comprehensive-test program. Assessments designed under the comprehensive-test program, for instance, must yield data that can be used to judge schools’ effectiveness. They are also intended for use in federal accountability. Neither expectation applies to assessments designed as part of the high school test program.

Joanne Weiss, the director of the Race to the Top program, said that the high school test competition was designed differently so it can act as a “lever for high school improvement,” encouraging states to build more rigor into their secondary school courses without the added pressure of accountability. She added, however, that high school tests designed as part of the comprehensive-test grant program would be subject to that program’s rules.

Each grant program includes incentives for states to coordinate K-12 and higher education in developing tests, something that is rarely done currently and which some advocates believe would allow schools to better line up their demands with college expectations.

Applicants for the comprehensive-testing grant program get extra points if they can show they have enlisted their four-year college or university systems to help design the tests and to agree to let entering students skip remedial work and enroll in credit-bearing courses if they score at a certain level on those tests. State consortia applying for the high school program get priority if they show their colleges or universities will help design tests that measure achievement in coursework in career and technical education, or in science, technology, engineering, and mathematics.

David T. Conley, a University of Oregon professor whose work focuses on college readiness, commended the incentives for higher education involvement.

“To use that level of common sense in designing an assessment system is unprecedented,” he said. “We tell students in high school that one of the main purposes of their education is to go on and learn beyond high school, but we never sit down together at the table, high school and college instructors, to decide what we expect and how to coordinate and align those expectations.”

But Mr. Conley warned that judging college readiness by a test score cutoff—even on a vastly improved test—risks blowing a key opportunity to improve the way schools gauge students’ needs as they enter college. What’s necessary, he said, is a test that can show a broad range of unmet needs, from help with entry-level mathematics to support with study skills. That information can’t come from a test with a set cutoff point, but from a variety of measurements, he said.

“We have to get a more robust definition of what it means to be entirely college-ready,” he said. “This is an opportunity to do that. But we can’t limit ourselves to current methods of testing.”

Sharing Content

In response to experts’ suggestions that the department use the test competition to spur and spread innovation, it is requiring states that compete for the testing money to commit to making test content developed with that money “freely available,” including to states not in the consortia and to commercial organizations.

Consortia’s applications will be evaluated by panels of experts assembled by the Department of Education. They will be scored on a 200-point scale , with the largest portion of points for test design and development and their plans for how research will be conducted to evaluate the tests’ validity. But they will also be judged on their plans for how their consortia will operate and how the project itself will be managed. Experts at a series of public meetings held by the department to help shape the application cautioned officials that consortia—especially larger teams—can easily stumble on the massive management challenges.

Six potential assessment consortia took shape late in the winter, as states readied themselves to vie for the federal money. Those six have now merged into three, although more could emerge before the June application deadline. ("States Rush to Join Testing Consortia," Feb. 3, 2010.)

Leaders of the groups told Education Week that Achieve, a Washington-based organization that works with states to craft standards and accountability systems, is talking with about 30 states, led by Florida, Massachusetts, and Louisiana, about devising a system of summative assessments that would include performance tasks.

The so-called MOSAIC consortium of states, which is focusing on formative assessments, is now working with what’s being called the SMARTER group, which focuses on computer-adaptive testing, and the “balanced assessment” consortium, which is working on a system that will include curriculum-embedded performance tasks scored by teachers. That larger, merged group is being advised by Stanford University professor Linda Darling-Hammond, among others, and led by state chiefs and assessment directors from the states, including Maine, West Virginia, and Oregon. The group currently includes about 40 states, according to Ms. Darling-Hammond. Consortia memberships overlap and are in flux.

Another consortium, including about eight states and headed by the National Center on Education and the Economy, aims to design high school tests modeled on the British “board exams.” 

COMMENTS ON LINE AS OF APRIL 16, 2010

piccolo wrote:

It is good that the Feds want to encourage innovation, but this is not the way to do it. The best way to encourage innovation is to test all kinds of ideas and see which one works best. With this plan, the Feds will merely select one or two ideas that meet their own criteria and seem promising to them and then test those two ideas for four years. If those two ideas don't work, then it's back to the drawing board.

As Rick Hess has said repeatedly and so well, for true innovation we need a "greenfield" where all kinds of ideas can be tested and the bad ones thrown out and the good ones improved and brought to scale. And a key component of this is that the best ideas are not chosen by ED or by any specific person or body based on their preferences, they are chosen through natural selection based on which ones actually improve outcomes.

4/8/2010 1:24 PM EDT on EdWeek

Truman1 wrote: Standardized tests are trying to standardize children. It doesn't work and cuts rather than adds value. Instead of forcing kids to adapt to a standardized model, we should be adapting the school and instruction to individual students. The old factory assembly-line model of education - treating kids like widgets to make them all come out the same on the same date - is obsolete. I had hoped Pres. Obama would stick with his motto on change, but apparently not on education.

With teacher layoffs, larger class-sizes, cuts in remedial classes, and hamstrung state and school budgets, this is no time to spend precious education dollars on testing instead of teaching. Standardized testing inflates testing company profits but at the expense of a child's education and teaching jobs in every community. No thanks.

Marvi wrote: California has invested millions of dollars in developing the STAR (Standardized Testing and Reporting) test. For the most part it is comprehensive and fair. Now the federal government is asking it to scrap the test for an unknown entity. This seems unnecessary and extremely wasteful.

Fangtai wrote: It would be far cheaper and more effective educationally to put funding into school improvement. Teachers can and will create better tests of students' abilities at a fraction of the cost of standardized tests that in reality only compare students and offer no really valuable data. Aging school buildings, like aging people suffer from maladies that cannot and will not be cured by student testing. It is odd that the "best" the Department of Education seems to be able to come up with is something that education has had since the time of confucious, tests. Accountability has become a matter of the federal government offering funds to create and administer tests to determine if those same funds should be given out. I'll make you a deal Mr. Duncan, send me $2,000 extra a year, tax free and I will write my own mid-term and final exams, and I will diligently send the results back to you after they are graded. You can use the rest of the education dollars thayt seem to spring eternal to build my town a new high school.