Analysis: Five Questions About the AIM Proposal

AIM
Share:

gate-2

There has been some pretty good discussion on the Vanguard about some of the pros and cons of the current AIM program and whether the new proposal makes things better or worse. From my perspective, the biggest positive about the AIM proposal is it seeks to fix what seemed to be the biggest problem in the previous system, identification.

Tobin White found that under the previous system, 27 percent were identified through private testing, 49 percent through the TONI, (Test of Nonverbal Intelligence) and 24 percent through the OLSAT (Otis-Lennon School Ability Test). While the OLSAT itself is subject to criticism, with the district acknowledging “the test has been shown to reflect a higher level of success for white and Asian students” – and to be biased against identifying underrepresented groups of students including English Learners, low income, Hispanic and African-American – the district proposal does clean up the identification process.

Gone is the private testing which was a key source of claims of unfairness. Streamlined is the rest of the process.

If the district had simply cleaned up this portion of the identification process, they probably would have complete community consensus for moving forward.

However, the district goes further than setting the process for selection as the OLSAT plus risk factors, and then a prescribed test for people with a given set of risk factors. And that leads us to a series of questions.

First, why did the district select the 98th percentile? As some of our readers pointed out, it is not immediately clear what the educationally-based justification is for the 98th percentile. They note in their explanation, “Local districts are directed by the state to develop their own program design and identification criteria. As mentioned earlier, research for this report suggests that the qualification score ranges from 90-99 percentile in GATE programs throughout California.”

That would appear to suggest that there is no agreed upon standard or number. The district seems to suggest a different rationale.

They say: “The current DJUSD qualification score for AIM-identification is the 96 percentile. Raising or lowering the qualification score will have a direct effect on the projected number of students who qualify.” This at least implies that the district is focused more on a bottom-line number than an educationally-based rationale.

They then add, “Analysis from relevant research as well as conversations with GATE teachers, principals and community input has led the administration to select a qualification score that is meant to best serve the DJUSD student population.” But they never explain what exactly that means. Are they simply trying to end up with a certain number or is there some non-arbitrary rationale for the decision on the cut score?

That leads us to a second question, what is achieved by shrinking the size of the program? Over the last decade, research has shown that there are between 100 and 130 students in the AIM program. The district projects, with the qualification score raised to the 98th percentile and the elimination of private testing, there would be between 63 and 73 students in self-contained classrooms.

Throughout this discussion, we have heard some critics believe that there should only be self-contained classrooms for those who struggle in the mainstream classroom. That is different from the program that we have had, but that is not what this proposal entails. Staff writes, “All 3rd graders would take the OLSAT and students scoring 98th percentile or above will qualify for AIM.”

That suggests that the OLSAT score is what matters and we will see high achieving students as well as perhaps underachieving students in the AIM self-contained classrooms.

That leads us to the question: why do we need to shrink the size of the classrooms? Does staff believe that there are too many students in AIM? Does staff believe that the students scoring in the 96th and 97th percentiles are not benefiting from AIM?

What is the ultimate purpose of this change? How does it benefit the schools?

As we mentioned, the district acknowledges problems with the OLSAT in that “the test has been shown to reflect a higher level of success for white and Asian students,” and to be biased against identifying underrepresented groups of students including English Learners, low income, Hispanic, and African-Americans.

So that begs the question, why use it all? In 2012, the Wall Street Journal reported that the New York City gifted program had re-worked its testing formula where the Naglieri Nonverbal Ability Test will count for two-thirds of the student’s score and the OLSAT would count for one-third (down from 75 percent of the total).

One of our commenters noted that there are problems with the Naglieri, which this district plans to use to assess students with economic risk factors, while students with risk factors related to language or culture will be assessed with TONI.

Another commenter noted, “Relying on OLSAT scores so heavily, and on other standardized tests is a problem. What those scores mean is much less objective than it appears.” They suggest the need for qualitative assessments by educators.

But there are problems there, as well. It was Jann Murray-Garcia who in 2002-03 who sounded the alarm that “no African-American or Latino third-graders in the entire Davis school district were recommended by teachers to sit for the GATE test.”

The school district is hanging part of its cultural diversity hopes on the HOPE (Having Opportunities Promotes Excellence) scale, which they plan to start as a pilot that they will run concurrently with the current process.

Staff writes, “The HOPE Scale assessment was designed to identify and serve high-potential students from low-income families. Classroom teachers complete the HOPE scale for each of their students by answering eleven questions using a six point frequency response scale. The future use of the HOPE in DJUSD may mitigate for the inherent biases associated with other assessments.”

Are things better now than in 2002-03? Certainly the district is more conscious of racial bias and their discussion here confirms that belief. On the other hand, the district continues to struggle with the achievement gap, something that may be broadened with the wrong AIM approach. And while the district has utilized unconscious bias training in the past, we were told that it had been five years since the district received that training – not only have current teachers likely forgotten the training but there has been a very high turnover in the last few years, meaning many have not received any unconscious bias training at all.

In short, will the HOPE test work better than previous teacher-based assessments of gifted for minority and underrepresented populations?

That leads to the fifth question, what does the AIM program look like in terms of racial breakdown? We see in the analysis the belief by staff that raising the qualification score cut-off to the 98th percentile along with the end of private testing will likely reduce the size nearly in half, bringing it down to between 63 and 73 students.

That leads to a question: what does the racial breakdown look like? One poster yesterday suggested, “Why should we worry about the ethnic breakdown of the program when it should be about the needs of the children regardless of their race?” But then they couldn’t answer a question from another poster about the fairness of a system that identifies 95 percent of its students as white or Asian.

This isn’t about quotas or producing an exact replica of the district’s ethnic breakdown. Instead, it is about creating a system that is fair, that can assess underserved populations just as well as it assesses whites and Asians. The OLSAT has problems there and the district attempts to remedy that by establishing risk factors (which go beyond simply race and ethnicity) as well as using the HOPE scale pilot.

Tobin White’s research suggested that, at the previous 96th percentile level, the OLSAT-identified population was 48 percent white and 44 percent Asian, suggesting that an OLSAT-only program would produce a program that underrepresented both Latinos and Blacks.

On Saturday and again on Monday, I sent two questions to Superintendent Winfred Roberson. First, what is the projected racial/ethnic breakdown of the proposed revised AIM program? Second, what percentage of the current minority students in AIM would qualify under the proposed changes?

They seem like reasonable and critical questions. If the superintendent does not know the answer, that is fine, but he did not even respond. That is disappointing.

It was pointed out that this is, in fact, a slow process. The school board will not act on these recommendations this week. To me, though, that requires that we raise the tough questions and hope that the district will take them into account as they refine and finalize this policy.

For me this isn’t about defending the status quo. The more I looked into the issue of identification, the more I realized that we needed to change that. Private testing has some rationale, but late arrivals into the school district should be offered school district-based assessment. That seems like an easy fix.

The second question is whether the district’s second level assessments are the right tools. The district added some tools, but interestingly enough did not eliminate the TONI, which seemed a huge source of controversy.

I agree with the need to tweak and refine the identification process. Where I am less sure is the need to make the major changes to the program that the district did. I am not necessarily opposed to them, but want to hear a more objective explanation of how these are educationally-based changes rather than changes motivated simply by the desire to cut the size of the program for other reasons.

—David M. Greenwald reporting

Share:

About The Author

David Greenwald is the founder, editor, and executive director of the Davis Vanguard. He founded the Vanguard in 2006. David Greenwald moved to Davis in 1996 to attend Graduate School at UC Davis in Political Science. He lives in South Davis with his wife Cecilia Escamilla Greenwald and three children.

Related posts

23 thoughts on “Analysis: Five Questions About the AIM Proposal”

  1. Don Shor

    It appears there is to be no cluster grouping of students in differentiated classrooms. Will students who do not make the 98% threshold, but would previously have been in the program, simply be in their neighborhood schools?
    Is differentiated training to be gifted-specific? If so, how?

    What is the actual authority of the AIM Assessment Team with regard to placement of students within self-contained GATE? Do parents have any ability to appeal, and who makes the ultimate decision?

    Are sufficient resources being provided for this? Is a single part-time coordinator going to be able to give sufficient time, develop curriculum, lead training, and monitor progress as half of the students who would currently be in self-contained GATE are relegated to neighborhood schools?

    How will outcomes be monitored, and how will the public be made aware of them?

    1. Robin W.

      What single part-time coordinator? I thought the Board cut that position, so that there is no longer a GATE/AIM Coordinator — which, by the way, means the recent proposal was put together in the absence of any staff having anything close to the level of expertise in this field that the district had for the past 20 years in Deanne Quinn. (Existing staff all together don’t have the expertise Deanne has.)  I am curious what the pedagogical justification is for any part of the proposal.

      1. Don Shor

        This is the proposal:

        2. DJUSD will hire a .4 FTE AIM Differentiation Specialist (See Appendix L for job description) and eliminate the position of .4FTE AIM Coordinator. This job description will be brought to the Board of Education on October 1, 2015 for consideration and approval.
        3. The support staff includes the, already implemented, addition of new (.25 FTE) secretary.

        That apparently will be the full support staff for GATE/AIM.

        1. ryankelly

          There is also a staff secretary for the program and the duties of placement in the program are no longer the duties of the Differentiation Specialist.  With the AIM Coordinator’s time taken up by placement, testing, and doing paperwork, this may be an improvement.

          1. Don Shor

            My recollection is they have chosen not to fill the AIM Coordinator’s position, pending guidance from the board.

      2. wdf1

        Robin W.:  I thought the Board cut that position, so that there is no longer a GATE/AIM Coordinator 

        The board voted not to approve the contract for Ms. Quinn as a temporary GATE/AIM Coordinator.  The apparent justification is that they wanted someone who would be more permanent, and there was a job opening announcement for such a position recently.  The board did not cut that position.

    1. zaqzaq

      There is also no mention of eliminating the lottery.  The lottery allows the school district to not make a decision on one admission criteria over another and thus they cannot be sued for discriminating in their selection process.

  2. Robin W.

    Where is the proposal for funding the teacher training in differentiation — the linchpin that is supposed to make it okay to put all of these gifted kids back in regular classrooms instead of in self-contained classes?

    1. zaqzaq

      Good point.  They should have all of the funding issues figured out prior to implementing any change in the existing program.  The teachers union will also have to agree to a contract modification to require differentiated instruction in the classroom.  That has yet to be accomplished.

  3. Davis Progressive

    i’m not sure the point of this was for everyone to ask their questions, but there does seem to be a lot of questions and a lack of answers.  i get the impression this was rushed to get it ready for september 17.  not sure that’s a good thing.

    1. Anon

      To me it just looks as if the DJUSD decided to pull the decision-making about AIM back into the administration and away from the public eye; come up with a recommendation; present the recommendation; and see if it floats.  My guess it will sink as is, will have to be patched/overhauled to keep its head above water!

  4. Napoleon Pig IV

    My confidence in the competence and integrity of DJUSD administration and the Board of Trustees is growing by leaps and bounds!

    When it becomes obvious that thoughtful and fact-based input has no influence on pre-determined outcomes or implementation of the will of the cabal, I guess sarcastic pot shots from the pasture side of the fence will have to do. Of course, an additional option is to spend three minutes not being listened to while making “respectful” comments during the public comment period at a board meeting.

    Pass me another sandwich, please, while I do further research on charter schools. Oink!

  5. Grant Acosta

    Seriously, do any of you have any recommendations for the best OLSAT prep resource?  testingmom.com?  prepstrong.com?  thinkingtolearn.com?  Kid must get in!

Leave a Reply

X Close

Newsletter Sign-Up

X Close

Monthly Subscriber Sign-Up

Enter the maximum amount you want to pay each month
$ USD
Sign up for