Showing posts with label SEM. Show all posts
Showing posts with label SEM. Show all posts

Tuesday, November 6, 2018

Law Review Article: Evaluating Intellectual Disability: Clinical Assessments in Atkins Cases (Ellis et al., 2018)




This new law review article is, IMHO, the best overview article regarding the history of ID, the legal issues in Atkins cases, and good discussion of the major conceptual and measurement issues found in many Atkins cases. An excellent introduction to ID issues in Atkins cases.

EVALUATING INTELLECTUAL DISABILITY: CLINICAL ASSESSMENTS IN ATKINS CASES

James W. Ellis, Caroline Everington, Ann M. Delpha

ABSTRACT

The intersection of intellectual disability and the death penalty is now clearly established. Both under the U.S. Supreme Court's constitutional decisions and under the terms of many state statutes, individual defendants who have that disability cannot be sentenced to death or executed. It now falls to trial, appellate, and post-conviction courts to determine which individual criminal defendants are entitled to the law's protection. This Article attempts to assist judges in performing that task. After a brief discussion of the Supreme Court's decisions in Atkins v. Virginia, Hall v. Florida, and Moore v. Texas, it analyzes the component parts and terminology of the clinical definition of intellectual disability. It then offers more detailed discussion of a number of the clinical issues that arise frequently in adjudicating these cases. For each of these issues, the Article's text and the accompanying notes attempt to provide judges with a thorough survey of the relevant clinical literature, and an explanation of the terminology used by clinical professionals. Our purpose is to help those judges to become more knowledgeable consumers of the clinical reports and expert testimony presented to them in individual cases, and to help them reach decisions that are consistent with what the clinical literature reveals about the nature of intellectual disability and best professional practices in the diagnostic process.

Click on images to enlarge







- Posted using BlogPress from my iPad

Monday, December 18, 2017

Atkins court decision: Farad Roland v USA (NJ; 2018)

Today the opinion regarding the Atkins ID decision for Farad Roland was issued.  As per my policy, having served as an expert witness in this particular case, I offer no comments.  The opinion can be found here.

Wednesday, November 16, 2016

Walls v Florida (2016) - remand based on Hall v Florida SCOUTS decision




I just noted that I had failed to post a copy of Walls v Florida (October 2016) decision to the blog roll of cases. It will be available under the Court Decisions blog role in a few moments. A copy can be accessed here.



- Posted using BlogPress from my iPad



- Posted using BlogPress from my iPad

Sunday, November 13, 2016

Thompson v Florida: Hall v SCOTUS related new evidentiary hearing


Thompson v Florida decision for a new evidentiary hearing, in light of Hall v Florida, can be found here.


- Posted using BlogPress from my iPad

Monday, June 6, 2016

David Kaye on Hall v Florida-- "Deadly statistics: Quantifying an "unacceptable risk in capital punishment" - In press article in Law, Probability and Statistics

The following article is "in press" in Law, Probability and Statistics.  A preview can be found here.

 
Deadly Statistics:
Quantifying an “Unacceptable Risk” in Capital Punishment
David H. Kaye*
Law, Probability & Risk
Vol. 15, No. 4, Dec. 2016 (in press)

Abstract: In Atkins v. Virginia, the U.S. Supreme Court held that the Eighth Amendment ban on
cruel and unusual punishment precludes capital punishment for intellectually disabled offenders.
Death-penalty states responded with laws defining intellectual disability in various ways. In Hall v.
Florida, the Court narrowly struck down the use of a measured IQ of 70 to mark the upper limit of
intellectual disability because it created “an unacceptable risk that persons with intellectual disability
will be executed.” But the Court was unclear if not inconsistent in its description of an upper limit
that would be acceptable. Four dissenting Justices accused the majority not only of misconstruing
the Eighth Amendment, but also of misunderstanding elementary statistics and psychometrics. This
article uses more complete statistical reasoning to explicate the Court’s concept of unacceptable risk.
It describes better ways to control the risk of error than the Court’s confidence intervals, and it argues
that, to the extent that the Eighth Amendment allows any quantitative cut score in determining an
offender’s intellectual disability, these more technically appropriate methods are constitutionally
permissible.

Keywords: Hall v. Florida, cruel and unusual, Eighth Amendment, capital punishment, intellectual
disability, IQ, psychometrics, cut-score, measurement error, standard error, confidence interval,
shrinkage estimator, Bayesian inference, credible region, burden of persuasion

Contents
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
I. The Intellectual Disability Trilogy. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
II. The Need to Allow States to Use Cut Scores and the Meaning of “Significantly Subaverage”
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
III. True Scores and Single-measurement Error Within Classical Test Theory.. . . . . . . . . . . . . . 15
A. First- and Second-order Questions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
B. True Scores and Measurement Error.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
C. Reliability and Standard Error of Measurement (SEM). . . . . . . . . . . . . . . . . . . . . . . . 18
D. Confidence Intervals from the SEM (SEM-IS).. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
E. SEM-adjusted-maximum Score (SEM-AM).. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
F. Confidence Intervals from the Standard Error of Estimate (SEE-IS). . . . . . . . . . . . . . 27
IV. Other Statistical Issues in and Outside of Hall. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
A. Multiple Scores. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
B. Credible Regions (BCR). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Summary and Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Tuesday, August 11, 2015

Law Review Article: Dr. James Ellis on Hall v Florida (SCOTUS, 2014)--ID is a condition-not a number





Dr. James Ellis has presented a nice summary of the major change in the determination of ID in Atkins cases as a result of the Hall v Florida 2014 SCOTUS decision.  The main point is summarized by the statement that ID is a "condition" and "not a number."  Scientific and professional evidence and clinical judgement must be involved in the determination--no longer can "bright line" IQ cut-off scores be used in isolation.  Click here to read the article.



Tuesday, May 27, 2014

Victory for psychometrics in Hall v Florida SEM bright-line Atkins MR/ID SCOTUS decision


This morning SCOTUS rectified the long standing "bright line" (ignoring SEM) problem with Atkins ID/MR cases in Florida.  Click here for background information.  Click here for today's decision.

Monday, March 3, 2014

Hall v Florida SCOTUS transcript from today

Here is today's transcript for the oral arguements and questioning before the US Supreme Court (SCOTUS) re the Hall v Florida Atkins case. To someone who has worked his entire career in intelligence testing, it is very interesting to hear the justices talk about IQ, SEM, etc.

Amicus briefs from APA and AAIDD (and others) have been posted previously at this blog. Prior decisions regarding Hall v Florida are available in the blogroll under Atkins decisions

 

Thursday, February 13, 2014

Hall v Florida SCOTUS case: Amicus Briefs by APA and AAIDD

 

The Atkins case of Hall v Florida will be heard by SCOTUS shortly. Like most Atkins cases, the issues are complex. But the essence of the case is Florida's "bright line" test for the first ID Dx prong...which, based on the FLorida Cherry Court decision, is set at a firm IQ score of 70 with no recognition of the standard error of measurement (SEM).

Both APA and AAIDD have spearheaded two separate Amicus Briefs, which also include other organizations. The two briefs have now been posted in the brief sidebar of this blog. They can also be found at the links below.

APA led Amicus Brief

AAIDD led Amicus Brief

 

 

Monday, December 23, 2013

SCOTUS Hall v Florida Atkins ID update: Petitioners and Amicus Briefs--major focus on IQ "bright line" and SEM

The Atkins MR/ID case of Hall v Florida, which is to be heard by SCOTUS this spring, had two mportant briefs posted within the last week.

The Hall v Florida petition was filed Dec 16. Today, an Amicus Brief was filed by a number of organizations, led by the American Psychological Association.
Click here for a variety of posts re: Atkins cases in Flordia, which have been problematic due to the Florida "Cherry court" establishment of a "bright line" score of 70, with no consiseration of the standard error of measurement (SEM)

Thursday, October 24, 2013

Hall v Florida Atkins ID SCOTUS review: ICDP prior comments re SEM and problems with Florida's Atkins criteria

The Hall v Florida Atkins case, which will be reviewed by SCOTUS, has been generating considerable buzz the past few days, including an editorial in the NY Times (Intellectual Disability and the Death Penalty - 10-22-13; image of editorial below--click to enlarge to read). 

This is a very important case given Florida's complete disregard for the scientific facts that underlie the psychometrics of intelligence tests--in favor of a "bright line" criteria that fails to account for the standard error of measurement (SEM) in IQ scores.

I have previously made a couple of posts re this problem in Florida.  These posts can be found here.  Together with Kevin Foley, I published an IAP Psychometrics 101 Report (#11) which addresses the issue of the SEM in Atkins cases.

I hope that SCOTUS will recognize the obvious scientific flaws in the Florida Atkins criteria.

(Click image to enlarge)

Tuesday, September 25, 2012

Guest post: The 10th Circuit COA Creates More Holes in the Atkins Safety Net: Nancy Haydt, J. D. on Hooks v Workman


This is a Guest Post by Nancy Haydt, J. D. re: Hooks v. Workman  Nancy Haydt is an attorney practicing in California and Colorado. Her research includes a nation-wide database of Atkins cases.  As per the typical policy of the ICDP blog, I post guest posts "as is" without comment.  The only additional information I am providing are links to all court related decisions (I could locate) for this case (2005, 2010, 2012a, 2012b)  


The 10th Circuit COA creates More Holes in the Atkins Safety Net
by Nancy Haydt, J.D.[i]

Hooks v. Workman, --- F.3d ----, 2012 WL 3140916 (C.A.10 (Okla.), 8/3/2012.

In August, the Tenth Circuit Court of Appeals (COA) granted a habeas corpus petition’s claim of ineffective assistance of counsel, and, at the same time, created bad law for current and future 10th Circuit defendants and petitioners claiming mental retardation per Atkins v. Virginia, 536 U.S. 304 (2002). In one fell swoop, the 10th Cir. COA barred IQ score adjustment for the Flynn Effect, discredited any meaningful application of the Standard Error of Measurement, accepted the KBIT as a valid measurement of intelligence for Atkins purposes, and adopted the principle that adaptive functioning is defined by weighing adaptive weaknesses against adaptive strengths.

In Hooks, the Court of Appeals took the position that the AAIDD’s definition of mental retardation is appropriate for clinical application, but the AAIDD’s recommended diagnostic procedures are not binding in legal proceedings. Hooks greatly undermines the scientific and clinical basis of the diagnosis of mental retardation. Hooks widens the ever-expanding gap between science and the science-like proceedings created by the judiciary which will determine the fate of many Atkins clients.

Legal Proceedings

In 1989, Victor Wayne Hooks was tried and convicted by a jury of the capital murder of his pregnant wife and their unborn child. He was sentenced to death. In 2004, an Atkins hearing was tried before a jury. Evidence was presented of IQ test scores ranging from 53 to 80.
Date
Test
Score
1970
SB
80
1972
WISC
70
1978
WAIS
61
1979
WAIS
57
1982
BETA-II
61
1988
WAIS
80
1994
WAIS-R
72
2002
K-BIT
76
2004
WAIS-III
53

Experts for the prosecution and defense agreed that some test scores were probably unreliable. These so-called “experts” also agreed that Hooks’s most reliable scores were the K-BIT and the 1994 WAIS-R. There was testimony that the scores from many tests could be adjusted downward for norm-obsolescence, but neither defense expert was willing to endorse adjustment for the Flynn Effect. Defense experts testified that Mr. Hooks’s IQ “was in the gray area” of subaverage intelligence, but was “most likely mentally retarded.” In light of such underwhelming defense testimony, it was not surprising that the jury found that Hooks did not prove that he had sub-average intellectual functioning.

Defense evidence showed Mr. Hooks’s adaptive limitations from early childhood to his present functioning in custody. Through their experts, they painted the picture of a child who was developmentally delayed, placed in special education classes and diagnosed as mentally retarded while still in grade school. Mr. Hooks’s limitations in communication, social skills, work, self-direction and academics were documented and extensive. The prosecution presented evidence of criminal behavior as evidence of adaptive functioning. That evidence, along with Hooks’s ability to drive, his ability to have children, his daily reading of the bible, and his letters to his daughters was the prosecution’s case against adaptive limitations. The trial court refused to instruct the jury that intellectual disability is defined by a person’s limitations, and not by his strengths. With no expert evidence lending understanding to the concept of adaptive behavior, the jury found that Hooks did not prove that he had limitations in adaptive functioning. The jury found that Mr. Hooks did not have mental retardation.

On appeal Hooks’s conviction and death sentence were affirmed. The jury finding that Hooks did not have mental retardation was affirmed.

On Habeas Corpus: Failure to Establish Scientific Structure for a Clinical Determination of MR

The habeas corpus petition in Hooks contained few references to current scientific source material. They contain no references to the AAIDD User’s Guide or standards of practice. There was no evidence in the habeas record, either by testimony or affidavit, from scholars in the field of intellectual disability. The scientific basis of MR assessment, including psychometric issues and standards of practice, was never entered into evidence by expert testimony or affidavit. The COA was presented no clinical structure for making a reasonable determination of mental retardation. This vacancy of structure gave the COA carte blanche to create their own definition of mental retardation and their own standard for diagnosis.

Binding precedent for the 10th Circuit

Among the damaging holdings are:

 “[T]he Flynn Effect, whatever its validity, is not a relevant consideration in the mental retardation determination for capital defendants." Also, “Atkins does not mandate an adjustment for the Flynn Effect. Moreover, there is no scientific consensus on its validity.”

The K-BIT is a valid measure of intelligence for Atkins purposes.

For legal purposes, Atkins does not require that determination of mental retardation be “based solely on deficiencies to the exclusion of strengths”. The AAIDD definition is a clinical standard, not a legal standard. “[W]hether the legal standard is satisfied depends upon the facts: What is a given defendant able and unable to do? Both strengths and deficiencies enter into this equation because they make up the universe of facts tending to establish that a defendant either has ‘significant limitations’ or does not.”

The SEM supports the concept that “a rational trier of fact could conclude from this evidence that Mr. Hooks indeed functions at a sub-average intellectual level, but it could also rationally draw the conclusion that he does not.”

Hooks sets a bad precedent for 10th circuit defendants and petitioners who assert protection from the death penalty under Atkins. With Hooks in the 10th Circuit, and In re Briseno, 135 S.W.3d 1 (Tex.Crim.App.2004),  in Texas, we are seeing an ever widening gap between legal and clinical standards for the determination of mental retardation.

Good News for Mr. Hooks; Bad News for 10th Cir. Atkins Defendants

The COA granted Mr. Hooks’s claim of ineffective assistance of trial counsel in the sentencing phase of his case. The COA determined that Mr. Hooks’s counsel did not prepare or present material in mitigation. The COA did not find that Hooks’s counsel was ineffective in his Atkins proceedings. Barring successful appeal of the Atkins issue to the U.S. Supreme Court, the determination that Mr. Hooks does not have mental retardation is final. It is unlikely that the Atkins proceedings will be appealed.

Mr. Hooks’s case was remanded to state court for a new sentencing hearing. However, current and future 10th circuit defendants and petitioners now face greater difficulty in proving that they have mental retardation
.
[Note: Though “Intellectual Disability” is the term preferred by the AAIDD, the courts still, and almost uniformly, use and refer to “Mental Retardation”.]



[i] Nancy Haydt is an attorney practicing in California and Colorado. Her research includes a nation-wide database of Atkins cases.

Friday, August 24, 2012

IQ Score Interpretations in Atkins MR/ID Death Penalty Cases: The Good, Bad and the Ugly

I just uploaded the following PPT presentation to my SlideShare account---IQ Score Interpretation in Atkins MR/ID Death Penalty Cases: The Good, Bad and the Ugly. It was presented this month (Sept, 2012) at the Habeas Assistance Training Seminar. Click here to view.




Posted using BlogPress from Kevin McGrew's iPad
www.themindhub.com

Thursday, April 26, 2012

SCOTUS petition of the day: Herring v Florida re standard error of measurement (SEM)

http://www.scotusblog.com/2012/04/petition-of-the-day-279/


___________________________
Sent from Kevin McGrew's iPad
Kevin McGrew, PhD
Educational Psychologist
___________________________
The MindHub (TM)
www.themindhub.com
Purpose, Passion & Serendipity
___________________________

Sunday, March 18, 2012

Atkins MR/ID Death Penalty court decision: Brumfield v Cain (LA, 2012)


Thanks to Kevin Foley for sending me a copy of Brumfield v Cain (LA, 2012). Information regarding prior court decisions for Brumfield are available here.

I have only skimmed the decision but a number of statements in the decision are of interest.

First, the court made a clear endorsement of the AAIDD's latest manual on ID classification as the authoritative source for defining ID.

Second, the importance of being a well prepared expert is evident in the following statement regarding one of the state's experts. The court said this about the state's lead expert: "The Court finds Dr. Hoppe’s failure (or inability, if counsel for the State was to blame) to 'obtain corroborating data from collateral sources' in this case renders his testimony here suspect." [pg 28, n.21].

Finally, the court appropriately endorsed the psychometric principle and methods of the standard error of measurement (SEM) and the Flynn Effect adjustment for norm obsolescence. Striking home here at the ICDP blog was the court's citation of IAP AP101 # 7 Report regarding the acceptance of the Flynn Effect by the majority of the scientific community. Starting on the bottom of page 33 and continuing on page 34.... "The Flynn Effect has been widely accepted as a fact in the scientific community, though explaining the cause of this phenomenon has proven more difficult. (Kevin S. McGrew, Is the Flynn Effect a Scientifically Accepted Fact?, Institute for Applied Psychometrics (2010)".



- Posted using BlogPress from Kevin McGrew's iPad

Monday, January 2, 2012

Atkins MR/ID death penalty court decision: Black v Bell (US; TN, 2011)





Thanks again to Kevin Foley for forwarding me a copy of Black v. Bell (2011).

Briefly, this case was remanded for further proceedings.  The case includes a variety of criticall Atkins issues such as the application of the SEM and the Flynn Effect, adaptive deficits vs. strengths and etiology of the condition.

Prior 2005 decision can be found here.

Posted via DraftCraft app

Sunday, October 23, 2011

Atkins MR/ID Death Penalty Decision: Herring v Florida (2011)

Yet another Florida Atkins decision that fails to acknowledge the standard error of measurement. I have previously lamented the unbelievable "Cherry court" bright lint (no SEM allowed) decision previously and won't restate my disbelief again (click here to visit). The latest decision to not allow the use of the SEM is Herring v Florida.

Come on Florida. The SEM is a scientifically accepted fact....beyond dispute.

Thursday, June 30, 2011

Atkins MR/ID Death Penalty court decisions: Pruitt v TN (2011) and Howell v TN (2011)




Two more recent Atkins MR/ID decisions to add to the Atkins MR/ID Court Decisions blogroll, both from TN. I have not read either of the decisions so I don't know if the TN Supreme court recent reversal that indicates that the standard error of measurement (SEM) and Flynn Effect can now be considered in Atkins cases influenced these two lower court decisions.

Pruitt v TN (2011)

Howell v TN (2011)


- iPost using BlogPress from my Kevin McGrew's iPad

Generated by: Tag Generator


Tuesday, April 5, 2011

Time to Stop Executing the Mentally Retarded--The Case for Applying the Standard Error of Measurement

I am pleased to announce that the following IAP Applied Psychometrics 101 (#11) report is now available for viewing and download. I had the unique opportunity to tag along on this paper with Kevin Foley, who is conducting extensive research and writing re: Atkins MR/ID cases. This manuscript is intended more for individuals in the legal profession (judges, lawyers) and is thus written in law review review article format.

Although this report is intended primary for readers of the ICDP blog, I am also posting it to the IQ's Corner blog as those readers may find the attempt to explain SEM in terms understandable by non-psychologists of interest.

Double click on the image below to enlarge.




- iPost using BlogPress from my Kevin McGrew's iPad


Generated by: Tag Generator