Gifted Issues Discussion homepage
Posted By: 22B Incongruous test results. Please fill in gaps. - 02/10/13 06:45 PM
A couple of weeks ago our 7yo son took the WISC-IV and WJ-III(Ach) tests. Later we recieved some results by phone and after that got a brief written report (with no subtest scores).

After the testing I asked the psychologist if he had "hit the ceiling"* on any subtests, and she answered "yes, 2 or 3". In the phone call I asked what subtests did he "hit the ceiling on" and she said "Vocabulary and Similarities". But when we got the brief written report the percentile for VCI was only 92.

So given only this information, (which is all we have on VCI) can someone deduce the scores on the 3 VCI subtests
Vocabulary
Similarities
Comprehension

We have requested more detailed information, including subtest scores, but we don't yet know if we'll get it. [Edit to add, it looks like they won't tell us the subtest scores.] Perhaps someone here can fill in the gaps, and suggest if this makes sense.


* By "hit the ceiling" I mean ran out of questions without reaching the termination criteria (getting too many questions wrong)for that subtest.
Thanks! That's great information!

I think "ceiling" definitely meant getting to the end of all the available questions without previously having been terminated due to a string of bad answers. Given this, are you saying that a child can get a scaled score of 17 or 16 (or less?) despite getting to the end of all the available questions, if they have enough 1s and 0s amongst the 2s? (FWIW he just turned 7.)

If I'm thinking wishfully, I'd wonder if maybe the tester thought 19+19+13=41. Is that also plausible? Should I ask them to check?

It's a pity they don't give more detailed information, as it would be valuable, and I wouldn't be having to speculate. (The testers said they are just certifying our son meets the criteria for gifted (>=2SD), and aren't being asked to go into details.) But I'd like to know what the details are and what they mean.

For example, what would VCI scaled scores of 17/16/8 imply about a child, given that the 1st 2 subtests (Voc and Sim) went through all the questions while Comp is 3SD lower?

I'm not sure about posting all this information, but I'm curious what else can be deduced from what information is available. For WISC-IV we only got percentiles (and nothing on individual subtests).

[removed]

What can be deduced from these numbers about the Standard Score and Sum of Scaled Scores in each category? I understand that in some cases the available information could only yield a range of possible values.

For WJ-III we got Standard Scores.

[removed]


What, if anything, should we make of such a combination of high and low scores?


Is anyone able to fill in the missing Standard Scores and Sums of Scaled Scores based on the WISC-IV percentiles?

Also, what should we read into such a mix of high and low scores?
I can't really answer your questions but my 7 yo dd has a somewhat similar wisc-iv spread which I personally don't see very often.(I usually see it where the VCI is much higher or the same as PRI.) Although her PSI isn't nearly as low as your sons.

VCI 95%
PRI >99.9%
WMI 99.7%
PSI 79%

Do you mind my asking why you had your son tested? Was it for entrance into a gifted program or do you have academic concerns?

I'm trying to deduce if my dd may have a hidden learning disability b/c she doesn't always perform up to her ability in class. I haven't figured out if it is an underlying disability or a quirk in her personality/trying to fit in, etc... She does struggle with handwriting. It's still within normal for a 1st grader, but she is frustrated and still reverses a lot.
In a hurry here, and like Dottie I love a puzzle! BUT I also love real data, and you should be able to get your ds' full set of scores. If it's school, you can submit a written request for them; if it's a private provider you can submit a written request for his full file (you might have to pay a slight fee for copying). Personally, I think it's always a good idea to make those requests, even if you think you don't need them now - you might want them later on.

Re the dip in processing speed, that can be a result of an LD or other challenge. Like mountainmom2011, I'm curious what the reasons were you sought out testing?

Best wishes,

polarbear
Thanks for the replies everyone. We actually didn't request the testing at all, and didn't know it was going to happen until a few days before. The school ordered the tests for gifted evaluation, which of course we wanted, so we were happy for the test. They'd already been letting him accelerate in all individual subjects, but needed to certify giftedness to allow a whole grade acceleration, so his homeroom (currently 1st grade) could catch up with all the individual subjects (currently 2nd-4th grade). This is a virtual school, so the logistics of acceleration are much simpler than in a B&M school, but they can always say no, so the test results should ensure they are favorable to acceleration.

Now that we (partially) see the test results, we're certainly curious what the results mean. We're definitely going to try to request the full details from the school, but that could take weeks as they have to get the reports from the testers first. We don't understand why we weren't simply given all the results, and maybe it's going to be a struggle to get hold of that information.

We were surprised the IQ came out as low as it did, (low 130's, barely enough to qualify as gifted), given our son's obvious aptitude for mathematics. The variation among test results has some consistency with what we've observed. He is stronger mathematically than verbally. He does have a good memory, but is sometimes quite slow at some tasks (though I suspect some of the slowness is voluntary). His comprehension is sometimes very good and sometimes not, so a poor performance on a particular comprehension test is plausible, though unlucky. It never occurred to us to consider an "LD", and we would be wary of entering into any kind of evaluation that had the potential of misdiagnosis. We're more inclined to think in terms of relative strengths and weaknesses. We want to understand what the tests may imply but don't want to read too much into them. The PSI score is pretty bad, but who knows what was going on in that part of the test.

Thanks for the calculations, Dottie. So would the sum of scaled scores for WMI 146 be 36? And would the sum of scaled scores for PRI 133-137 be in the range 46-48? (I'm guessing here based on various clues.)

The testers have now given us more details on the WJ-III (but won't for the WISC-IV), so these details are copied below if something can be gleaned from them. (Should I be giving all this detail?). The mathematics scores seem high, but obviously they have been boosted due to having the chance to move far ahead in the curriculum, and to teach himself more advanced things on the internet.

________________________________________

[removed]

________________________________________


Since I'm seeking insights on what all this means, I might as well throw in a few anecdotes for what their worth. Our son was an early reader ("self-taught" with the help of toys and PBS) reading longish words at about 2y9m. He was a late talker, with very minimal speech until suddenly bursting into full sentences at about 3y6m. His sleeping had zero correlation with the usual day-night cycle until about 5y6m.

So what does all this mean?

Any suggestions on plans for the future (e.g. accelerate in Mathematics/Science but not English/History)?

Thanks for any comments.
Hi 22B! Your DS sounds a lot like mine, now 9. We have no formal test results for him (it's a lot less usual here in the UK, and there's never been a positive reason to do it) but he was also an early self-taught reader, late talker, bad sleeper, and very mathy (does well in comparisons with mathy people twice his age, both in problem-solving and in syllabus, even though we've been trying hard not to have him speed through syllabus, preferring to get him to think). Also, very good memory, can be slow. Writing was a particular problem until recently, but with some good help from school (and switching to fountain pen) he's doing amazingly much better now.

Not sure whether I can actually be any use, though! We're very fortunate in DS's school; he's with agemates, but in small classes (15) and, I think, enough differentiation that we're likely to leave him with agemates. (He may, or may not, collect one year of acceleration when we move him to senior school at 12/13 - depends where he goes.) I have strong opinions on how to nurture mathematicians, but it may be that you do too ;-) In brief: mathematics is about solving hard problems, not about being able to carry out algorithms; so acceleration to work with typical school material but with older children may be a useful ingredient, but it's definitely not a complete solution.
At the end of my WJIII report for my son it has a section on expected vs. actual performance. Does yours have this?

It looks to me that he would be outperforming is IQ by a factor of 6 or more on the math. This is significant and could mean that there is something about the IQ test or a hidden LD that is causing his score on the IQ test to be lower. It is not really possible to outperform your IQ like this. It would be the equivalent of my intellectually disabled 5 year old who cannot walk and only says mama and dada being able to add, subtract and multiply or divide on a test today. This is not possible, of course. And it is not possible for your son to have a moderately gifted IQ and yet perform an additional 3 SD higher than that in achievement.

(I am not questioning the achievement scores, but I am questioning the IQ scores. Like Dottie, I would expect to see much higher IQ scores).

I would get as much as you can about the test (raw data, etc) and then talk with someone who specializes in gifted children about the scores.

Thanks for the replies everyone.

ColinsMum, it's nice to hear confirmation that my son is not alone with his combination of characteristics. I basically agree with what you say about how to nurture mathematicians - both parents have Maths PhDs and we know what mathematics is about - but that doesn't mean we know what we should be doing so we are very much open to suggestions. I agree with the sentiments in "The Calculus Trap" http://www.artofproblemsolving.com/Resources/articles.php?page=calculustrap and "Why Discrete Math Is Important" http://www.artofproblemsolving.com/Resources/articles.php?page=discretemath so we certainly want to do many things outside the standard American K-12 Math path. AoPS itself certainly has some interesting such courses, e.g. Counting & Probability and Number Theory, but if someone had courses on set theory, logic, graph theory, etc., then we'd be interested in those too. Mathematics competitions will provide a challenge, and will better gauge where he stands relative to his peers. We will keep accelerating him though, which is easy in a virtual school with its individually paced online courses, until he "officially" gets to (Middle School level) Algebra, and will then diversify into all the other topics and activities.

Dottie, I think you're right that since he could do the timed Math and Reading tests at a good speed, then he should have been been able to do the PSI subtests more quickly. He would know what it meant to do familiar things like Math and Reading quickly, but perhaps when it came to the unfamiliar and novel PSI tasks he'd have no basis for choosing what speed to go at. Perhaps he could have gone much faster, and scored higher (despite making more errors) but he'd have no way of knowing this at the time. This makes me think that PSI is not a robust method for measuring what it's supposed to measure. It's too dependent on a child's choice of speed and how well that choice balances speed and accuracy to maximize score. That's my off the cuff theory anyway. So I'm not going to worry that there's a slow processing issue.

qxp, the WJ-III report did not have the type of information you mentioned. We'll try to get more information. (The WJ-III and WISC-IV were given by two different testers FWIW.) You're right that the combination of scores doesn't seem consistent, so we at least need to put put some healthy error bars on all these numbers. I would (wildly) guess our son is 3 to 4 SD above average in Mathematical ability for his age, so I'm taking the very high WJ-III Math numbers with a grain of salt. I think future Mathematics competitions will give a more accurate picture. On the other hand, the WISC-IV VCI and PSI numbers probably underestimate his abilities, but they could still be his weaker areas. So I would think that if you decrease the higher scores and increase the lower scores, then that would give a more accurate (and plausible) picture. So I'm not thinking the score disparities necessarily indicate some kind of "issue" though I can understand why the concern arises.
Does anyone know what rights one has to obtain full results of testing, including such things as individual subtest scores (raw and scaled), etc.?

What kinds of information do people generally get when they do get some kind of comprehensive report?
Well, let's see.

The companies that publish the tests have certain proprietary rights, so that an assessor cannot, for example, show you the test questions and answer sheets.

What actually goes in the report ends up being a balance between the assessor's professional judgement and what the school district requires. Some assessors will tailor their report, or choose which instruments to use or not use, based on the concerns that are raised in the request for evaluation. For example, if a speech and language assessment has been requested, you might skip certain sections of the academic assessment that cover the same ground.

Subtests scores are part of the report, but different assessors like to report different information. For example, some school psychs like to put confidence intervals after the subtest and summary scores. Others don't want to explain what confidence intervals are and introduce unnecessary confusion with technical statistical information, so they don't bother.

I like to see a discussion of behavioral observations. They might say that the student was on-task and engaged the whole time. They might say that the student got stuck on repeating a joke they heard on TV during a timed portion of the test. I think I actually wrote in one that the student walked over to the piano and played "Heart and Soul" when they had a break!

One thing I love to see in a cognitive report is the school psych's statement that the IQ score either is or is not, in the assessor's professional judgement, a good summary of the student's cognitive potential. For example, if there's a big difference in subtest scores, the school psych may say that one of them is the best approximation of cognitive potential instead of the composite score.

I like to see some kind of interpretation of the subtest scores. And I like to see some kind of practical recommendations based on those scores. For example, a teacher might try various approaches to give a student with a low processing speed score extra wait time in class.

But all reports are not created equal, that's for sure!
Originally Posted by 22B
AoPS itself certainly has some interesting such courses, e.g. Counting & Probability and Number Theory, but if someone had courses on set theory, logic, graph theory, etc., then we'd be interested in those too.
DS quite likes the Barwise & Etchemendy "Language, Proof and Logic" book+CD course - he's done more playing around with the software than systematically going through the book, but that's OK in this case. I would love to recommend you a certain recreational book on logic, sets and proof theory (no, not mine!) but it isn't ready yet. Graph theory's a big hole in the market, it seems to me. Gertrude, Superperson and the Monster ( http://www.ccs3.lanl.gov/mega-math/workbk/graph/grgsm.html ) were a noble start, but it's a pity about the bugs, and besides it's died.
I agree with polar bear that you should ask the school for all of the data in writing. We had private testing done. Our report included raw scores, IQ, Percentile and Confidence Intervals broken into VCI, PRI, WM, PS and FSIQ. Our report also included all subtest scores, both raw and scaled.
Thanks Beckee and knute974 for letting me know what I should be expecting in a report (so I know when they're not giving us enough). I'm also wondering if one has a "right" to receive certain information. For example I found this thread
http://giftedissues.davidsongifted.org/BB/ubbthreads.php/ubb/showflat/Number/128116/
where the OP wasn't being given raw scores (which could be used to find extended norm scores), and one poster suggested that HIPAA gives you a right to these medical records. But are they really medical records, and does HIPAA really apply?

Thanks ColinsMum and kcab for the suggestions of books and online courses. I'm wondering what there is at elementary school level. I saw that EGPY courses include set theory and logic at elementary school level, but they are very expensive and our son is covering all other topics except these for free with k12.com. I think even average elementary school students could learn a bit of basic set theory and logic, and it is a pity these topics are not included in the standard curriculum.
It's been a month and a half and both the testers and the school are flat out refusing to disclose the subtest scores for the WISC-IV. About a month ago they gave just percentiles for VCI, PRI, WM, PS and FSIQ. There are no other numbers and no kind of psychologist commentary or interpretation. They refuse to give us anything else.

Is this normal?

What should we do?

What rights do we have to the missing information?

Thanks. I've already tried getting records, but maybe it'll help if I know about FERPA. Would HIPAA also apply here?

Is it typical for schools to actively try to prevent parents getting access to this kind of information? What is their motiviation? I'm new to this (only our oldest has started school) and so I'm trying to get a better understanding of what is going on. I'm shocked at how determined they are to not give us the results.

The test was ordered by the school, and the tester was paid by the school, but is not a regular employee of the school (or the district). So there are two places to get the information, the tester or the school, which is actually making it even harder to find out.
I don't know if HIPAA helps in this situation. FERPA absolutely should apply. I have never heard of a school hiding results. Is it a public school or private?
It's a public charter virtual school.
The school finally gave us the scores. I decided to put them in a new thread.
http://giftedissues.davidsongifted...._scattered_scores_Any_th.html#Post150672
© Gifted Issues Discussion Forum