Educational tests and measurements

This study investigated Stanford Achievement Test (Eighth Edition) reading scores in vocabulary, comprehension, and total reading achievement. Scores were obtained from gender and socioeconomic levels (SES) of regular education fifth grade students following the use of computer assisted instruction (CAI) using Jostens Learning Corporation software. Factorial analyses of variance were performed to test the interaction between high and low socioeconomic levels (SES) of regular education students, and gender on the Stanford Achievement Scores (Eighth Edition) in the areas of vocabulary, comprehension, and total reading achievement. All participants used computer assisted instruction for three years as a supplement to basal reading instruction. The sample consisted of 590 elementary students (312 females and 278 males) in grade 5. Socioeconomic levels were determined by whether or not the students received free or reduced price lunch (139 low SES students and 451 high SES students). All participants attended the same school for three years and had three consecutive years of scores in vocabulary, comprehension, and total reading achievement on the SAT. Gain scores were obtained by subtracting the 1994 scores from the 1996 scores in vocabulary, comprehension, and total reading achievement. Mean gain scores were compared between groups using factorial analysis of variance, with SES and gender as the factors. Analyses revealed that there was not a significant (p < .05) difference between high and low SES students in comprehension or total reading achievement. There was a significant $(p < .05)$ difference between high and low SES students in vocabulary gain scores, but the difference was too small to be of practical significance. Analyses revealed that there was not a significant (p < .05) difference between males and females and scores in vocabulary, comprehension, or total reading achievement. There was a significant interaction (p < .05) between gender and SES in vocabulary, comprehension, and total reading achievement scores. Results of this study clearly indicated that there were more gains for certain groups of students. Recommendations suggest that future research includes close examination of low SES male students and their unique learning styles. Characteristics, their interactions with the computer and software design should also be studied.

This study explored the predictive accuracy of three, two-group linear discriminant function equations. The grouping or criterion variables employed were scores from the three sections (math, reading, and writing) of the Computerized Placement Test (CPT). The predictor variables used were gathered from the academic history for each case. These variables ranged from the GPA in grade eight, through the normal-curve-equivalent test scores in both math and reading from the Grade Ten Assessment Test (GTAT), and included several actual GPAs achieved in science and math courses at all three levels of difficulty in high school (Appendix A). The data set was built from 16 variables derived from the academic history of 432 graduates of the Broward County public schools in 1994. Each of these cases was found to have had a pass/fail score on the Florida Entry-Level-Placement Test (CPT) at Broward Community College. All three discriminant function equations were examined to determine if the models were statistically significant and reliable, or consistently repeatable, using both a leave-one-out analysis, and a hold-out estimate analysis. The degree to which the models performed better than proportional chance was also investigated. The results of the three, two group discriminant equations built from the predictor variables and the grouping variables have implications for high school counselors. These data indicated a better prediction for students who do not pass (90.4%) the CPT than for those who do pass (48.8%) the entry-level placement test at Broward Community College. The external analyses (leave-one-out and hold-out) show some reduction in predicting accurately; but, as demonstrated by the Z class summary, still are predicting at a significant level for the samples with the exception of the CPTRJ hold-out method for the non-selected group. For high school counselors, then, this research was designed to encourage early examination of particular data sets for the purpose of predicting success on the Florida entry-level placement test. Successful course selection can assist students gain access to college.

The Boston Naming Test (60 items) and the newly developed Miami Naming Test (76 items) are designed to assess naming deficits and word-retrieval capacities. These two tests were compared in a sample of 106 Afro-Caribbean elders. Analysis included inter-rater, test-retest reliability and internal consistency using Cronbach's alpha. The correlation between the scores of both raters on the Boston Naming Test was r=.9974 and r=.9984 on the Miami Naming Test. The test-retest reliability scores were r=.936 for the Boston Naming Test and r=.931 for the Miami Naming Test. The alpha level for the Miami Naming Test was .95 and the Boston Naming Test was .94. The individual items for both tests were evaluated for their level of difficulty and the scores on the Miami Naming Test were compared to the Boston Naming Test and the Mini Mental State Exam results. Results indicated acceptable levels of reliability for both the Boston Naming Test and the Miami Naming Test. This study shed light on which items should be replaced or deleted and future directions for research on assessment of dementia on older adults of Afro-Caribbean background. This study was supported by Minority Supplement grant #NR07744-01 and was guided by design of the parent grant Culture Bias in Expressive Ability in Dementia funded by the National Institute of Nursing research.

Many students with specific learning disabilities (LD) exhibit reading difficulties that interfere with their performance on "high-stakes" standardized tests with math word problems. Therefore, it is important to identify accommodations that will lead to valid test scores. Audio presentation for math word problems is intended to remove the effects of a disability in reading. One purpose of the study was to conduct an empirical investigation of the effects of audiocassette presentation by comparing the performance of students with LD and students from general education (GE). Another was to investigate the relationship, if any, between the level of knowledge of mathematics vocabulary and the benefit of audiocassette presentation for the students with LD. Finally, the study sought to extend the current research base to students in middle school. Twenty-four students with LD and 24 from GE were tested with parallel forms of the Math section of the Iowa Test of Basic Skills. Half of each group tested with form K under standard administration and received audiocassette presentation for form L. The other half of each group was tested with form L under standard administration and audiocassette presentation for form K. Finally, the Vocabulary subtest from the Test of Mathematical Abilities, 2nd edition (TOMA-2) was administered. Separate paired t tests were performed for the GE group and for the group with LD. The performance of the two groups was then compared with repeated measures analyses. No statistically significant differences were found, which was attributed, in part, to small sample size. Minimal change in the mean performance of either group occurred after audiocassette presentation for Math Concepts. The group mean for LD on Problem Solving improved slightly with the accommodation. Repeated measures analyses showed no significant difference in performance between students with "high" vs. "low" levels of math vocabulary. A floor effect, along with the students' level of academic language proficiency, may have affected the results. Some students improved their scores with audio presentation, but others scored lower. This reinforces the need to base the use of any test accommodation on individual need, not disability label or other factors.

This study investigated the effect of the disability labels learning disabilities (LD) and emotional handicaps (EH) on general education and special education teachers' willingness to refer students to gifted programs. Referral differences between general education and special education teachers were also examined. Two hundred forty-seven teachers (195 general education teachers and 52 special education teachers) from one south Florida school district participated in this study. Participants were randomly assigned to one of three conditions (no label, LD, EH) and asked to read a vignette describing a gifted student. All vignettes were identical except for one statement added to the LD or EH group stating the student had a disability. After reading the vignette, teachers completed a survey instrument with six questions regarding possible referral options. One of the six questions asked if they would refer the student to their school's gifted program. Teachers indicated their responses by circling one of four choices: strongly agree, agree, disagree or strongly disagree. Responses to the gifted referral question on the survey instrument served as the dependent variable. A 2 x 3 factorial analysis of variance (ANOVA) was used to evaluate the main effects of labeled conditions (three levels), teacher certification type (two levels), and the interaction between labeled condition and teacher type. Results indicated that teachers were significantly influenced by the LD and EH label when making referrals to gifted programs. Both special education and general education teachers were much less willing to refer students with disability labels to gifted programs than identically described students with no disability label. Additionally, when compared to general education teachers, special education teachers were less likely to refer a gifted student, with or without disabilities, to a gifted program. Implications were discussed and recommendations for future research were made.

The purpose of this study was to investigate the use of Classroom Assessment Techniques (CATS) by adjunct faculty at 3 homogeneous Florida community colleges, 1 Vanguard and 2 non-Vanguard. A qualitative methodology, with a phenomenological approach, helped to describe the meaning that the experience of using CATS had for adjunct professors. Interviews with 18 participants, including adjunct faculty and faculty development administrators, were the primary means of data collection, supplemented by researcher field notes, demographic profile sheets, and analysis of actual CATS. The data synthesized into 3 levels of meaningful encounters, revealing the barriers that inhibited adjunct faculty use of CATS and how those obstacles were overcome, as well as facilitators that promoted use of CATS. A critical finding was that CATS did not motivate adjunct faculty to move from "private" investigation of student learning to "public dialogue" on teaching and learning that can add to the scholarship of teaching. The data showed that institutional commitment to CATS and a formal introduction to them as formative assessment, built upon a solid research base, were important steps toward encouraging their use. Also, "high touch" faculty development activities, which included CATS, effectively complemented those that were "high tech." The findings of the study indicated that the Vanguard and non-Vanguard colleges shared similar ideas. The Vanguard Learning College, however, distinguished itself by the actions taken to become more learning-centered; adjunct faculty participants assumed leadership roles as educational researchers who pursued independent projects to develop instructional materials to improve student learning as compared to adjunct professors at the non-Vanguard colleges. The following conclusions were reached: (a) Community college adjunct faculty use CATS to expand their own learning, often by designing probing questions in response to immediate classroom concerns. Therefore, the experience of using CATS is unique for each professor. (b) Deprivatizing adjunct faculty teaching is difficult, and sharing meets with resistance. At the Vanguard College, individual and communal learning are beginning to fuse. (c) CATs strengthen learning colleges as communication tools between instructors and individual students, but are not used to their fullest advantage to generate public dialogue on student learning.

The purpose of the present study was to investigate the
variable effects of different testing frequencies upon the
achievement of college students of three levels of ability.
Frequency of testing was selected for research because of the
role it serves in the behavioral system of instruction initiated
by Fred Keller. Past research on the effect of increase in
test frequency has produced ambivalent results, in part
because of repeated methodological errors, in part because
the individual learning level of each S has not been a
primary concern in the design of these studies. The basic
hypothesis of this experiment was that the effects of increased
quiz occurrence depend on previous academic history. Results were discussed in relation to the practice of
infrequent testing. Such procedures most handicap those
with poor backgrounds. Those institutions serving this type
of student should re-evaluate their examination methods and
consider the use of frequent quizzes.
Further suggestions were made to extend the investigation
of the functional relationship between instructional techniques
and individual histories.

This study explored how contextual factors influenced the effect of educational practices on student reading achievement and describes an alternative means of assessing educational programs under conditions of multiple-treatment interference and innovation diffusion. Over 1,500 reading teachers at 69 elementary schools within a large diverse district completed surveys regarding multiple aspects of the reading program, actions of their reading leaders, and instructional program coherence at their schools. Nearly 13,000 students in grades 2 through 5 were assigned to those teachers. Factor analyses were used to separately identify patterns within survey items that measured educational practices, leadership actions, and instructional program coherence. Then, the students' achievement gains were adjusted for the effects of fixed demographic and organizational variables through hierarchical linear modeling. Finally, classroom level relationships between the adjusted achievement gains, and subscales computed from the factors that were identified, were examined through a path analysis. Educational practices were found to align to six factors labeled Technology, Training Utility, Advanced Skills, Basic Skills, Grouping, and Assessment. Leadership actions were found to align to two factors labeled Relationship and Task. Fixed effects at the student, classroom, and school levels were found to have an impact on both the initial status and growth components of student achievement. In the path model, Task was found to have a significant direct effect on Advanced Skills, while the effect of Relationship on educational practices was partially mediated by Instructional Program Coherence. Both Advanced and Basic skills were found to have positive effects on Adjusted Gain when taught at the appropriate level, and negative effects, when taught at the inappropriate level.

The purpose of this study was to examine the effects of four instructional methods - context clues, definition, elaboration technique, or word parts and word families- on the vocabulary growth and acquisition of adults enrolled in a community college developmental reading course. The study investigated whether performance in any or all of the four instructional methods was moderated by age or language. Seventy-three respondents participated in the study. Participants were enrolled in one of five sections of College Reading Preparatory II (REA0002) offered in the Spring of 2009 at Indian River State College in Fort Pierce, Florida. All five sections of REA0002 were taught by the same professor, a tenured faculty member, chair of the developmental reading department and Associate Professor of Developmental Reading at Indian River State College. The instruction and tests in all five sections of REA0002 were consistent with the research design which insured continuity and consistency in the use of the four instructional methods. All participants received the same treatment and quizzes. During the course of the study, participants first received a pretest, then the treatment or instruction, followed by an instructional quiz, and a delayed post-test was administered at the end of the study. An analysis of the data, which included the pretest, instructional quizzes with four quizzes independently and then combined for an aggregate score for an immediate post-test, and the delayed post-test, yielded mixed results. The four instructional quizzes independently showed definition instruction to have the highest positive impact on student learning. In a measure of gains from pretest to instructional quizzes immediately after treatment, significant improvement in student learning was found only with word parts instruction.

The focus of this study is on evaluating the impact of a school counselor-led program, Ready for Success (RFS) on the academic achievement of second- and third grade students. The research question investigated in this study was: How do students in grades 2 and 3 who receive the RFS classroom intervention perform on the Scholastic Reading Inventory (SRI) when compared to students in grades 2 and 3 who do not receive the RFS classroom intervention. This study is significant because it addresses the need for more outcome research tying school counselor led interventions to student achievement. Research based interventions for school counselors that improve academic achievement directly address the current focus on student achievement outcomes as well as the need for accountability of school counselors. The sample for this study included 240 participants, 107 in the treatment group and 133 in the comparison group. Students were selected from all second- and third-grade classes at four schools in South Florida. There were 66 participants in the second grade; 37 were male and 29 were female. There were 174 participants in the third grade; 92 were male and 82 were female. Academic achievement was measured using a standardized, objective, state-wide assessment instrument, the Scholastic Reading Inventory (SRI). The analysis used for this study was an analysis of covariance (ANCOVA). Pretest scores on the SRI were used in the study as covariates on the dependent variable to account for group differences at pretest. The statistical analysis shows that there was no significant difference between the comparison and treatment group reading achievement levels on the SRI. Upon further review of the research a significant, confounding variable was discovered. High concentration of non-ESOL students were in the comparison group as compared to the treatment group.