J. Frass and I. Newman (2000) proposed a hypothesis testing procedure that incorporated the following three key elements: (1) the establishment of a practical significance value; (2) the construction of a non-nil null hypothesis that incorporated the practical significance value; and (3) statistical testing of the non-nil null hypothesis with a randomization test. One of the difficulties researchers may encounter with this testing procedure is the implementation of the randomization test. This...
Topics: ERIC Archive, Computer Software, Hypothesis Testing, Statistical Significance, Fraas, John W.,...
This paper presents a testing procedure that incorporates three key elements. The first element is the use of non-nil null hypotheses. The second element is the determination of a practically significant level that is incorporated into the corresponding non-nil null hypothesis. The third element is the use of a randomization test to statistically test each non-nil null hypothesis. This procedure stresses two philosophical positions. First, the concepts of practical and statistical significance...
Topics: ERIC Archive, Cost Effectiveness, Statistical Significance, Test Construction, Fraas, John W.,...
Over the last few years, there has been evolution, although not a linear one, that has progressed from an emphasis on statistical significance to an emphasis on effect size to an emphasis on both of these concepts to what is believed to be a pragmatic emphasis on replicability. This paper presented two methods of estimating a study's replicability that researchers should consider reporting along with their statistically significant and effect size findings. One method of estimating the...
Topics: ERIC Archive, Effect Size, Research Methodology, Statistical Significance, Newman, Isadore, McNeil,...
This paper evaluates the competitiveness of Ashland University (Ohio) faculty salaries and the degree of compression present in those salaries.. Based on the results of an academic year 1992-1993 evaluation of competitiveness and compression, a program was designed and implemented to increase salary levels of Ashland University faculty and at the same time reduced the degree of compression. This paper examines 1999-2000 academic year salary levels with respect to competitiveness and degree of...
Topics: ERIC Archive, College Faculty, Comparable Worth, Competition, Employment Practices, Higher...
This paper presents a method designed to assist practitioners in the interpretation of the practical significance of a statistically significant logistic regression coefficient is presented. To avoid the interpretation problems encountered when using the traditionally reported change in either the log odds or odds values, this method centers the interpretation on the change in the probability value of the event occurring associated with a given change in the independent variable for a range of...
Topics: ERIC Archive, Computer Software, Probability, Regression (Statistics), Test Interpretation, Fraas,...
Statistical significance and practical significance can be considered jointly through the use of non-nil null hypotheses that are based on values deemed to be practically significant. When examining differences between the means of two groups, researchers can use a randomization test or an independent t test. The issue addressed in this paper is whether Type I error rates produced by independent t tests of group means are impacted by the use of non-nil null hypotheses. The results of this Monte...
Topics: ERIC Archive, Groups, Hypothesis Testing, Monte Carlo Methods, Statistical Significance, Newman,...
The purpose of this paper is to assist researchers, practitioners, and graduate students in identifying and addressing key questions related to the task of choosing among the analytic techniques designed to analyze a dichotomized dependent variable with a set of independent variables. The discussion is limited to (1) the analysis of data by the analytic procedures of ordinary least squares regression, discriminant analysis, or logistic regression; (2) the use of the Statistical Package for the...
Topics: ERIC Archive, Discriminant Analysis, Least Squares Statistics, Regression (Statistics), Research...
Educational researchers often use multiple statistical tests in their research studies and program evaluations. When multiple statistical tests are conducted, the chance that Type I errors may be committed increases. Thus, the researchers are faced with the task of adjusting the alpha levels for their individual statistical tests in order to keep the overall alpha value at a reasonable level. A three-step procedure is presented that can be used to adjust the alpha levels of the individual...
Topics: ERIC Archive, Decision Making, Educational Research, Error of Measurement, Program Evaluation,...
This paper presents a discussion of various statistical concepts and techniques in light of two propositions. The first is that researchers need to select analytical techniques that prevent them from committing Type VI errors, which are inconsistencies between the research question and the statistical analysis. The second is that many statistical techniques are interrelated on a conceptual level. In addition, a list of resources is presented to assist researchers who want to pursue a more...
Topics: ERIC Archive, Multivariate Analysis, Research Design, Research Methodology, Statistical Analysis,...
When investigating the impact of predictor variables on an outcome variable or measuring the effectiveness of an educational program, educational researchers and program evaluators cannot ignore the possible influences of interaction effects. The purpose of this paper is to present a procedure that educational researchers can follow in order to increase their understanding of the nature of the interaction effect between a treatment variable and a continuous independent variable. This technique...
Topics: ERIC Archive, Computer Software, Evaluation Methods, Interaction, Outcomes of Education, Predictor...
One may receive the most benefit from an evaluation of an educational program or the performance of a teacher if the evaluation process is approached from a Total Quality Management (TQM) point of view. Under the philosophy of TQM, the purpose of any evaluation process is to provide feedback for the continual improvement of the educational process that is being evaluated. In the process of obtaining this feedback, the evaluator must be cognizant of two concepts that are basic to the TQM...
Topics: ERIC Archive, Data Analysis, Educational Change, Feedback, Formative Evaluation, Longitudinal...
This is a report of a limited study of four factors that might affect a teacher's level of acceptance of mandated change. The factors are: (1) number of years the teacher and principal have worked together; (2) years of experience of the teacher involved in the change process; (3) whether the teacher has tenure; and (4) the participatory nature of the school climate. Data for the study were collected from a review of the literature and from a survey of 61 elementary teachers from one school...
Topics: ERIC Archive, Change Agents, Educational Change, Elementary Secondary Education, Organizational...
Teacher efficacy has been identified as a variable that can influence teacher effectiveness. The results of methods designed to change teacher efficacy, however, have been mixed. The purpose of this study was to evaluate the possible impact on teacher efficacy of the FOCUS (1992) instructional method, which is designed to create an environment in teacher-education classes that is receiver-oriented, using activities and strategies designed to match students' learning styles. Participants were 68...
Topics: ERIC Archive, Classroom Environment, Elementary School Teachers, Elementary Secondary Education,...
