Model assumptions were assessed prior to performing ANOVA. ANOVA was applied to duration and effort measures, with results reported in Table 6 (duration) and Table 7 (effort). At alpha = 0.05 neither treatment reached significance. At alpha = 0.1 (90% confidence) results indicated significant differences for both treatments, with p = 0.0969 for duration and p = 0.1017 for effort; the latter was treated as significant despite being slightly above 0.1. The experiment used Latin square designs and included sections on subjects, tasks, measures, treatment comparisons, effect size, power analysis, and multiple validity threats.
Once model assumptions were assessed, we proceed to perform the ANOVA. Table 6 shows the ANOVA for the duration measure whereas Table 7 shows the ANOVA for effort. If we set an alpha level of 0.05 neither treatment (both ANOVA tests) are significant. However setting an alpha level of 0.1 which represents a confidence level of 90% we get significant differences in both treatments.
For the first treatment (Table 6) we get a p-value = 0.0969 with respect to duration, whereas we get a p-value = 0.1017 for the second treatment (Table 7). Although this second p-value is slightly greater than 0.1, we also consider it significant. Authors: (1) Omar S. Gómez, full time professor of Software Engineering at Mathematics Faculty of the Autonomous University of Yucatan (UADY); (2) José L. Batún, full time professor of Statistics at Mathematics Faculty of the Autonomous University of Yucatan (UADY); (3) Raúl A. Aguilar, Faculty of Mathematics, Autonomous University of Yucatan Merida, Yucatan 97119, Mexico.
Abstract and 1. Introduction 2. Experiment Definition 3. Experiment Design and Conduct 3.1 Latin Square Designs 3.2 Subjects, Tasks and Objects 3.4 Measures 4. Data Analysis 4.1 Model Assumptions 4.2 Analysis of Variance (ANOVA) 4.3 Treatment Comparisons 4.4 Effect Size and Power Analysis 5. Experiment Limitations and 5.1 Threats to the Conclusion Validity 5.2 Threats to Internal Validity 5.3 Threats to Construct Validity 5.4 Threats to External Validity 6. Discussion and 6.1 Duration 7. Conclusions and Further Work, and References 4.2 Analysis of Variance (ANOVA)
Collection
[
|
...
]