ITEDU 600: Curriculum Evaluation in Technical Education
Resources
___________________________________
| CONCEPTS
OVERVIEW of EVALUATION
Burt, M.R., Harrell, A.V., Newmark, L.C., Aron, L.Y., & Jacobs, L.K. (1997). Evaluation guidebook. Project funded by S.T.O.P. Formula Grants under the Violence Against Women Act. Retrieved April 6, 2008, from http://www.jrsa.org/evaluationwebsite/guide/documents/stop1-4.html
Center for Creative Leadership. (n.d.). Leading Effectively Podcast Series [Audio]. Retrieved April 4, 2008, from http://www.ccl.org/leadership/podcast/transcriptValueofEvaluation.aspx
Confrey, J. (2006). Comparing and contrasting the National Research Council Report on evaluating curricular effectiveness with the What Works Clearinghouse Approach. Educational Evaluation and Policy Analysis, 28(3). 195-213. Retrieved January 21, 2008, from http://epa.sagepub.com/cgi/reprint/28/3/195
Duvall, J., Higgs, A., & Wolske, K. (2007). Evaluation: What is it and why do it? My Environmental Education Evaluation Resource Assistant. Retrieved July 21, 2008, from http://meera.snre.umich.edu/plan-an-evaluation/evaluation-what-is-it-and-why-do-it
Ericae.net is the Eric clearinghouse for assessment, evaluation and research information. The How-To Series, a set of on-line, full-text books and booklets addressing practical evaluation, research, measurement, and statistical issues, is extremely helpful.
Gajda, R. & Jewiss, J. (2004). Thinking about how to evaluate your program? These strategies will get you started. Practical Assessment, Research & Evaluation, 9(8). Retrieved January 21, 2008 from http://PAREonline.net/getvn.asp?v=9&n=8
Guba, E.G. (1973). The failure of educational evaluation. In Number Eleven, Evaluation of Education, The Educational Technology Reviews Series. Englewood Cliffs, NJ: Educational Technology Publications.
McNamara, C. (1997). Basic guide to program evaluation. Retrieved January 19, 2008, from http://www.managementhelp.org/evaluatn/fnl_eval.htm
Morrison, J. (2003). ABC of learning and teaching in medicine: Evaluation. BNJ, 326(7385), 385-487. Retrieved April 4, 2008, from http://www.pubmedcentral.nih.gov/picrender.fcgi?artid=1125244&blobtype=pdf
Norris, N. (1998). Curriculum evaluation revisited. Cambridge Journal of Education, 28(2). Retrieved March 28, 2005 from Academic Search Premier. (AN851432)
Patton, M. (2007). Qualitative evaluation checklist. The Evaluation Center. Western Michigan University. Retrieved July 12, 2007, from http://www.wmich.edu/~evalctr/checklists/qec/index.htm
Posavac, E.J. & Carey, R.G. (2007). Program evaluation: Methods and case studies (7th ed.). Upper Saddle River, NJ: Prentice Hall.
Practical Assessment, Research and Evaluation (PARE) is an on-line journal. Its purpose is to provide education professionals access to refereed articles that can have a positive impact on assessment, research, evaluation, and teaching practice, especially at the local education agency (LEA) level.
Program development and evaluation. University of Wisconsin-Extension. Evaluation Publications are available at http://www.uwex.edu/ces/pdande/evaluation/evaldocs.html
Scriven, M. (1973). The methodology of evaluation. In B.R. Worthen and J. Sanders, (Eds.), Educational evaluation: Theory and practice. Belmont, CA: Wadsworth.
Sowell, E. J. (2005). Curriculum: An integrated approach (3rd ed.). Upper Saddle River, NJ: Pearson Education.
Spaulding, D.T. (2008). Program evaluation in practice: Core concepts and examples for discussion and analysis. San Francisco, CA:Jossey-Bass.
Willis, J. (1981). Democratization of curriculum evaluation. Educational Leadership, 38(8), 630-632. Retrieved March 28, 2005 from http://search.epnet.com/login.aspx?direct=true&db=aph&an=9397127
The Evaluation Center located at Western Michigan University offers a Glossary Database.
W.K. Kellogg Foundation. (1998). W.K. Kellogg Foundation evaluation handbook. Retrieved April 3, 2008, form http://www.wkkf.org/Pubs/Tools/Evaluation/Pub770.pdf
__________________________________________________
EVALUATION CONCEPTS
ACCOUNTABILITY
ERIC Clearinghouse for Junior Colleges. (1984). Educational accountability. ERIC Digest. Retrieved March 18, 2008, from http://www.ericdigests.org/pre-926/educational.htm
Reeves, D. (2004). Accountability for learning: How teachers and school leaders can take charge. Chapter 1 available at ASCD.
ACCREDITATION
educationUSA.gov. (n.d.). Accreditation guide. Bureau of Educational and Cultural Affairs, U.S. Department of State. Retrieved April 16, 2008, from http://educationusa.state.gov/accred.htm
Indiana Department of Education. (2008). Accreditation. Indiana Accountability System for Academic Progress, Indiana Department of Education. Retrieved May 28, 2008, from http://www.doe.in.gov/asap/accreditation.html
North Central Association Commission on Accreditation and School Improvement, Board of Trustees
U.S. Department of Education. (2008). Accreditation in the United States. Overview of accreditation. Financial Aid for Postsecondary Students. Retrieved April 12, 2008, from http://www.ed.gov/admins/finaid/accred/accreditation.html#Overvieew
U.S. Department of Education Database of Accredited Postsecondary Institutions and Programs
ACTION RESEARCH
Merrill, C. (2004). Action research and technology education. The Technology Teacher, 63(8).
Mills, G.E. Action research: A guide for the teacher researcher. Upper Saddle River, NJ: Merrill Prentice Hall.
Stringer, E. (2004). Action research in education. Upper Saddle River, NJ: Pearson Education Inc.
Wideman, R. (1999). The power of action research: Supporting professional learning through inquiry. The Ontario Action Researcher, 2(2). Retrieved October 23, 2008, from http://www.nipissingu.ca/oar/archive-Vol2No2-V223E.htm
ADEQUATE YEARLY PROGESS (AYP)
ED.gov (2002). Strategies for making Adequate Yearly Progress, Using curriculum based-measurement for progress monitoring. Presentations from the Student Achievement and School Accountability Conference, October 2002. Retrieved April 18, 2008, from http://www.ed.gov/admins/lead/account/aypstr/edlite-index.html
ALIGNMENT
Pennsylvania System of School Assessment (PSSA). (2001). Curriculum alignment. Retrieved September 10, 2008, from http://www.pde.state.pa.us/a_and_t/lib/a_and_t/curriculumalignment.pdf
Association of College and Research Libraries & American Library Association. (n.d.). Analysis of instructional environments. Retrieved September 23, 2009, from http://www.ala.org/ala/mgrps/divs/acrl/about/sections/is/projpubs/aie/instenvironments.pdf
ARTICULATION, Vertical
Scarborough, J.D. (n.d.). Articulation: An extended model and educational pathways to careers. Strategic Alliance to Advance Technological Education through Enhanced Mathematics, Science, Technology, and English Education at the Secondary Level. Northern Illinois University. Retrieved October 18, 2008, from http://www.ceet.niu.edu/orgs/nsfstali/frameset.html
CERTIFICATION, Qualification
Education
Industry and Trades
CHANGE and DIFFUSION
Kirkpatrick, D.L. (1998). Chapter 3: The four levels: An overview. Evaluating Training Programs: The Four Levels (2nd ed.). San Francisco: Berrett-Koehler Publishers, Inc.
ETHICS and HUMAN SUBJECT PROTECTION
Ethical Standards of the American Educational Research Association (AERA)
American Evaluation Association (AEA) Guiding Principles for Evaluators
Title 45 Public Welfare, Part 46 Protection of Human Subjects
American Psychological Association (APA) 2002 Ethics Code (PDF))
The Joint Committee on Standards for Educational Evaluation (1994). The program evaluation standards. Thousand Oaks, CA: Sage Publications, Inc. [Summary available at http://www.wmich.edu/evalctr/jc/PGMSTNDS-SUM.htm]
EVALUATION STANDARDS
Stufflebeam, D.L. (1999). Program evaluations metaevaluation checklist. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/checklists/program_metaeval.pdf
Gangopahdyay, P. (2002). Making the evaluation meaningful to all education stakeholders. [Checklist]. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/checklists/makingevalmeaningful.pdf
EVIDENCE-BASED PRACTICE
Comprehensive School Reform Quality Center from 2003 through 2006, through a grant to the American Institutes for Research from the Office of Elementary and Secondary Education of the U.S. Department of Education. CSRQ offers reviews and guidance on the effectiveness and quality of the leading comprehensive school reform (CSR) models..
The Center for Data Driven Reform in Education
National Staff Development Council provides several resources addressing data-driven decision-making.
HIGHLY QUALIFIED TEACHERS (HQF)
ED.gov (2002). Highly qualified teachers and paraprofessionals. Presentations from the Student Achievement and School Accountability Conference, October 2002. Retrieved April 18, 2008, from http://www.ed.gov/admins/tchrqual/learn/hqt/edlite-index.html
LICENSURE
Resources of Indiana Department of Education including the Division of Professional Standards and Teacher Inquiry (database of individuals holding a teacher license in Indiana).
MAPPING
ATLAS MAPS at the American Association for the Advancement of Science
Burn, R.C. (2001). Curriculum mapping. Curriculum Handbook. Association for Supervision and Curriculum Development. Retrieved August 21, 2007, from ASCD.
Curriculum Mapper presents "What is curriculum mapping?"
DMAC Solutions provides several examples of reports which are generated from mapping databases at http://www.dmac-solutions.net/state/help/html/TAKS/Reports/Instructional/TAKS_Instructional_Reports_Examples.htm
Glencoe/McGraw-Hill offers a Curriculum Mapping Primer at http://www.glencoe.com/sec/teachingtoday/educationupclose.phtml/35
Fayette County Public School's Curriculum Map and Framework
Least Tern's What is Curriculum Mapping?
Teach Resources. (2008). Curriculum mapping. CurriculumMapping101.com. Retrieved August 29, 2008, from http://www.curriculummapping101.com/Curriculum_Mapping.html
EXAMPLES:
Brighton Central School in Kentucky offers several maps, e.g., Technology 9 Communications and Technology Grade 8
MERIT and WORTH
Stufflebeam, D.L. (2001). Evaluation values and criteria checklist. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/checklists/values_criteria.pdf
QUESTIONS
Online Evaluation Resource Library (OERL). (n.d.). Curriculum Development Annotated Plan Excerpts. OERL: Plans: Curriculum Development. Retrieved April 14, 2008, from hhttp://oerl.sri.com/plans/cd/planCD_eo.html
Shadish, W. (1998). Some evaluation questions. Practical Assessment, Research & Evaluationn, 6(3). Retrieved January 21, 2008 from http://PAREonline.net/getvn.asp?v=6&n=3
The University of Texas Medical Branch offers explanations of three types of research questions (descriptive, relationship, and comparison) at http://www.sahs.utmb.edu/pellinore/Intro_to_research/wad/design.htm.
Marzano, R. J. (1996). Eight questions about implementing standards-based education. Practical Assessment, Research & Evaluation, 5(6). Retrieved April 12, 2008 from http://PAREonline.net/getvn.asp?v=5&n=6
STANDARDS
Alexandra Beatty, Rapporteur, Committee on State Standards in Education: A Workshop Series, National Research Council. (2008). Common standards for K-12 education?: Considering the evidence: Summary of a Workshop Series. National Academies Press. Retrieved September 2, 2008, from http://www.nap.edu/catalog.php?record_id=12462
VARIABLES
Professor Jon'a Meyer's RealPresenter streaming slide explains independent, dependent, intervening, and moderating variables. This 16-minute multimedia presentation is called Variables in Social Science Research. It is located at http://www.camden.rutgers.edu:8080/ramgen/jfmeyer/mc-film04/trainer.smi and requires the RealMedia player. The player is available as a download from http://www.real.com///a>
VALIDITY
Association for Supervision and Curriculum Development presents Sources of Bias and Protections from Bias
Winter, G. (2000). Comparative discussion of the notion of 'Validity' in qualitative and quantitative research. The Qualitative Report, 4, (3 & 4). Retrieved March 31, 2006, from http://www.nova.edu/ssss/QR/QR4-3/winter.html
__________________________________________________
APPROACHES, MODELS, & METHODS of EVALUATION
ADVOCACY and POLICY CHANGE EVALUATION
Patton, M.Q. (2008). Advocacy impact evaluation. Journal of Multidisciplinary Evaluation, 5(9). Retrieved April 8, 2008, from hhttp://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/159/181
APPROACHES or MODELS
Bell, E.J. & Dudley, R,J. (1998). Elements of effective curriculum evaluation: An analysis of a Queensland model of curriculum evaluation. Paper presented at ‘Framing the Future’, the September 1999 Biennial Conference of the Australian Curriculum Studies Association. Retrieved April 23, 2008, from http://www.acsainc.com.au/content/99_bell_elements.pdf
Stufflebeam, D.L. (1999). Foundational models for 21st Century program evaluation. Occasional Papers Series. The Evaluation Center. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/pubs/ops/ops16.html
CIPP (context, input, process, and product)
Stufflebeam, D.L. (2000). The CIPP model for evaluation. In Daniel L. Stufflebeam, George F. Madause, & Thomas Kellaghan (Eds) Evaluation Models: Viewpoints on educational and human services evaluation (2nd ed.). Boston: Kluwer Academic Publishers
Stufflebeam, D.L. (2000). CIPP Evaluation Model Checklist. The Evaluation Center Western Michigan University. Retrieved August 29, 2008, from http://www.wmich.edu/evalctr/checklists/cippchecklist.htm">hhttp://www.wmich.edu/evalctr/checklists/cippchecklist.htm
Stufflebeam, D.L. (2003). CIPP Evaluation model checklist: A tool for applying the Fifth Installment of the CIPP Model to assess long-term enterprises. The Evaluation Center, Western Michigan University. Retrieved April 8, 2008, from http://www.wmich.edu/evalctr/checklists/cippchecklist.htm
PowerPoint Overview prepared by Federal Railroad Administration, Department of Transportation.
Students in the Conflict Management Program at The Johns Hopkins University School for Advanced International Studies. (n.d.). Evaluation approaches. The Conflict Management Toolkit. Retrieved August 28, 2008, from http://www.sais-jhu.edu/cmtoolkit/issues/evaluation/approaches.html
U.S. Department of Education. (2004). New directions for program evaluation at the U.S. Department of Education. Author. Retrieved April 8, 2008, from http://www.ed.gov/news/pressreleases/2002/04/evaluation.html
Science Program Improvement Review.
Jadaus, G.F. & Kellaghan, T. (2000). Models, metaphors, and definitions in evaluation. In Daniel L. Stufflebeam, George F. Madause, & Thomas Kellaghan (Eds) Evaluation Models: Viewpoints on educational and human services evaluation (2nd ed.). Boston: Kluwer Academic Publishers.
Sander, J. (1988). Approaching evaluation in small schools. ERIC Digest. Las Cruces, NM: ERIC Clearinghouse on Rural Education and Small Schools. (ERIC Document Reproduction No. ED296816)
Utterback, Ph., H., and Kalin, M. (1989). A community-based model of curriculum evaluation. Educational Leadership, 77(2), 490-50. Retrieved March 28, 2005 from http://search.epnet.com/login.aspx?direct=true&db=aph&an=8523771
ASSESSMENT: AUTHENTIC or PERFORMANCE
Hoepfl, M. (2007). Alternative classroom assessment tools and scoring mechanisms (p. 65-86). Marie Hoepfl & Michael R. Lindstrom (Eds.). (2007). Assessment of technology education. 56th Yearbook Council on Technology Teacher Education. Woodland Hills, CA: McGraw Hill.
Kimball, R. (2007). Assessment of design and technology in the U.K.: International approaches to assessment. Marie Hoepfl & Michael R. Lindstrom (Eds.). (2007). Assessment of technology education. 56th Yearbook Council on Technology Teacher Education. Woodland Hills, CA: McGraw Hill.
Mueller, J. (2008). Authentic assessment toolbox [Tutorial]. Retrieved October 21, 2008, from http://jonathan.mueller.faculty.noctrl.edu/toolbox/howdoyoudoit.htm
Pinellas School District & The Florida Center for Instructional Technology. (n.d.). Performance assessment. Classroom Assessment [Tutorial]. University of South Florida: Authors. Retrieved October 5, 2008, from http://fcit.usf.edu/assessment/performance/assess.html
Stiggins, R.J. (2000). Specifications for a performance-based assessment system for teacher preparation. National Council for Accreditation of Teacher Education. Retrieved October 14, 2008, from http://www.ncate.org/documents/articles/stiggins.pdf
ASSESSMENT PLAN
Office of Academic Assessment and Institutional Research. Ball State University. (1999). Designing a department assessment plan. Ball State University. Retrieved October 21, 2009, from http://web.bsu.edu/IRAA/AA/WB/chapter1.htm
Palomba, C.A., & Banta, T.W. (1999). Assessment essentials. San Francisco, CA: Jossey-Bass. [Includes a section on evaluating the assessment plan.]
ASSESSMENT: STUDENT
http://www.cidde.pitt.edu/ta/ta_handbook/Baker, C.E. (2000). Chapter 8: Evaluating students. The Teaching Assistant Experience.. Andrew P. Haley & Joanne M. Nicoll (Eds.). Pittsburgh, PA: University of Pittsburgh, CIDDE. Retrieved April 29, 2008, from
Bradley, K.D. Cunningham, J.D., & Sampson, S. (2007). Evaluating and restructuring science assessments: An example measuring student's conceptual understanding of heat. Paper presented at the American Educational Research Association annual meeting, Chicago, IL. Retrieved October 21, 2008, from http://www.uky.edu/~kdbrad2/BradleyCunninghamSampsonAERA2007_3_29_07.pdf
Hearne, J. (2001). Assessment as a tool for learning. New Horizons for Learning. Retieved October 26, 2008, from http://www.newhorizons.org/strategies/assess/hearne.htm
Hoepfl, M. Lindstrom, M.R. (Eds.). (2007). Assessment of technology education. 56th Yearbook Council on Technology Teacher Education.Woodland Hills, CA: McGraw Hill.
McMillan, J. H. (2007). Classroom assessment: Principles and practice for effective standards-based instruction, 4/E. Boston, MA: Allyn & Bacon
Shindler, J. (n.d.). Week #10: Pre-reading for workshop related to improving classroom climate and student achievement by formally assessing participation and process. Classroom Management Resource Site. California State University. Retrieved October 25, 2008, from http://www.calstatela.edu/faculty/jshindl/cm/index.htmStiggins, R. (2008, April). Assessment manifesto: A call for the development of balanced assessment systems. ETS Assessment Training Institute. Retrieved October 25, 2008, from http://www.assessmentinst.com/forms/AssessManifesto-08.pdf
Stiggins, R. J. & Conklin N. J. (1992). In teachers’ hands: Investigating the practice of classroom assessment. Albany NY: SUNY Press.
Wichita Area Technical College. (2007). Assessment handbook. Author. Retrieved October 11, 2008, from http://www.watc.edu/user/file/ie_AssessmentHandbook_011508.pdf
See below: AUTHENTIC, RUBRIC , PERFORMANCE
TESTS
Planning an effective test. Retrieved October 21, 2009, from http://www.yorktech.com/department/instruction_dev/TeachLearn/Planning_Effective_Test.htm
CASE STUDY
Davey, Lynn (1991). The application of case study evaluations. Practical Assessment, Research & Evaluation, 2(9). Retrieved January 21, 2008 from http://PAREonline.net/getvn.asp?v=2&n=9
hhttp://www.aare.edu.au/93pap/taylp93313.txt
CHECKLISTS
Stufflebeam, D.L. (1999). Program evaluations metaevaluation checklist. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/checklists/program_metaeval.pdf
Gangopahdyay, P. (2002). Making the evaluation meaningful to all education stakeholders. [Checklist]. Retrieved September 1, 2008, from http://www.wmich.edu/evalctr/checklists/makingevalmeaningful.pdf
CURRICULUM EVALUATION
Hughes, P. (2001). The monitoring and evaluation of curriculum reforms. Final report. Retrieved from http://www.ibe.unesco.org/curriculum/GulfStatesProjectsPdf/omanIIhug.pdf
DOCUMENT ANALYSIS
Newton, D.P. & Newton, L.D. (2007). An analysis of primary technology textbooks: Can they support cause and purpose explanations? Research in Science & Technological Education, 25(2). 199-210. Abstract retrieved October 22, 2008, from ERIC. (EJ763505)
EVALUABILITY ASSESSMENT
Trevisan, M. S. & Yi Min Huang. (2003). Evaluability assessment: A primer. Practical Assessment, Research & Evaluationn, 8(20). Retrieved April 12, 2008 from http://PAREonline.net/getvn.asp?v=8&n=20
IMPACT EVALUATION
Asian Development Bank. (2006). Impact evaluation: Methodological and operational issues. Manila, Philippines: Asian Development Bank. Retrieved April 8, 2008, from http://www.adb.org/Documents/Handbooks/Impact-Analysis/Impact-Analysis.pdf
Doppelt, Y. (2005). Assessment of project-based learning in a mechatronics context. Journal of Technology Educationn, 16(2). Retrieved September 13, 2008, from Virginia Tech’s Digital Library and Archives.
METHODS
GENERAL OVERVIEW
Centers for Disease Control and Prevention. (2005). Section 3. Methods of Evaluation. Demonstrating your programs worth: A Primer on Evaluation for Programs to Prevent Unintentional Injury. Author. Retrieved April 14, 2008, from http://www.cdc.gov/ncipc/pub-res/dypw/02_introduction.htm
Sanders, J.R., & Davidson, E.J. (2003). Checklists and tools for use in school evaluation. Supplementary materials for use with a model for school evaluation. In D.L. Stufflebeam & T.E. Kallaghan (Eds.), International handbook of educational evaluation. Dordrect, The Netherlands: Kluwer. Available at http://evaluation.wmich.edu/resources/schooleval/
Scriven, M. (2000, rev. 2007). The logic and methodology of checklists. Western Michigan University. Retrieved April 8, 2008, from http://www.wmich.edu/evalctr/checklists/papers/logic&methodology_dec07.pdff
CONCEPT INVENTORIES
Richardson, J. (2004). Concept inventories: Tools for uncovering STEM students' misconceptions. Invention and Impact: Building Excellence in Undergraduate Science, Technology, Engineering and Mathematics (STEM) Education. Washington, DC: American Association for the Advancement of Science.
COST ANALYSIS
Sewell, M. & Marczak, M. (n.d.). Using cost analysis in evaluation. CYFERnet-Evaluation. The University of Arizona, Tucson Arizona. Retrieved April 23, 2008, from http://ag.arizona.edu/fcs/cyfernet/cyfar/Costben2.htm
DOCUMENT REVIEW
Peterson, D.J. (n.d.). Using existing records in evaluation. CYFERnet-Evaluation. The University of Arizona. Retrieved April 8, 2008, from http://ag.arizona.edu/fcs/cyfernet/cyfar/Exisrec5.htmm
Marczak, M. & Sewell, M. (n.d.). Using focus groups for evaluation. CYFERnet-Evaluation. The University of Arizona. Retrieved April 8, 2008, from http://ag.arizona.edu/fcs/cyfernet/cyfar/focus.htmm
GEM: GENERAL ELIMINATION METHOD
Journal of Multidisciplinary Evaluationn, 5(9). Retrieved April 8, 2008, from http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/159/181
INSTRUMENTS
Baker, Frank (2001). The basics of item response theory [Online version]. ERIC Clearinghouse on Assessment and Evaluation, University of Maryland, College Park, MD. Retrieved October 1, 2008, from http://echo.edres.org:8080/irt/baker/
http://www.citt.ufl.edu/toolbox/toolbox_examsQuizzes.php
Cheung, D., & BUcat, R. (2002). How can we construct good multiple-choice items? Paper presented at the Science and Technology Education Conference, Hong Kong. June 20-21, 2002. Retrieved October 11, 2008, from http://www3.fed.cuhk.edu.hk/chemistry/files/constructMC.pdf
Duvall, K. (n.d.). Improving your test questions. Measurement and Evaluation: Center for Teaching Excellence. Retrieved October 11, 2008, from http://www.oir.uiuc.edu/dme/exams/ITQ.html
Scarborough, J.D. (n.d.). Student performance assessment. Strategic Alliance to Advance Technological Education through Enhanced Mathematics, Science, Technology, and English Education at the Secondary Level. Northern Illinois University. Retrieved October 18, 2008, from http://www.ceet.niu.edu/orgs/nsfstali/Student_Performance_Assessment.htm
See Item Analysis
INTERVIEW
Colker, A.M. (n.d.). Developing interviews: Preparing an interview protocol. [Tutorial] Professional Development Module. Online Evaluation Resource Library (OERL). Available at http://oerl.sri.com/module/mod6/m6_p1.html
CYFERnet-Evaluation. The University of Arizona. Retrieved April 8, 2008, from http://ag.arizona.edu/fcs/cyfernet/cyfar/Intervu5.htmm
EXAMPLES of Interview Protocol
(OERL) (n.d.). Teacher / Faculty Interviews. Curriculum Development Instruments. [Example of Interview Protocols]. Retrieved April 15, 2008, from http://oerl.sri.com/instruments/cd/teachintrv/instr4.htmll
Colker, A.M. (n.d.). Developing observation instruments: Selecting an observation approach [Tutorial]. Professional Development Modulee. Online Evaluation Resource Library. Available at http://oerl.sri.com/module/mod10/m10_p1.html
ITEM ANALYSIS
Baker, F. (2001). The basics of item response theory [Online version]. ERIC Clearinghouse on Assessment and Evaluation, University of Maryland, College Park, MD. Retrieved October 1, 2008, from http://echo.edres.org:8080/irt/baker/
Devine, M. & Yaghlian, N. (n.d.). Analysis of testing (p. 5). Office of Instructional Support, Cornell University. Retrieved October 11, 2008, from http://www.cte.cornell.edu/campus/teach/faculty/Materials/TestConstructionManual.pdf
Duvall, K. (n.d.). Test item performance: The item analysis. Measurement and Evaluation: Center for Teaching Excellence. Retrieved October 11, 2008, from http://www.oir.uiuc.edu/dme/exams/item.html
Hewitt-Gervais, C., Bevins, T., Volety, & Mayfield, G. (2000). Report on the validation of: the student evaluation of instruction instrument. Retrieved October 11, 2008, from http://fgcu.edu/planning/StudentAssessment/FacultyInfo/Validation.html
Scoring Office, Academic Technology Services. (n.d.) Introduction to item analysis. Michigan State University: Author. Retrieved October 11, 2008, from https://www.msu.edu/dept/soweb/itanhand.html
Wise, J-M. (n.d.). Item Analysis: Techniques to improve test items and instruction [PowerPoint]. Center for Assessment and Testing, Florida State University . Retrieved October 11, 2008, from http://learningforlife.fsu.edu/cat/scanning/docs/ItemAnalysis.ppt
OBSERVATION PROTOCOL
Piburn, M., Sawada, D., Falconer, K., Turley, J. Benford, R., & Bloom, I. (2000). Reformed Teaching Observation Protocol (RTOP). ACEPT IN-003. Retrieved October 4, 2008, from http://physicsed.buffalostate.edu/AZTEC/RTOP/RTOP_full/index.htm
Texas Collaborative for Excellence in Teacher Preparation. (2002). Classroom observation protocol. Author. Retrieved October 13, 2008, from http://www.colorado.edu/physics/phys4810/phys4810_fa06/protocols/ClassObProt2002.pdf
PORTFOLIO ASSESSMENT
CYFERnet-Evaluation. The University of Arizona. Retrieved April 8, 2008, from http://ag.arizona.edu/fcs/cyfernet/cyfar/Portfo~3.htm
Facione, P.A. & Facione, N.C. (1994). Holistic critical thinking scoring rubric. California Academic Press. Retrieved October 14, 2008, from http://www.insightassessment.com/pdf_files/rubric.pdf
IDE Corporation. (2002). Rubric to assess a PBL and rubric. Retrieved October 15, 2008, from http://www.idecorp.com/assessrubric.pdf
Instructional Materials Service, Texas A&M University. (n.d.). Rubric toolkit for agricultural science and technology education. Retrieved October 14, 2008, from http://www-ims.tamu.edu/docs2/Rubrics2004.pdf
Moskal, B. M. (2003). Recommendations for developing classroom performance assessments and scoring rubrics. Practical Assessment, Research & Evaluation, 8(14). Retrieved April 12, 2008, from http://PAREonline.net/getvn.asp?v=8&n=14
Pinellas School District & The Florida Center for Instructional Technology. (n.d.). Performance assessment. Classroom Assessment [Tutorial]. University of South Florida: Authors. Retrieved October 5, 2008, from http://fcit.usf.edu/assessment/performance/assess.htmll
http://www.relearning.org/resources/PDF/rubric_sampler.pdf
Scarborough, J.D. (n.d.). Student performance assessment. Strategic Alliance to Advance Technological Education through Enhanced Mathematics, Science, Technology, and English Education at the Secondary Level. Northern Illinois University. Retrieved October 18, 2008, from http://www.ceet.niu.edu/orgs/nsfstali/Student_Performance_Assessment.htmm
National Assessment of Educational Progress (NAEP) (otherwise known as the nation's report card) reports results for student achievement at grades 4, 8, and 12 in a nationwide sample.
Vu, P. (2008, January 17). Do state tests make the grade? Stateline.org. Retrieved April 18, 2008, from, http://www.stateline.org/live/details/story?contentId=272382
SURVEYS and QUESTIONNAIRES
Pinellas School District & The Florida Center for Instructional Technology. (n.d.). Attitude surveys. Classroom Assessment [Tutorial]. University of South Florida: Authors. Retrieved October 5, 2008, from http://fcit.usf.edu/assessment/attitude/survey.html
Colker, A.M. (n.d.). Developing written questionnaires: Questionnaire design [Tutorial]. Professional Development Module. Online Evaluation Resource Library. Available at http://oerl.sri.com/module/mod3/m3_p1.html
Colker, A.M. (n.d.). Developing written questionnaires: Administering written questionnaires [Tutorial]. Professional Development Module. Online Evaluation Resource Library. Available at http://oerl.sri.com/module/mod5/m5_p1.html
Zalles, D.R., (n.d.). Developing written questionnaires: Determining if questionnaires should be used [Tutorial]. Professional Development Module. Online Evaluation Resource Library. Available at http://oerl.sri.com/module/mod1/m1_p1.html
Zalles, D.R., (n.d.). Developing written questionnaires: Writing questionnaires [Tutorial]. Professional Development Module. Online Evaluation Resource Library. Available at http://oerl.sri.com/module/mod2/m2_p1.html
TESTS, EXAMS, & QUIZZES
CYFERnet-Evaluation: Evaluation tools and Instruments
Simkin, M.G. & Kuechler, W.L. (2005). Multiple-choice tests and student understanding: What is the connection? Decision Sciences Journal of Innovative Education, 3(1). Retrieved October 18, 2008, from http://www.business.unr.edu/faculty/kuechler/cv/DSJIE.3.1.05.pdf
See also ASSESSMENT: STUDENT
NEEDS ASSESSMENT
Department of Public Instruction, North Dakota. (n.d.). Needs assessment [Definition and Steps in Conducting]. Author. Retrieved April 3, 2008, from http://www.dpi.state.nd.us/grants/needs.pdf
Posavac, E.J. & Carey, R.G. (2007). Chapter 6: The assessment of need. Program evaluation: Methods and case studies (7th ed.). Upper Saddle River, NJ: Prentice Hall.
Peake, J.B., Duncan, D.W., & Ricketts, J.C. (2000). Identifying technical training needs of Georgia agriculture teachers. Journal of Career and Technical Education, 23 (1). 44-54. Retrieved September 2, 2008, from Virginia Tech’s Digital Library and Archives.
Purdue University Libraries Technology Training Team. (2002). How to conduct needs assessment. Purdue University. Retrieved March 31, 2008 from http://gemini.lib.purdue.edu/staffdev/handouts/needsassess.doc
Quellmalz, E., Schank, P., Hinojosa, T., & Padilla, C. (1999). Performance assessment links in science. Practical Assessment, Research & Evaluation, 6(10). Retrieved April 12, 2008 from http://PAREonline.net/getvn.asp?v=6&n=10
Rouda, R. & Kusy, M.E. (1995). Needs assessment, Development of human resources, Part 2art 2. Technical Association of the Pulp and Paper Industry. Retrieved March 31, 2008, from http://alumnus.caltech.edu/~rouda/T2_NA.html
http://www.worcester.k12.md.us/media/Needs_Assessments.pdf.
PARTICIPATORY EVALUATION
Aubel, J. (1999). Participatory program evaluation manual, 2nd Ed. Child Survival Technical Support Project. Retrieved August 28, 2008, from http://www.childsurvival.com/documents/PEManual.pdf
Rossman, G.B. (n.d). Participatory monitoring & evaluation. The Center for International Education, School of Education, University of Massachusetts. Retrieved August 28, 2008, from http://www.people.cornell.edu/pages/alr26/parEval.html
U.S. Agency for International Development. (1996). Conducting a participatory evaluation. Performance Monitoring and Evaluation TIPS, 1.Retrieved August 28, 2008, from http://www.childsurvival.com/documents/PEManual.pdf
Zuzoski, A., & Luluquisen, M. (2002). Participatory evaluation: What is it? Why do it? What are the challenges? Policy & Practice, 55. Retrieved August 28, 2008, from http://depts.washington.edu/ccph/pdf_files/Evaluation.pdf
Laurel County Public Schools. (2007). Certified personnel evaluation plan. Retrieved April 12, 2008, fromhttp://www.laurel.k12.ky.us/District%20Resources/Certified%20Evaluation%20Plans/Policies.pdf
East Baton Rouge Parish School Board. (2006). Personnel accountability plan: Certificated and profession. Author. Retrieved April 12, 2008, from http://humanresources.ebrschools.org/eduWEB1/1000012/docs/hr_final_personnel_plan_4-06.doc
http://www.ed.gov/teachers/nclbguide/improve-quality.html
WestEd. (2001). Teacher assessment and professional development. Retrieved April 12, 2008, from http://www.wested.org/asds/profdev.shtml
See also Certification
PROCESS Evaluation
Banilower, E.R., Boyd, S. E., Pasley, J. D., & Weiss, I. R. (2006). The LSC capstone report: Lessons from a decade of mathematics and science reform. Chapel Hill, NC; Horizon Research, Inc. Retrieved April 14, 2008, from http://www.pdmathsci.net/reports/capstone.pdf
Bond, S. L.; Boyd, S. E. & Rapp, K.A. (1997). Taking stock: A practical guide to evaluating your own programs. Chapel Hill, NC: Horizon Research, Inc. Retrieved April 12, 2008, from http://www.horizon-research.com/reports/1997/stock.pdf
Wholey, J.S., & McLaughlin, J.A. (1998). An evaluation workshop on planning and constructing performance-based evaluationss. Transcript of the Project Directors' Annual Meeting. Washington, DC. Retrieved April 13, 2008, from http://www.ed.uiuc.edu/sped/tri/evalwkshp.htm
Centers for Disease Control and Prevention. (2005). Demonstrating your programs worth: A primer on evaluation for programs to prevent unintentional injury. Retrieved April 14, 2008, from http://www.cdc.gov/ncipc/pub-res/dypw/02_introduction.htm
PROPOSAL Evaluation
Online Evaluation Resource Library http://oerl.sri.com/plans/planscrit.html
__________________________________________________
DATABASES, JOURNALS, and INFORMATION PROVIDERS
provides access to evaluation plans, instruments, and reports for projects supported by theee National Science Foundation.
The Association for Career and Technical Education (ACTE)
Cooperative Educational Service Agendy (CESA) Agency 10
CYFERnet: Children, Youth and Families Education and Research Network
Ericae.net: Assessment & Evaluation on the Internett is a clearinghouse for assessment, evaluation and research information. The How-To Series, a set of on-line, full-text books and booklets addressing practical evaluation, research, measurement, and statistical issues, is extremely helpful.
The Evaluation Center, Western Michigan University.
National Center for Research on Evaluation, Standards, and Student Testing
National Center for Education Statistics (NCES)
Career and Technical Education in the United States: 1990-2005
Online Evaluation Resource Library (OERL)
National Center for Education Statistics, Career/Technical Education
JOURNALS
American Journal of Evaluation
Australasian Digital Theses Program
Journal of Multidisciplinary Evaluation. Available at http://www.wmich.edu/evalctr/jmde/content/JMDE_002_full.pdf or http://survey.ate.wmich.edu/jmde/index.php/jmde_1
EVALUATION COURSES
Instructional Systems Technology Department, Indiana University. (). R561: Evaluation and change. Retrieved October 21, 2009, from https://www.indiana.edu/~istr561/knuth08spring/index.shtml
Khirallah, B. (2007). EDU 5352: Educational evaluation. University of Dallas. Retrieved October 13, 2008, from http://dante.udallas.edu/edu5352/
Knuth, R.A. (2006, Spring). R561, Evaluation and Change in the Instructional Development Process. Instructional Systems Technology Department. Retrieved April 11, 2008, form http://www.indiana.edu/~istr561/knuth/unit1print.html
Ritz, J. (2005). OTED785/885. Old Dominion University. Retrieved April 8, 2008, from http://www.odu.edu/~jritz/oted885/ntg12.shtml
Wicklein, R.C. (n.d.). ECOCS 7200: Evaluation of programs in occupational programs. The University of Georgia. Retrieved March 30, 2008, from http://www.coe.uga.edu/syllabus/eocs/EOCS_7200_wickleinr_SP04.pdf
Sharma, R. (2001). Curriculum designing. Unit 4. Madhya Pradesh Bhoj (Open) University, Bhopal. Retrieved August 24, 2008, from http://www.bhojvirtualuniversity.com/ss/online_cou/b_ed/secp_03/cp3b2u4con.asp
Burns, M. (n.d.). Evaluation in FCS 5470. Family and Consumer Science. Eastern Illinois University. Retrieved September 1, 2008, from http://www.eiu.edu/~mburns/fcs5470///
__________________________________________________
CTE Programs: Post Secondary
Bureau of Career Development, New Hampshire Department of Education. (2006). Checklist for evaluating Regional Career and Technical Education Centers and Programs. New Hampshire Department of Education. Retrieved March 30, 2008, from http://www.ed.state.nh.us/education/doe/organization/adultlearning/Career%20Development/documents/CenterEval_000.doc
The Pennsylvania State Board for Vocational Technical Education. (2006). The accreditation of public postsecondary programs and institutions in Career and Technical Education: Handbook for approval, evaluation, accreditation, and audit procedures of public postsecondary programs. Harrisburg, PA: The Pennsylvania State Board for Vocational Technical Education. Retrieved March 30, 2008, from
CTE Programs: Secondary
Indiana Department of Workforce Development. (2008, March 27). Indiana State Plan: FY 2009-2013 (July 1, 2008-June 30, 2013). Indiana Department of Education. Retrieved April 22, 2008, from http://www.in.gov/dwd/files/Final_Perkins_5_Year_State_Plan.pdf
U.S. Department of Education. (2003). National Assessment of Vocational Education (NAVE). Retrieved July 21, 2008, from http://www.ed.gov/rschstat/eval/sectech/nave/evalplan/index.html
GENERAL PROCESS
The Baldridge National Quality Program (2008). Education Criteria for Performance Excellence. National Institute of Standards and Technology, Department of Commerce. Gathersburg, M. Retrieved April 21, 2008 from http://www.quality.nist.gov/PDF_files/2008_Education_Criteria.pdff
Fournier, D. M. (Ed.). (1995). Reasoning in evaluation: Inferential links and leaps. New Directions for Evaluation, 48,
Sanders, J.R., & Davidson, E.J. (2003). Checklists and tools for use in school evaluation. Supplementary materials for use with a model for school evaluation. In D.L. Stufflebeam & T.E. Kallaghan (Eds.), International handbook of educational evaluation. Dordrect, The Netherlands: Kluwer. Available at http://evaluation.wmich.edu/resources/schooleval/
Sanders, J.R., & Davidson, E.J. (2003). Checklists and tools for use in school evaluation. Supplementary materials for use with a model for school evaluation. In D.L. Stufflebeam & T.E. Kallaghan (Eds.), International handbook of educational evaluation. Dordrect, The Netherlands: Kluwer. Available at http://evaluation.wmich.edu/resources/schooleval//
FACILITIES
