Programme Evaluation in Open and Distance Learning

Programme Evaluation in Open and Distance Learning

• 1.
  Programme Evaluation: Understandingthe design
• 2.
  The Big Question…How to do programme evaluation?
• 3.
  Evaluation is notto prove, but to improve “ ”
• 4.
  Programme evaluation is not course evaluation…
• 5.
  A systematic gathering,analysis and reporting of data about a programme to assist decision-making. What is programme evaluation?
• 6.
  Programme evaluation is not end of event exercise…
• 7.
  A Programme EvaluationFramework Focus Methods Tools Analysis Reporting Purpose Stakeholders Areas: COAT Time Data Collection Plan Qualitative Quantitative Sampling Checklists Questionn- aires Interview schedules Observation sheets Pre-test Data Colle- ction Analysis Interpretation Action Plan Reporting Questions Blueprint Tools Findings Decisions
• 8.
  Example of FocusPurpose: To improve the operation of the existing programme To assess the impact of the programme To maintain and assure quality To decide on continuing with the programme Any other?
• 9.
  Example of FocusStakeholders: Students Academic Counsellors Faculty Subject Matter Experts Employers Study Centre staff/ support staff Society
• 10.
  COAT Questions Components: What are the components of the programme? Need to cover all… Outcomes: What the programme is intended to achieve? Activities: What activities are performed during the programme delivery? And how are they organized? Target Groups: For whom the programme is designed, and what are their needs?
• 11.
  Example of FocusComponents: Print materials Support services Academic counselling Electronic resource support Assignment and interactions Project work supervision Practical facilities Post qualification placement Any other?
• 12.
  Example of FocusOutcomes: (eg. B. Ed.) To increase the number of trained teachers in the country To improve the quality of teaching-learning at school level Any other?
• 13.
  Example of FocusActivities: Entrance Test Admission Supply of learning materials Academic counselling Practice teaching Workshop Assignments Term-end evaluation
• 14.
  Example of FocusTarget Group: In-service teachers with 2 years experience of teaching in secondary schools Needs of the target group addressed?
• 15.
  To conclude… Knowingis not enough; we must apply. Willing is not enough; we must do. -- Goethe
• 16.
  The Question stillremains… HOW