Thursday, August 24, 2006

Analysis and Evaluation next phase for OIL

The next phase for the Analysis and Evaluation Group for OIL (online information literacy) eCDF project was brainstormed today.

We did this after we finished the second presentation to research forums at both the polytechnic and the university (21 August and 24 August) to inform people about the evaluation processes which have taken place over the first year of the project. In particular, the presentations were to inform audiences about the findings of the research evaluation project - Real use research evaluation of an online essay writing module: In formation literacy eLearning modules project. The audiences at both venues were relatively small with approximately 15 at each event.

Brainstorm of ideas for the next phase of evaluation
1. Which modules from phase one do we need to test for usability?
  • Business report - scheduled for 1 September 0800 - 1000 in computer lab H517. M and I and myself plus D has volunteered to help as well. This could be usability testing and not part of the research project.
  • Science report - will not be used in class this year, but could be randomly used by second year students if they are referred to it by their lecturer. R wants to customise the module for first year students using the online editor. Then integrate it in the first year biology course in 2007. This would be ideal for the research project. Also D to get Rosemary to review the module for the Science Investigation - expert review.
  • NZ Information Sources
  • - review Leitesha and Joseph modules, also review modules with Learning Centre students and staff at university and polytechnic - usability testing.
2. Which modules to be investigated as part of the research project?
Depending on the research design, expert review and use of the online editor for customisation could be incorporated in the research. Also real use with students in class and critique of the modules by users early October). Observation, focus group interviews (record and transcribe) and questionnaire testing of usability will still be used as methods for collecting data when in real use. Also a feedback blog could be set up for participants to add their feedback. Staff who participate in customisation of the modules would be asked to keep a log of the process, and be interviewed in a focus group. This would comprise case study research.
  • Science report - as above.
  • Essay writing
  • - M wishes to customise this module for a foundation course.
  • Digital Information Literacy
  • - expert review & consultation - FLNW** conference visitors - this module and others.
  • Maori & Pasifika
  • - expert review & consultation - ongoing consultation
  • Ethics - expert review & consultation - copyright expert
  • Searching - expert review
  • Evaluation - expert review
  • Springboard (introduction to IL) module - expert review
Need to make modifications to the questionnaire (remove irrelevant features), information sheet and consent form. Also the feedback sheet on the OIL website needs to be modified to collect feedback. If we add an information sheet and include the consent on the questionnaire, then people critiquing the modules of the OIL site could be included in the research project.
  • Expert review will also be obtained re ANZIIL standards.
  • Notify college research office about changes in methodology - information sheet, consent form, questionnaire, research design.

Methods for disseminating modules
  • Add OIL link to institutional websites
  • Training in online editor - introduce mid-September with Terry Stewart eCDF project - inhouse group training first from 4 September when usernames and passwords issued.
  • Google not picking up site.
  • ITPNZ, DEANZ, FLLinNZ, eLearning Directors notified
**FLNW = Future of Learning in a Networked World

No comments: