- We can measure effectiveness by evaluating the students’ ability to use it.
- Standard methods - MC/short response, essay, etc sometimes work well, but not always.
- depends on the skill or learning you are trying to measure.
- demonstration of software/skill would be better than a test/quiz - then use checklist, rubric, observation, rating scales, etc.
- Is it safe for my students?
- What do I have to do to maintain it?
- What assessment tools will I use?
- Was the technology used appropriately?
- Does the technology enhance learning?
- Were the learning objectives reached?
- Were my students actively engaged?
- Did they seem more interested &/or motivated?
- How long or often did they use the technology?
observation: - attitude regarding technology, motivation, interest, self-learning, voluntarily helping other students, distraction or benefit?
Checklist: - most points being met suggests that the technology was a success.
Rating scales - similar, but more involved (mostly like a rubric)
Rubric - more detailed, deeper levels of learning/achievement based on levels of quality and stages of development.
Re-evaluate at regular intervals, like every year. Students, learning objectives, etc change over time.
Keep the technology applicable to the real-world, and current.
Sample year-end evaluation:
At the end of the school year, think back and reflect on the technologies used in your class - whether it be software, hardware, the internet, or any combination of the three - to help you determine whether the resources are working and/or where you need to make changes. One way to help you determine this is to think about whether your students know how to select and use technology to help them find, analyze, and convey information effectively and creatively. If so, then you have a good indication that technology has at least enhanced students’ learning. Also consider whether it helped you as a teacher, such as helping you track grades and other information, or create classroom materials.
Exit Slip surveys are also a very useful feedback method from students to gain understanding about a technology mid-stream, instead of waiting until the end of the year or unit.
Evaluate digital tutorials:
Give young students either an online or CD tutorial that teaches them phonetics and how to read. After they have sufficient practice with the tutorials, evaluate the effectiveness of the digital tutorials. To help you in your evaluation, sit with each student and have them read aloud a short story or a series of sentences that they should be able to read after using the tutorials. Use either a rating scale or rubric to evaluate.
Though this isn't stated in the video, I agree that sometimes technology is used sometimes just for the sake of using it. Educators need to be assessing their use of technology in the classroom, and considering if it is in-fact useful and beneficial to student learning.
The fact that a lot of technology integration needs to be assessed through it's own medium is a great method, and does indeed require more thorough assessment techniques such as rubrics and check lists.
My concern is that some teachers are biasing their assessment tools to grade the use of the technology, rather than the real content and learning which should be demonstrated through the technology. In many cases, the ITC curriculum is more of a tool, than an end-of-year outcome.
This is certainly something that I will be considering, especially some of the evaluations from a teacher's perspective on how effective a tool was throughout the year, where I need to improve or adapt, and what to toss in search of something more effective for learning.