Showing posts with label corporate training. Show all posts
Showing posts with label corporate training. Show all posts

Thursday, October 11, 2018

ELearning: The “Testing Effect”




“2010 New York Times article reported on a scientific Study
that showed that students who read a passage of text and then
 took a test asking them to recall what they had read retained
 an astonishing 50% more of the information a week later than
 students who had not been tested.”
The “Testing Effect” describes the power of retrieval. Its most common application can be seen in testing in school exams; to help measure learning and assign grades. In the corporate world, this process is often shunned as a facile means of overcoming employee resistance or circumventing policy & procedure issues.

Testing as a whole has come under fire in recent years. Various elementary, secondary and post-secondary learners and academic bodies have cited that testing in the traditional manor is not an effective means of determining comprehension and this notion has carried over into corporate learning to some extent. Testing has gotten a “bad rap” and it is often related to memorization.  

In their book “Make It Stick”, authors Peter C. Brown, Henry L Roediger III and Mark A. McDaniel cited that a “2010 New York Times article reported on a scientific Study that showed that students who read a passage of text and then took a test asking them to recall what they had read retained an astonishing 50% more of the information a week later than students who had not been tested.”

 The book, Make It Stick,  suggests that the New York Times article would seem like good news, but here’s how it was greeted in many online comments:

“Once again, another author confuses learning with recalling information.”

“I personally would like to avoid as many tests as possible, especially with my grades on the line,. Trying to learn in a stressful environment is no way to help retain information.”

“Nobody should care whether memorization is enhanced by practice testing or not. Our children cannot do much of anything anymore.” 

  eLearning can be an important component of learning new skills, enhancing product knowledge, reinforcing policies and procedures or changing behaviour, but only when a well-defined testing process is associated with any given topic or group of topics.  This process enhances retrieval of information and can have an important influence on work practices; but only when content is coupled with a well thought out testing process that is extended over time. 

I suppose the next question is how? How does the process of retrieval of information enhance memory?  The basic concept is this - the act of retrieving information from memory makes it easier to retrieve later. We retrieve information from memory every moment of every day; how to tie a knot, how to start your car, how to program your remote (well maybe not this one), how to add and subtract, etc. These may seem common and mundane but they are made thus through the repetition of retrieving information repeatedly, thereby embedding knowledge more permanently.

I think many of us can bare witness to the effects of retrieval strength in our daily lives, for example, if we go away for an extended trip, our minds would be far away from the normal processes and routines we follow daily. As a result, when we return, we have lost some information, perhaps:  passwords, log in procedures, actions that we may undertake less frequently but typically would recall when retrieved periodically. This can be described as the ebbing of retrieval strength. We are not reminded of the information and gradually we forget.

What does it all mean for eLearning? I think we have to re-consider how we perceive testing, its frequency and the veracity of the testing process. In designing learning programs within corporate environments, we often view learning as a one-time event or a one-time window. We tend to design testing around that event or window but do not plan repeated opportunities to review content, refresh knowledge and enhance retrieval strength through a more rigorous testing process over the long term.

The process need not be onerous. We recommend offering shorter and more persistent testing on information. Make sure the information is prioritized, meaning focus on topics of greater importance to your organization’s mission. For example you may evaluate your learning calendar for a given year and consider reintroduction of key learning principles along with repeated testing opportunities. This can be coupled with the introduction of new content each calendar year. 

Making the process fun and “not boring” will have an important effect on learning and embedding information making it easier to retrieve, however and perhaps more importantly, designing an ongoing process of presenting the prioritized information through multiple channels while reinforcing the learning process with testing is essential to effecting change through learning in your organization.

Wednesday, September 10, 2014

MOOCs & Corporate Training?

MOOCs have the capacity to
change the way we look at eLearning
Massive Open Online Courses (MOOCs) are beginning to make a splash in the corporate training world as organizations begin to adopt this technology for internal training and customer service and customer relationship building.  For those who may not be familiar with the term a MOOC is “massive “in that it allows thousands of learners to participate at any one time in a course or program, “open,” because anyone with an Internet connection can enroll in a course; and they are “courses” because they have a start and end date, learner testing and benchmark achievement levels and /or proctored exams.

The term free and verification are often used when describing MOOCs but again this is a misnomer. As with anything in the real world, you rarely get anything for free (courses often cost between $30 - $100) and few of the courses offer verification …especially the free ones. Forbes magazine suggests that only about 14% of the courses at one of the largest MOOCs in North America  are verified in some way.   

A MOOC is a concept that incorporates lateral learning and thinking process.  Typically a syllabus is created with the content such as online articles, web links, blogs, wikis, videos, etc., that offer important information on the topic being discovered during a given time frame of the program or course. The learners explore the content and engage in dialogue with other learners and external subject matter experts. Gradually the learning group establishes its own understanding and focuses of the content and can assess their progress against the entire group of learners. Dave Cormier the originator ofthe term MOOC ( no relation that I know of) offers a short and concise explanation.
Now that we have established the idea of a MOOC (which originated from the academic world) we need to gain some insight into how it is implemented at the corporate world. The difference between academic and corporate may seem subtle but nothing could be further from the truth. Academic settings are ideal in that funding for content is already in place and the learning can be extended to an audience outside of the paid program allowing them to learn along with program participants.  In a corporate setting there are three basic learning paths governed by the demands of business, compliance training to which the employer is legally bound, productivity & skills training and customer service learning. In these cases there is no corporate funding so the planning and strategy of a MOOC remains similar to a standard corporate training environment except that the training can be allowed to cross pollinate within the business and the same knowledge and format can be extended to customers outside the business.

While MOOCs are touted as a new and advanced frontier in learning – if there are to be effective they demand planning and lots of it. The “Garbage In…Garbage Out” rule applies here perhaps more than in traditional learning systems simply because of the increasingly sophisticated approach.  Multiple audiences lateral learning, expanded content, social networks all add to the effectiveness of learning and extend learning throughout the organization but they do demand increased strategic planning. Large organizations can employ this approach much more readily because of their already considerable investment in learning, the poor existing track record of learning within organizations and the benefits that can be harvested when they extend product and service learning opportunities to their customers. 

Smaller organizations can benefit from the unique learning opportunities of MOOCs but it is important to carefully consider a strategy and implementation plan that benefits them every step of the way.