In April, Pearson sponsored an op-ed piece regarding open educational resources. It posed a lot of interesting questions about their required upkeep and ability to deliver desired learning outcomes. Ultimately, it questioned their efficacy, stating that they create "pedagogical inconsistency" for students and provide challenges in curating the latest, most up-to-date course materials for use in their classes.
You can read Pearson's op-ed, if you'd like. David Wiley certainly did, and it was his response that caught our eye. We included an excerpt below, but be sure to check out the original post for the full context.
The article poses three questions and answers them. Below I share some thoughts prompted by the article. (The questions from the article are presented in bold; unattributed blockquotes are from the original article.)
How do we deliver better learning experiences to more students?
There are fantastic learning resources out there of all breeds bringing different types of value to the learning process. OER often shine in their variety and ability to deepen resources for niche topics. Where proprietary courseware (textbooks, etextbooks, or online courseware) stand apart is in pedagogical organization and the unique value of authorship. While it’s possible to build a complete course from OER, the finished product often lacks the scaffolding found in courseware authored by single author/editorial/product teams. That scaffolding connects concepts and practice together, guiding students through the content in a way that maximizes learning.
I’m glad that the author goes straight to the issue of student learning. When all is said and done, the degree to which resources like commercial textbooks and OER support student learning is the only thing that matters. (I will use the language of effectiveness rather than efficacy below, for very important reasons I discussed previously.)
Absent any effectiveness data, for decades faculty who were evaluating educational resources had no choice but to settle for characteristics of resources that reasonable people might believe correlate positively with effectiveness. These proxies for effectiveness included famous authors, name brand publishers, large product teams with diverse skill sets, Stephen Spielberg-like production quality in graphic design, layout, and imagery, and highly formalized editorial and review processes. Unfortunately, sometime during these passing decades faculty began to believe that only resources with these proxy characteristics could be effective in supporting learning. They began to doubt that other development models must necessarily result in materials that are less effective. I don’t think it would be controversial to say that this “content worldview” was encouraged by publishers.
A growing number of peer-reviewed studies and other research reports are demonstrating that when faculty who previously used commercial products as their core instructional materials replace them with OER, student learning either stays the same or increases. Hilton’s review of this research suggests that this “same or better” outcome for OER users holds about 93% of the time.
This result – that freely available resources can support student learning as well as very expensive resources – runs counter to people’s intuition that “you get what you pay for.” As we see in other areas (e.g., climate change), when the truth differs significantly from people’s beliefs, there can be a steep communications hill to climb. This has certainly been the case for OER, and is the primary reason why it is so critically important that more empirical research on the relative effectiveness of OER be conducted and published in peer-reviewed academic journals.
While we need a larger, more robust literature addressing the question of the relative effectiveness of commercial resources and OER, there is another sense in which this research is utterly meaningless. If I purchase the rights to an out-of-print textbook from Pearson and relicense it CC BY, is it now more or less effective than it was the day before? This is a ridiculous question.
The question of whether the language on the copyright page will significantly influence student learning is completely irrational, yet such are the questions we must answer over and over again. As people continue to raise questions in the face of mounting evidence, I’m reminded of Nobel Prize-winning economist Daniel Kahneman, who wrote:
The mystery is how a conception that is vulnerable to such obvious counterexamples survived for so long. I can explain it only by a weakness of the scholarly mind that I have often observed in myself. I call it theory-induced blindness: Once you have accepted a theory, it is extraordinarily difficult to notice its flaws. As the psychologist Daniel Gilbert has observed, disbelieving is hard work.
There are no results from the instructional design, learning science, or cognitive science literature demonstrating that the language on the copyright page is a critical factor in promoting student learning. There is a growing body of research demonstrating that OER can be just as effective – or more effective – than commercial materials. It should be obvious to anyone that the features of instructional materials that effectively support learning (e.g., frequent formative assessment opportunities) can appear in educational resources with any copyright license.
The initial empirical results look good for OER, and we should hope they continue to hold. If alternative development models can continue to produce materials that support learning as effectively as the traditional publisher models, there is undoubtedly a positive future for OER. However, if we have to spend $1M per open textbook to achieve effectiveness results on par with commercial publishers, the long-term sustainability of OER is seriously in question.
How can we drive down costs for students and for institutions?
This seems to be the most likely question that OER seek to answer. And underpinning this is the presumption that “open” means “free.” But as mentioned above, there are significant costs imposed on both the learner (e.g., pedagogical inconsistency) and the instructor (e.g., material curation and upkeep).
As I have explained at length before, most recently through an analysis of the word “open”s usage in a cluster of interrelated contexts, the definition of open in contexts like “open educational resources” has two critical components – (1) free, plus (2) 5R permissions. There’s a lack of sophistication in the way most people talk about the “free” component of the definition of open, including the op-ed.
All educational resources – whether open or commercial – can be used to support learning only with some effort by the instructor. (We’ll ignore the obvious fact that learners must also exert effort to learn from resources, which is captured in the discussion of effectiveness vs efficacy linked above.) When a publisher releases a new edition of a book and stops selling the old one, forcing an instructor to change texts, or when an instructor chooses to switch from one author’s book to a second author’s book, or when an instructor chooses to switch from commercial materials to OER, there is a significant amount of effort required on the part of the instructor. You may have heard faculty complain about how many “preps” they have this semester. This effort can typically be converted into a cost by using the amount of time an instructor earning a certain amount per hour spent on the task. (I suspect I would disagree with the op-ed author about the relative amount of effort necessary to be ready to teach effectively with commercial materials vs OER. No doubt we would both likely overestimate in favor of our preferred solution.) In this sense, no materials – whether commercial or open – can ever be used without incurring cost. Therefore, in some sense it costs money to use OER in support of learning.
In contrast, by definition OER never require a license fee or royalty to use. You have free, perpetual, and irrevocable permission to retain, reuse, revise, remix, and redistribute OER. Being devoid of any licensing fee or royalty, OER are clearly much more affordable for students than commercial resources. Even at institutions where a small support fee (e.g., $10) is charged per course to provide support to faculty in their use of OER, OER are still significantly less expensive that commercial materials.
Who is responsible for ensuring ADA compliance of OER? How are necessary integrations with student information and learning management systems supported? Who provides technical support to learners and faculty when needed? There is no free lunch, and most OER proponents understand that. That’s why businesses are beginning to sell services around OER, perhaps in anticipation of the day when the foundation, government, and venture capital funding that has kept OER afloat begins to dry up.
The answer to the questions of “who [plays some critical role]” is “anyone who is willing and able.” Often this will be individuals, but I believe there is also significant potential value to instructors in the emergence of organizations that are willing to take on an OER stewardship role – organizations that make it easier for faculty to adopt OER effectively. This belief in the value of such organizations, shared by myself and my partner Kim Thanos, is why Lumen Learning exists. As a rule, Lumen does not create new OER. Instead, we try to provide a simple, supported pathway for faculty members to adopt and teach effectively with OER – including LMS integration, technical support, and many of the functions mentioned above.
But we didn’t create Lumen out of fear that one day foundation, government, or other funding will dry up. If anything, the increasing adoption of policies by governments and foundations requiring that copyrightable materials created by their grantees must be openly licensed (e.g., see the two dozen or so Foundation open licensing policies and this list of seventy-some state and federal open licensing policies) are ensuring that there will be new OER created and shared for a long time to come. Instead, we created Lumen to accelerate the effective adoption of OER – because we believe that OER adoption will greatly improve access, affordability, and learning for students while simultaneously greatly expanding pedagogical freedom for faculty.
OER are a great way to enrich and personalize instruction alongside core instructional resources. But the hidden costs of OER make them a dubious replacement for primary course material, unlikely to deliver substantial savings over proprietary digital solutions in the long run. Low-cost OER make great supplements, but there is real value in core instructional content presented systematically and updated regularly by invested authors. Today’s highest-quality, most in-demand proprietary content is the product of an ecosystem that recognizes and rewards that value. That isn’t likely to change in the future. One good thing about the OER buzz is that it has opened up the conversation about the cost of course materials and our collective responsibility for improving college affordability. We’ll just have to be careful that we’re not sacrificing the quality of the learning experience in the pursuit of lower cost.
I fully agree that “there is real value in core instructional content presented systematically and updated regularly by invested authors.” I simply disagree that the only mechanism for organizing these collective efforts is the promise of royalty payments. Regardless of whether or not the alternative incentive models employed by creators and improvers of OER should be theoretically viable according to standard economic models, these models are viable and they are flourishing. In addition to making great supplements, OER make great replacements for core instructional materials – and the peer-reviewed research on the topic demonstrates that OER are generally at least as effective as the commercial materials they replace. The significant cost savings, comparable student outcomes, and greater pedagogical flexibility facilitated by OER are some of the reasons why dozens of colleges across the country are at this very moment switching their core instructional materials from publisher resources to OER across entire degree programs. These OER-based degrees (or “Z Degrees”), in which general education courses and required courses in the major all use OER instead of commercial materials, can cut the cost to graduate by 25% or more at community colleges. These programs are growing rapidly (most recently with encouragement from Achieving the Dream) and will be important to monitor.
There is indeed an ecosystem of educational materials. Until very recently that ecosystem only contained materials developed by a handful of companies through largely homogenous processes. These processes produced materials that were terrifically expensive, difficult to distinguish from one another, and somewhat draconian in their approach to copyright. Now the ecosystem also includes OER – materials that are developed through heterogeneous processes, are royalty free, are almost infinite in their variety, and provide faculty and students alike with incredible flexibility via open licenses.
It will be interesting to watch the educational materials ecosystem evolve over the next several years. What will the new equilibrium state look like in 2020?