New Report from SRI Education Evaluates Impact of Digital Courseware on Student Learning

MENLO PARK, Calif., Jan. 13, 2015 /PRNewswire/ -- SRI Education, a division of SRI International, has released a report that assesses five years of technology investments in digital courseware by the Bill & Melinda Gates Foundation Postsecondary Success initiative. The initiative seeks to understand what is required for digital courseware to produce positive student learning outcomes at scale. At the request of the Gates Foundation, SRI Education reviewed 137 postsecondary online and hybrid courses and provided a synthesis of the findings, along with implications and recommendations for future investments in learning software for colleges and universities.

"Digital courseware has the potential to improve student learning outcomes and catalyze changes in education practice. These two affordances align well with the Gates Foundation's emphasis on improving college success for underrepresented minorities, low-income students, and first-generation college attendees," said Barbara Means, Ph.D., director, Center for Technology in Learning, SRI Education. "With this in mind, we looked at online and blended learning courseware in three major areas – context of use, instructional and technology design, and implementation practices. Our goals were to determine courseware features associated with greater learning effectiveness and to provide guidance for funders as they look to make learning technology investments in the future."

After reviewing the major Postsecondary Success projects, several features were identified as having positive effects on student learning:

• Instructional designs or redesigns for entire courses produced significantly greater learning effects compared to less intensive approaches such as designs for supplemental resources.
• Learning effects from digital courseware implementation were greater in community colleges than in four-year colleges.
• Courses in mathematics produced more positive learning effects than courses in other subject areas such as science or the humanities.
• Course implementations using individualized pacing had more positive impacts than those with class-based or a mixed form of pacing.
• Online courses in which students' dominant role was solving problems or answering questions had more positive effects than those where most of the students' time was spent reading text or listening to lecture videos.
• Adaptive learning technologies demonstrated larger learning effects than non-adaptive technologies.

Along with these key findings, SRI researchers describe lessons learned from their analysis of the Postsecondary Success portfolio. For example, the needs of local students and the institutional context are critical factors in the successful adoption of existing digital courseware into higher education classes. Courseware innovations that have been successful in one campus often fail to achieve similar results when implemented in new settings. Moreover, while faculty are often willing to try courseware developed at another institution, they want to be able to modify it for their own circumstances, and often the courseware that interests them is not easily modifiable.

Additionally, courseware innovations that improve student learning and course completion rates are developed through multiple cycles of design, testing and revision. Data that link student outcomes to specific design features and implementation practices need to be systematically collected and analyzed to gain insights on how to improve software design and implementation practices.

The report includes several recommendations for organizations looking to make future investments in digital courseware to enhance student outcomes.

• Funders should consider investing in high-quality courseware for lower-division courses that is designed for reuse, as well as in additional research on effective strategies for implementing the most effective courses at scale.
• Courseware funders should consider enlisting the help of third-party evaluators who use consistent measures and methods to collect and analyze data that can provide objective evidence of effectiveness.
• Funders should take a phased approach to supporting courseware innovations, with later stages of funding dependent on demonstrated capacity to collect data that can inform improvement.
• Part of the funders' investment in evaluating courseware and technology tools should be devoted to examining longer-term impacts and implications for degree completion.

About SRI International
SRI International is a leader in research and development whose innovations have created new industries, extraordinary marketplace value and lasting benefits to society. SRI provides government and business with pioneering R&D and solutions in biosciences, chemistry and materials, computing, education, engineering, security and defense, sensing and devices, and more. SRI brings its innovations to the marketplace through technology licensing, spin-off ventures and new products.

SOURCE SRI International

Related Links

www.sri.com