According to the National Center for Education Statistics, as many as 29% of first-year, full-time students do not re-enroll for their second year1 of college, and according to the Organization for Economic Co-operation and Development , only 46 percent of Americans who enter college ultimately graduate with a college diploma.2
As a learning science company, we recognize how important it is that this problem be addressed. Education providers need to feel confident that the digital technologies they select will deliver the desired outcomes to ensure a successful experience for educators and learners. For this reason, we measure the effectiveness of Connect according to its impact on a select set of outcomes:
We’ve partnered with dozens of faculty members across disciplines at a diverse set of institutions to develop
case studies that demonstrate Connect’s effectiveness on these measures. We aggregated and analyzed data
from 20 different case studies that include student usage of the SmartBook® technology published between
2014 and 2015 for the Connect Effectiveness Study 2016, which features a summary of key findings and
anecdotes. In addition, participants have provided qualitative feedback indicating a noticeable improvement in
student preparedness and in-class engagement when using Connect.
Student retention measures the percentage of students who complete the class compared to the number who enrolled at the beginning of the term. In 2014 and 2015, case studies with instructors from 10 institutions reported on student retention when Connect was not in use compared to with Connect. In each case, student retention was higher in sections where Connect was in use and demonstrated an average 19.8% more students stayed in the course.
“With Connect, students get feedback immediately, and with algorithmic questions, they do their own work and can attempt newly generated assignments multiple times. Imagine, students doing more accounting homework. It shows in their grade. Students don’t send me many emails thanking me for forcing them to read, but I did get a few commenting SmartBook helped focus their attention to what was important. If it didn’t make sense after reading the highlighted areas, they kept reading.
The reports provide me with the rationale to initiate contact with struggling students, without having to hand back homework with red marks all over it.
With Connect, we are able to be more flexible and serve more students per section. Add retention and that is a combination sure to make any administrator smile."
- M. Jeff Quinlan, professor of Accounting, Madison Area Technical College
“Using the SmartBook reports provided a basis of which learning objectives needed most focus. They were awesome in reflecting the metacognitive skills of students by demonstrating the areas they thought they knew and facilitating the conversation as to why they thought they knew it so as to dispel conceptual myths.
Connect allowed me to make class time more meaningful for students. Rather than lecture on concepts or attempt to discuss concepts from the reading in a room of students who had not read, Connect allowed me to more effectively use class time on activities that strengthen student learning."
- Dr. Erin Lynch-Alexander, professor of Education, Austin Peay State University
Pass rates are not only a success metric that many institutions evaluate as a key indicator of curriculum effectiveness; passing a class is also an economic concern for many students and families nationwide, since not passing the first time often means re-taking the class at another point in the future and paying full tuition for it once again.
Additionally, pass rates correlate to industry and government concern with regard to declining on-time college completions rates. According to a report published by non-profit organization Complete College America3, only 50 out of approximately 580 public colleges and universities indicate “on-time graduation rates at or above 50% for their first-time, full-time students.” The report also estimates added costs for additional years of study reaching into the thousands of dollars, not to mention lost wages to potential income earners who are unable to graduate on time. The National Center for Education Statistics4 likewise indicates that only 39% of first-time, full year students graduate within four years, whereas 59% require six years to earn an undergraduate bachelor’s degree.
In 2014 and 2015, instructors from fifteen institutions reported on pass rates in case studies, showing a 13% improvement in the percentage of students passing the class when Connect is in use as compared to sections not using Connect.
“I believe the use of the SmartBook and Connect allow for the subject matter to be more approachable by the students. I believe the Connect results speak for themselves when it comes to pass rates and test scores.
The Missed Questions report helps me figure out the difficult topics that need more attention while the Student Detail report allows me to see the level of completion a student has reached. It will also show me if a student needed a long period of time to complete an assignment. This may indicate the student needs more instruction.”
- Angela NewMyer, professor of Microbiology, St. Louis Community College - Forest Park
“I know that students aren’t reading texts in the same fashion, but, if I could get them to do the work and access the text in a way that would allow them to learn the material, I figured I would have accomplished something.
In the past, I would have one lecture that I would use for each class section. Now, I use Connect to help me customize my lectures for each section of my course, so I’m better able to adapt my class to the needs of my students.
I love the At-Risk Report because it boils down how the student is engaging with the system with a number out of 10. I use this score as an online engagement grade that I update each Friday so that students can see if the scores move up or down from week to week. If the system flags the student as being severely at-risk, I […] e-mail the student asking him or her to make an appointment to meet with me to come up with a strategy for improvement.”
- Timothy Pierce, professor of Communications, Northern Illinois University
3Complete College America; “4-Year” Degrees Now A Myth In American
Higher Education 2014
4U.S. Department of Education, National Center for Education Statistics. (2015). The Condition of Education 2015 (NCES 2015-144)
In 2014 and 2015, instructors from fourteen institutions
reported on average student exam scores. In each case,
average student exam scores were higher in sections where
Connect was in use showing an average increase of 9.1%. A study of student user satisfaction supports
these findings with 74% of students stating they believed
they performed better on quizzes and exams when using
of students believed they performed better on quizzes and exams when using Connect.
“Exam grades in lecture classes using Connect are higher, especially on exams covering more detailed aspects, such as transcription and translation. In general, exam scores are higher after students complete SmartBook modules.
With the use of Connect, I see fewer F’s in my class and the majority of students finish the term with a B. I credit this to the reporting options, which identify at-risk students to me and help students identify their trouble topics.”
- Dr. Vanessa Hörmann, professor of Biology, Broward College
“Everything is at the student’s fingertips. All they have to do is apply themselves. My goal is for the students not to memorize and dump, but to retain the information… I believe Connect to be a total package as far as reaching students to meet their highest potential in whatever capacity they learn best.”
- Lana Andrean, assistant professor of Psychology, Bridge Valley Community and Technical College
5Hanover Research – 2015 McGraw-Hill Connect Satisfaction Study
While exam scores are an essential measure of student success, McGraw-Hill Education has also found a consistent correlation between the use of Connect and improved final course grades. During 2014-2015, nine instructors across 16 distinct sections reported on final grade distribution when using Connect and when not using Connect. In each case, sections using Connect reported a more favorable final course grade distribution, with an average increase of 15% more students earning A’s and B’s as compared to classrooms not using Connect.
more students earned A's and B's when using Connect
“Connect allows me to provide a very streamlined course with the text and assignments all in one place, making it easier for students to acquire meaningful knowledge in an online format designed to handle a large number of students at a time.
The really wonderful part, though, is that the students don’t see the same questions they miss over again, so they can’t just memorize answers! The material will appear again, but it will be asked in a different way.”
- Tiffiny Guidry, professor of Sociology, University of Alabama
“The use of Connect is allowing me to adapt my lecture style to include more group learning activities without having to formally flip the classroom. I am able to incorporate one lecture a week out of three that focuses exclusively on group problem solving and discussion-based learning.
SmartBook is the most significant way students engage in reading about and learning new vocabulary in the proper context, and I think this has helped quite a bit. As for solving related mathematical problems in the Connect assignments, I think the ability to show hints, answers, and guided solutions have been invaluable in helping students solve problems and answer their own questions at the moment they have them."
- Dr. Brandon Winters, professor of Chemistry, Bethel University
Instructors frequently cite the benefits they experience after implementing Connect, specifically reduced time spent on administrative tasks, allowing for more engagement with students in class. Data from 2014 and 2015 case studies supports this feedback. Participating instructors reported the number of minutes spent per week on each of the following tasks before and after implementing Connect. The aggregate findings showed 65% less time spent administering quizzes, 83% less time spent going over homework assignments in class, and 67% less time grading outside of class. And since many students using Connect attend class having already spent time studying prior to a lecture, they are prepared for class with the basic knowledge needed to engage in higher-level learning. Our findings showed that instructors using Connect nearly doubled time spent on active learning experiences in class than when Connect was not in use.
“The time saved in grading is the biggest impact for me. The efficiency with which Connect grades and seamlessly syncs with Blackboard is a huge advantage.
We were able to do more in-class activities and develop more of a flipped classroom due to students’ work in Connect.
As a result of using Connect, I am able to cover more content. Having the students complete the SmartBook assignments helps the students understand complex economic concepts and allows me to spend more time in class on extended applications.”
- Laura Jean Bhadra, professor of Economics, Northern Virginia Community College – Manassas Campus
Data showing improvements in student outcomes when using a digital learning system like Connect is abundant. Our case study process focused principally on collecting quantifiable data reflecting the impact of Connect. That said, one of the most important key indicators of a student’s likelihood of success in a class is the extent to which they are engaged in the learning process. While it is challenging to quantifiably measure student engagement, based on the qualitative feedback from case study participants, along with user satisfaction survey data and professor and student testimonials, students using Connect are reported to indeed be more engaged.
“I love Connect. I teach entirely online and I like to give students practice assignments so they have the opportunity to master the concepts and practice working problems. Since they get a unique set of data with each attempt I know that they are engaged in learning, not just copying answers. My students frequently comment about how valuable these tools are for them as well. Connect has gone a long way in helping me provide a quality learning environment for online students.”
- Malcolm E White, CPA, professor of Management, Columbia College
“Connect is a great learning tool for students. Given the option of multiple attempts and immediate feedback the students get more engaged.”
- Steven Yourstone, professor of Operations Management, University of New Mexico
“I like the variety of features available in Connect. Everything I learn from reading the text is reinforced by the visual and interactive components, meaning that I’m engaging in the lessons on several angles and truly absorbing and retaining it all.”
- Christina, student at Western Illinois University - Quad Cities
“I find that my students don't mind doing Connect assignments and are more engaged during class. They already have some background about the material we are covering and actually engage in class discussions more frequently."
- J. Michael Sellers, instructor of Biology, University of Southern Mississippi
“Student engagement has increased outside the classroom, and they tend to log on over the weekends to complete the assignments and access the SmartBook."
- Dr. Vanessa Hörmann, professor of Biology, Broward College
“Using Connect has revolutionized the way I teach psychology. It started with having to spend less time grading papers, which gave me more time to prep for class and design better assignments in Connect for students. When students completed those assignments before class, I spent less time "talking at" students and more time "talking with" students because they were already familiar with the key concepts for the chapter. More engagement in class meant more retention and better final grades. Better student outcomes led to happier administrators...Connect has been a one-stop solution for our department!”
- Cheri Kittrell, professor of Psychology, State College of Florida
“McGraw-Hill Connect was great! It let me engage with the reading material and also helped my overall grade for my course!”
- Cameron, student at Southern New Hampshire University
Rather than use a one-size-fits-all approach to instructional design, the SmartBook adaptive technology within Connect creates a personalized experience tailor-made for each student.
Do students really know what they think they know? Do they know what they don’t know? These are the questions answered through metacognition. In SmartBook, each student is asked to rate their level of confidence after answering each question. Over time, student self-assessment of their knowledge drives the adaptive learning experience, and SmartBook gets better and better at identifying that student’s learning needs. SmartBook also continually adapts the content presented to students based on student responses in real-time, ensuring they are always engaged with the most impactful content.
Features available within SmartBook provide a continually adapting, personalized experience for each student
Adaptive Learning Resources Make Study Time More Productive
Students complete assigned preparatory “Reading” and “Practice” in SmartBook. Key passages are highlighted for immediate reading, according to the instructor’s learning objectives. The highlighting experienced during the Reading phase and probes presented during the Practice phase continuously adapt to each learner based on their activity.
Each Student Receives a Unique Learning Path
Each “probe” (a data-informed question) corresponds to a learning objective covered in the assigned content. Each learning objective has multiple probes spanning varying levels of difficulty. Before responding to the probes, students first report on their confidence level of whether they know the answer. Behind the scenes, the seemingly simple probes capture a myriad of data, including baseline knowledge, confidence, and user behavior such as time to select answer, time on feedback and more. This not only assesses the user’s knowledge level, but also informs the next probe and the student’s unique learning path.
“Recharge” Reinforces The Right Material At the Right Time
Using the data gleaned from probes, in-platform content review, and metacognitive intelligence, SmartBook uses complex algorithms to predict the moment a learner is about to forget something. The Recharge feature then provides a resource for students to review and reinforce topics when needed. The rate of memory loss and topics covered are unique to each student, therefore the recharge experience is entirely unique to each learner as well. The result is long-term knowledge retention that leads to mastery – and ultimately better outcomes.
Overcoming Memory Decay to Improve Course Outcomes
In 1885, scientist Hermann Ebbinghaus extrapolated a startling new hypothesis: Humans tend to remember only half of newly-learned knowledge in the following days or weeks unless that material is reviewed. This is known as the Ebbinghaus Forgetting Curve, and it represents one of the key underpinnings of how SmartBook works to improve knowledge retention and long-term concept mastery.
“I have never enjoyed reading a textbook or been able to retain much information with it, but with the online interactive features of Connect, it makes learning fun, interesting and allows me to actually learn and retain information.”
- Melissa, student at University of Maine Machias
“Overall, Connect has allowed me to fine-tune my lecture. I am able to go into detail quicker in the lecture period since the students have completed their SmartBook modules and have an understanding of chapter topics… Students tend to generate more detailed questions now, specific to the topics discussed.”
- Dr. Vanessa Hörmann, professor of Biology, Broward College
One way to impact student performance is to provide the instructor with real-time data from students, allowing them to intervene with students when needed and adapt their course to the individual student and class. What topics have students mastered? Where are they struggling? Are they engaged? Who is at risk of dropping out? Connect’s powerful, data-driven reporting gives clear answers to these questions, allowing instructors to make intelligently designed learning experiences.
Features available within Connect make it possible for instructors to approach a class of 50 like a class of one
Get Key Insights At-a-Glance with Connect Insight™
A visual analytics dashboard – now available to both instructors and students – provides at-a-glance information regarding student performance that is immediately actionable. By presenting assignment, assessment, and topical performance results together with a time on task metric that is easily visible for aggregate or individual results, Connect Insight gives the user the ability to take a just-in-time approach to teaching and learning.
Gain More Comprehensive Insights with Powerful Connect Assignment Reports
Connect can generate a number of powerful reports and charts across a diverse set of variables to give instructors the information they need to easily evaluate performance across the course, each class or by individual student to keep students on a path to success. The “At-Risk Report” highlights each student’s engagement in the course material to allow instructors to quickly identify students who might be vulnerable to dropping out of a class or struggling to pass.
Know What Students Know and Don’t Know
What are the most challenging learning objectives? What probes and assignment questions are students getting right and wrong? Through the reports generated by SmartBook, instructors can see where students are struggling and can tailor lectures, assignments and study materials to suit.
“The ability to tailor a student’s learning experience toward the things the student doesn’t know rather than what the student has already grasped is incredible, especially when there are huge numbers of students involved. This experience allows the course to be individualized for each student rather than offering a one-size-fits-all, `canned’ course experience.”
- Professor Tiffiny Guidry, University of Alabama-Tuscaloosa
Our studies indicate that with Connect, students were more engaged in the material, more likely to stay in class and more likely to achieve successful outcomes. Instructors were able to make better use of their time and to implement more active instruction, intervene with struggling students, and facilitate greater student success in their classes.
Ami Scarbrough, Senior Director of Health Services Programs from Virginia College Online Division, sums up the sentiment echoed by hundreds of instructors across the country:
“From the time I started using Connect, I have been hooked. I have used other online systems and have not had nearly the success as I have had with Connect. This has been a great way to allow students to be able to utilize online resources more effectively. It also saves time for instructors to manage and teach their courses more effectively. They are not bogged down in the administrative aspects, because items are auto-graded for their convenience. We have definitely seen an increase in student participation, engagement, and retention as a result of adopting this platform.”
The performance data used in this effectiveness study are based on case studies conducted by twenty different instructors from institutions of higher education.
These instructors measured the effect of Connect on a set of performance indicators for student performance and instructor efficiencies using measurable metrics. In consideration of the time and effort instructors devoted to providing the data, they were provided with a $200 honorarium, irrespective of the nature of the results reported. Control and test groups were determined according to context. In some cases, performance metrics were recorded simultaneously between two groups of the same class, one using Connectwhile the other did not. In other cases, professors recorded the differences demonstrated before and after implementing Connect. While each professor had control over the specific metrics studies and the determination of control and test groups, consistent methodology was used to compute performance metrics. The reported outcomes indicated a correlation between using Connect and improved results but the case studies did not explicitly examine the statistical significance of that correlation.
The production of the Connect Effectiveness Study 2016 is designed to demonstrate the outcomes instructors and students achieved using Connect, as well as how they are achieving them. To prepare this study, data was analyzed from the following:
Click here to view case study source data analyzed for the Connect Effectiveness Study 2016.