The Impact of Connect on Student Success

McGraw-Hill Connect® Effectiveness Study 2016

Click here to download the full PDF of the study

Want to adopt Connect for your course?

Contact Your Rep


Introduction  |   Retention  |   Pass Rates  |   Average Exam Scores  |   Final Course Grades  |   Time Management  |   Engagement  |   Learning Science  |   Conclusion  |   Methodology


Introduction


According to the National Center for Education Statistics, as many as 29% of first-year, full-time students do not re-enroll for their second year1 of college, and according to the Organization for Economic Co-operation and Development , only 46 percent of Americans who enter college ultimately graduate with a college diploma.2

As a learning science company, we recognize how important it is that this problem be addressed. Education providers need to feel confident that the digital technologies they select will deliver the desired outcomes to ensure a successful experience for educators and learners. For this reason, we measure the effectiveness of Connect according to its impact on a select set of outcomes:

  • Student Retention
  • Pass Rates
  • Exam Scores
  • Final Course Grades
  • Instructor Time Management

Students using laptop

We’ve partnered with dozens of faculty members across disciplines at a diverse set of institutions to develop case studies that demonstrate Connect’s effectiveness on these measures. We aggregated and analyzed data from 20 different case studies that include student usage of the SmartBook® technology published between 2014 and 2015 for the Connect Effectiveness Study 2016, which features a summary of key findings and anecdotes. In addition, participants have provided qualitative feedback indicating a noticeable improvement in student preparedness and in-class engagement when using Connect.

​Connect’s Impact on Student Retention


After implementing Connect, aggregated case study data indicates a 20-point improvement in student retention, from 70.1% to 89.9%.


Student retention measures the percentage of students who complete the class compared to the number who enrolled at the beginning of the term. In 2014 and 2015, case studies with instructors from 10 institutions reported on student retention when Connect was not in use compared to with Connect. In each case, student retention was higher in sections where Connect was in use and demonstrated an average 19.8% more students stayed in the course.

Impact of Connect on Student Retention

Case Study Spotlight


Madison Area Technical College, Accounting

“With Connect, students get feedback immediately, and with algorithmic questions, they do their own work and can attempt newly generated assignments multiple times. Imagine, students doing more accounting homework. It shows in their grade. Students don’t send me many emails thanking me for forcing them to read, but I did get a few commenting SmartBook helped focus their attention to what was important. If it didn’t make sense after reading the highlighted areas, they kept reading.

The reports provide me with the rationale to initiate contact with struggling students, without having to hand back homework with red marks all over it.

With Connect, we are able to be more flexible and serve more students per section. Add retention and that is a combination sure to make any administrator smile."

- M. Jeff Quinlan, professor of Accounting, Madison Area Technical College

Austin Peay State University, Education.

“Using the SmartBook reports provided a basis of which learning objectives needed most focus. They were awesome in reflecting the metacognitive skills of students by demonstrating the areas they thought they knew and facilitating the conversation as to why they thought they knew it so as to dispel conceptual myths.

Connect allowed me to make class time more meaningful for students. Rather than lecture on concepts or attempt to discuss concepts from the reading in a room of students who had not read, Connect allowed me to more effectively use class time on activities that strengthen student learning."

- Dr. Erin Lynch-Alexander, professor of Education, Austin Peay State University

​Connect’s Impact on Pass Rates


After implementing Connect, aggregated case study data indicates a 13-point improvement in pass rates, from 72.5% to 85.2%.


Pass rates are not only a success metric that many institutions evaluate as a key indicator of curriculum effectiveness; passing a class is also an economic concern for many students and families nationwide, since not passing the first time often means re-taking the class at another point in the future and paying full tuition for it once again.

Additionally, pass rates correlate to industry and government concern with regard to declining on-time college completions rates. According to a report published by non-profit organization Complete College America3, only 50 out of approximately 580 public colleges and universities indicate “on-time graduation rates at or above 50% for their first-time, full-time students.” The report also estimates added costs for additional years of study reaching into the thousands of dollars, not to mention lost wages to potential income earners who are unable to graduate on time. The National Center for Education Statistics4 likewise indicates that only 39% of first-time, full year students graduate within four years, whereas 59% require six years to earn an undergraduate bachelor’s degree.

In 2014 and 2015, instructors from fifteen institutions reported on pass rates in case studies, showing a 13% improvement in the percentage of students passing the class when Connect is in use as compared to sections not using Connect.

Impact of Connect on Pass Rates graph

Case Study Spotlight


St. Louis Community College - Forest Park, Microbiology

“I believe the use of the SmartBook and Connect allow for the subject matter to be more approachable by the students. I believe the Connect results speak for themselves when it comes to pass rates and test scores.

The Missed Questions report helps me figure out the difficult topics that need more attention while the Student Detail report allows me to see the level of completion a student has reached. It will also show me if a student needed a long period of time to complete an assignment. This may indicate the student needs more instruction.”

- Angela NewMyer, professor of Microbiology, St. Louis Community College - Forest Park

Northern Illinois University, Communications

“I know that students aren’t reading texts in the same fashion, but, if I could get them to do the work and access the text in a way that would allow them to learn the material, I figured I would have accomplished something.

In the past, I would have one lecture that I would use for each class section. Now, I use Connect to help me customize my lectures for each section of my course, so I’m better able to adapt my class to the needs of my students.

I love the At-Risk Report because it boils down how the student is engaging with the system with a number out of 10. I use this score as an online engagement grade that I update each Friday so that students can see if the scores move up or down from week to week. If the system flags the student as being severely at-risk, I […] e-mail the student asking him or her to make an appointment to meet with me to come up with a strategy for improvement.”

- Timothy Pierce, professor of Communications, Northern Illinois University

Connect’s Impact on Average Exam Scores


After implementing Connect, aggregated case study data indicates an improvement in average student exam scores, from 71% to 80.1%.


Impact of Connect on Average Exam Scores graph

In 2014 and 2015, instructors from fourteen institutions reported on average student exam scores. In each case, average student exam scores were higher in sections where Connect was in use showing an average increase of 9.1%. A study of student user satisfaction supports these findings with 74% of students stating they believed they performed better on quizzes and exams when using Connect5.



74%


of students believed they performed better on quizzes and exams when using Connect.

Case Study Spotlight


Broward College, Non-Majors Biology

“Exam grades in lecture classes using Connect are higher, especially on exams covering more detailed aspects, such as transcription and translation. In general, exam scores are higher after students complete SmartBook modules.

With the use of Connect, I see fewer F’s in my class and the majority of students finish the term with a B. I credit this to the reporting options, which identify at-risk students to me and help students identify their trouble topics.”

- Dr. Vanessa Hörmann, professor of Biology, Broward College

Bridge Valley Community and Technical College, Psychology

“Everything is at the student’s fingertips. All they have to do is apply themselves. My goal is for the students not to memorize and dump, but to retain the information… I believe Connect to be a total package as far as reaching students to meet their highest potential in whatever capacity they learn best.”

- Lana Andrean, assistant professor of Psychology, Bridge Valley Community and Technical College



5Hanover Research – 2015 McGraw-Hill Connect Satisfaction Study

Back to Top

Connect’s Impact on Final Course Grades


2014-2015 case studies indicate that with Connect 15% more students earned A’s and B’s.


While exam scores are an essential measure of student success, McGraw-Hill Education has also found a consistent correlation between the use of Connect and improved final course grades. During 2014-2015, nine instructors across 16 distinct sections reported on final grade distribution when using Connect and when not using Connect. In each case, sections using Connect reported a more favorable final course grade distribution, with an average increase of 15% more students earning A’s and B’s as compared to classrooms not using Connect.


15%


more students earned A's and B's when using Connect

Impact on Final Course Grade Distribution chart

Case Study Spotlight


University of Alabama, Tuscaloosa, Sociology

“Connect allows me to provide a very streamlined course with the text and assignments all in one place, making it easier for students to acquire meaningful knowledge in an online format designed to handle a large number of students at a time.

The really wonderful part, though, is that the students don’t see the same questions they miss over again, so they can’t just memorize answers! The material will appear again, but it will be asked in a different way.”

- Tiffiny Guidry, professor of Sociology, University of Alabama

Bethel University, Chemistry

“The use of Connect is allowing me to adapt my lecture style to include more group learning activities without having to formally flip the classroom. I am able to incorporate one lecture a week out of three that focuses exclusively on group problem solving and discussion-based learning.

SmartBook is the most significant way students engage in reading about and learning new vocabulary in the proper context, and I think this has helped quite a bit. As for solving related mathematical problems in the Connect assignments, I think the ability to show hints, answers, and guided solutions have been invaluable in helping students solve problems and answer their own questions at the moment they have them."

- Dr. Brandon Winters, professor of Chemistry, Bethel University

Connect’s Impact on Instructor Time Management


Aggregated case study data indicates instructors spend 72% less time on administrative tasks, and 90% more time on active learning experiences, when Connect is in use.


impact-connect-instructor-time-management

Instructors frequently cite the benefits they experience after implementing Connect, specifically reduced time spent on administrative tasks, allowing for more engagement with students in class. Data from 2014 and 2015 case studies supports this feedback. Participating instructors reported the number of minutes spent per week on each of the following tasks before and after implementing Connect. The aggregate findings showed 65% less time spent administering quizzes, 83% less time spent going over homework assignments in class, and 67% less time grading outside of class. And since many students using Connect attend class having already spent time studying prior to a lecture, they are prepared for class with the basic knowledge needed to engage in higher-level learning. Our findings showed that instructors using Connect nearly doubled time spent on active learning experiences in class than when Connect was not in use.

Case Study Spotlight


Northern Virginia Community College – Manassas Campus, Economics

“The time saved in grading is the biggest impact for me. The efficiency with which Connect grades and seamlessly syncs with Blackboard is a huge advantage.

We were able to do more in-class activities and develop more of a flipped classroom due to students’ work in Connect.

As a result of using Connect, I am able to cover more content. Having the students complete the SmartBook assignments helps the students understand complex economic concepts and allows me to spend more time in class on extended applications.”

- Laura Jean Bhadra, professor of Economics, Northern Virginia Community College – Manassas Campus

Connect’s Impact on Student Engagement


Instructor and student testimonials indicated an improvement in student engagement when Connect is in use.


Data showing improvements in student outcomes when using a digital learning system like Connect is abundant. Our case study process focused principally on collecting quantifiable data reflecting the impact of Connect. That said, one of the most important key indicators of a student’s likelihood of success in a class is the extent to which they are engaged in the learning process. While it is challenging to quantifiably measure student engagement, based on the qualitative feedback from case study participants, along with user satisfaction survey data and professor and student testimonials, students using Connect are reported to indeed be more engaged.



“I love Connect. I teach entirely online and I like to give students practice assignments so they have the opportunity to master the concepts and practice working problems. Since they get a unique set of data with each attempt I know that they are engaged in learning, not just copying answers. My students frequently comment about how valuable these tools are for them as well. Connect has gone a long way in helping me provide a quality learning environment for online students.”

- Malcolm E White, CPA, professor of Management, Columbia College


“Connect is a great learning tool for students. Given the option of multiple attempts and immediate feedback the students get more engaged.”

- Steven Yourstone, professor of Operations Management, University of New Mexico


“I like the variety of features available in Connect. Everything I learn from reading the text is reinforced by the visual and interactive components, meaning that I’m engaging in the lessons on several angles and truly absorbing and retaining it all.”

- Christina, student at Western Illinois University - Quad Cities


“I find that my students don't mind doing Connect assignments and are more engaged during class. They already have some background about the material we are covering and actually engage in class discussions more frequently."

- J. Michael Sellers, instructor of Biology, University of Southern Mississippi


“Student engagement has increased outside the classroom, and they tend to log on over the weekends to complete the assignments and access the SmartBook."

- Dr. Vanessa Hörmann, professor of Biology, Broward College


“Using Connect has revolutionized the way I teach psychology. It started with having to spend less time grading papers, which gave me more time to prep for class and design better assignments in Connect for students. When students completed those assignments before class, I spent less time "talking at" students and more time "talking with" students because they were already familiar with the key concepts for the chapter. More engagement in class meant more retention and better final grades. Better student outcomes led to happier administrators...Connect has been a one-stop solution for our department!”

- Cheri Kittrell, professor of Psychology, State College of Florida


“McGraw-Hill Connect was great! It let me engage with the reading material and also helped my overall grade for my course!”

- Cameron, student at Southern New Hampshire University

The Learning Science Behind Connect

Using Metacognition to Improve Student Confidence and Success


Rather than use a one-size-fits-all approach to instructional design, the SmartBook adaptive technology within Connect creates a personalized experience tailor-made for each student.

Do students really know what they think they know? Do they know what they don’t know? These are the questions answered through metacognition. In SmartBook, each student is asked to rate their level of confidence after answering each question. Over time, student self-assessment of their knowledge drives the adaptive learning experience, and SmartBook gets better and better at identifying that student’s learning needs. SmartBook also continually adapts the content presented to students based on student responses in real-time, ensuring they are always engaged with the most impactful content.

Features available within SmartBook provide a continually adapting, personalized experience for each student

Adaptive Learning Resources Make Study Time More Productive
Students complete assigned preparatory “Reading” and “Practice” in SmartBook. Key passages are highlighted for immediate reading, according to the instructor’s learning objectives. The highlighting experienced during the Reading phase and probes presented during the Practice phase continuously adapt to each learner based on their activity.

Each Student Receives a Unique Learning Path
Each “probe” (a data-informed question) corresponds to a learning objective covered in the assigned content. Each learning objective has multiple probes spanning varying levels of difficulty. Before responding to the probes, students first report on their confidence level of whether they know the answer. Behind the scenes, the seemingly simple probes capture a myriad of data, including baseline knowledge, confidence, and user behavior such as time to select answer, time on feedback and more. This not only assesses the user’s knowledge level, but also informs the next probe and the student’s unique learning path.

“Recharge” Reinforces The Right Material At the Right Time
Using the data gleaned from probes, in-platform content review, and metacognitive intelligence, SmartBook uses complex algorithms to predict the moment a learner is about to forget something. The Recharge feature then provides a resource for students to review and reinforce topics when needed. The rate of memory loss and topics covered are unique to each student, therefore the recharge experience is entirely unique to each learner as well. The result is long-term knowledge retention that leads to mastery – and ultimately better outcomes.


Overcoming Memory Decay to Improve Course Outcomes

In 1885, scientist Hermann Ebbinghaus extrapolated a startling new hypothesis: Humans tend to remember only half of newly-learned knowledge in the following days or weeks unless that material is reviewed. This is known as the Ebbinghaus Forgetting Curve, and it represents one of the key underpinnings of how SmartBook works to improve knowledge retention and long-term concept mastery.


“I have never enjoyed reading a textbook or been able to retain much information with it, but with the online interactive features of Connect, it makes learning fun, interesting and allows me to actually learn and retain information.”

- Melissa, student at University of Maine Machias

“Overall, Connect has allowed me to fine-tune my lecture. I am able to go into detail quicker in the lecture period since the students have completed their SmartBook modules and have an understanding of chapter topics… Students tend to generate more detailed questions now, specific to the topics discussed.”

- Dr. Vanessa Hörmann, professor of Biology, Broward College


Using Data to Improve Student Performance


One way to impact student performance is to provide the instructor with real-time data from students, allowing them to intervene with students when needed and adapt their course to the individual student and class. What topics have students mastered? Where are they struggling? Are they engaged? Who is at risk of dropping out? Connect’s powerful, data-driven reporting gives clear answers to these questions, allowing instructors to make intelligently designed learning experiences.

Features available within Connect make it possible for instructors to approach a class of 50 like a class of one

Get Key Insights At-a-Glance with Connect Insight™
A visual analytics dashboard – now available to both instructors and students – provides at-a-glance information regarding student performance that is immediately actionable. By presenting assignment, assessment, and topical performance results together with a time on task metric that is easily visible for aggregate or individual results, Connect Insight gives the user the ability to take a just-in-time approach to teaching and learning.

Gain More Comprehensive Insights with Powerful Connect Assignment Reports

Connect can generate a number of powerful reports and charts across a diverse set of variables to give instructors the information they need to easily evaluate performance across the course, each class or by individual student to keep students on a path to success. The “At-Risk Report” highlights each student’s engagement in the course material to allow instructors to quickly identify students who might be vulnerable to dropping out of a class or struggling to pass.

Know What Students Know and Don’t Know
What are the most challenging learning objectives? What probes and assignment questions are students getting right and wrong? Through the reports generated by SmartBook, instructors can see where students are struggling and can tailor lectures, assignments and study materials to suit.


“The ability to tailor a student’s learning experience toward the things the student doesn’t know rather than what the student has already grasped is incredible, especially when there are huge numbers of students involved. This experience allows the course to be individualized for each student rather than offering a one-size-fits-all, `canned’ course experience.”

- Professor Tiffiny Guidry, University of Alabama-Tuscaloosa

Conclusion


Our studies indicate that with Connect, students were more engaged in the material, more likely to stay in class and more likely to achieve successful outcomes. Instructors were able to make better use of their time and to implement more active instruction, intervene with struggling students, and facilitate greater student success in their classes.


Ami Scarbrough, Senior Director of Health Services Programs from Virginia College Online Division, sums up the sentiment echoed by hundreds of instructors across the country:


“From the time I started using Connect, I have been hooked. I have used other online systems and have not had nearly the success as I have had with Connect. This has been a great way to allow students to be able to utilize online resources more effectively. It also saves time for instructors to manage and teach their courses more effectively. They are not bogged down in the administrative aspects, because items are auto-graded for their convenience. We have definitely seen an increase in student participation, engagement, and retention as a result of adopting this platform.”


Back to Top

Methodology


The performance data used in this effectiveness study are based on case studies conducted by twenty different instructors from institutions of higher education.

These instructors measured the effect of Connect on a set of performance indicators for student performance and instructor efficiencies using measurable metrics. In consideration of the time and effort instructors devoted to providing the data, they were provided with a $200 honorarium, irrespective of the nature of the results reported. Control and test groups were determined according to context. In some cases, performance metrics were recorded simultaneously between two groups of the same class, one using Connectwhile the other did not. In other cases, professors recorded the differences demonstrated before and after implementing Connect. While each professor had control over the specific metrics studies and the determination of control and test groups, consistent methodology was used to compute performance metrics. The reported outcomes indicated a correlation between using Connect and improved results but the case studies did not explicitly examine the statistical significance of that correlation.

The Numbers Behind the Study

The production of the Connect Effectiveness Study 2016 is designed to demonstrate the outcomes instructors and students achieved using Connect, as well as how they are achieving them. To prepare this study, data was analyzed from the following:

  • 20 instructors unique data from 2014 and 2015
  • 1,195 unique testimonials from students
  • 315 unique testimonials from educators

Click here to view case study source data analyzed for the Connect Effectiveness Study 2016.


Back to Top

Learn More


To see how instructors across disciplines are achieving improved course outcomes, learn more at www.mheducation.com/highered/platforms/connect/case-studies.html.