Defining Online Tutoring Quality

What is quality education? What is quality teaching? How can one measure it? These are some of the thorniest questions in education today. No single system or metric can determine it. For instance, standardized tests suffer from the fact that students may not test well, may have been trained on the wrong material, or may be having a bad day. Student survey data may reflect student opinions of the teacher rather than opinions of the learning. For instance, numerous studies in post-secondary education show a positive correlation between lenient grading and student satisfaction. Longitudinal data from schools, such as job placement rates or lifetime earnings of students, cannot be easily compared to each other because students at different schools enter and exit with different skill levels. Lastly, portfolio analysis -- the compilation and examination of a given student's work over a period of time -- suffers from the subjectivity of the teacher. Due to the flaws of any single metric, those that need to measure educational quality -- such as schools, accrediting agencies and parents -- are forced to rely on a meta-analysis of all of the metrics listed above, input analysis (credentials of instructors, training processes, and others), and reputation.

So what does this mean for online tutoring? A quick search of the Internet will demonstrate that every online tutoring company claims to have "high quality" tutors. Most will claim that their tutors are extensively trained. All list fabulous quotes from users. All show terrific survey results. All claim grade increases. So, how does a parent or a school determine who really is better? Using the above framework, they need to look at inputs, metrics, and reputation. Of these three, inputs are the least manipulable because inputs impact the cost structure of a business. They are also the least advertised, because they are a proxy for educational quality. However, they probably provide the best indication of the educational value of a service.

INPUTS
By looking at what goes into the tutoring process, one can get a sense of what should come out. The inputs that are relevant to online tutoring are tutor credentials, tutor training, tutor oversight, tutoring philosophy, service availability, service levels, breadth of service, and ease-of-use.

1. Tutor Credentials: Generally, tutors with advanced degrees in their discipline have a better understanding of the material than those that don't. This is particularly relevant in math and science. Companies that don't indicate the degree levels of their tutors are typically relying on current college students or graduates as opposed to masters level and PhD tutors.
2. Tutor Training: Just about everyone has been taught by someone who is brilliant in their discipline, but doesn't know how to teach. Tutor training on how to tutor is just as, if not more, important than subject level expertise. When students need help, they are typically frustrated and lack confidence. An effective tutor not only helps them with the subject matter, but encourages them as well. At SMARTHINKING, we call this the "affective" element of tutoring. Again, every company will claim to do this. However, if a company is serious about tutor training, its tutors will be part-time employees as opposed to independent contractors. Though hiring tutors as independent contractors is simpler and cheaper, IRS regulations require that any position that requires significant training as a job requirement must be filled by an employee.
3. Tutor Oversight: Tutoring is a one-to-one social experience that combines the delivery of subject knowledge with, hopefully, the social cues necessary to encourage the learner. However, as with any human interaction, there can be miscommunication between student and tutor, mistakes made in the provision of information, and differences in communication styles. Identifying and addressing these sorts of issues requires the subjective perspective of experienced educators. At SMARTHINKING, we have former college professors that oversee each of our disciplines. Further, they contribute to the scholarship surrounding online tutoring.
4. Tutoring Philosophy: An online tutoring service can be a learning service or an answer service. While not mutually exclusive, they are certainly not the same. Frequently, students want an answer, not a lesson. Tutoring companies that evaluate their tutors solely on student satisfaction ratings give tutors the incentive to do the work for the students. While this might make good business sense for a company trying to sell its services to consumers, it's not good education.
5. Service Availability, Breadth and Levels: All of these inputs are for naught if an online tutoring service doesn't provide service at the moment and in a subject that the student needs it and without an onerous wait time.
6. Ease-of-Use: Again, all of these inputs are for naught if the online tutoring technology is not user-friendly and capable of supporting educational interactions. For instance, Voice over the Internet (VOIP) is a feature that is frequently requested, but seldom used. This is because the set-up and performance for VOIP -- microphones, speakers, soundcards, volume settings, bandwidth, archiving, non-duplex service, voice lagtimes, and others -- make it more cumbersome than helpful. Also, math notation is notoriously difficult to do on the Internet. Technology that enables easy superscripts, subscripts, fractions, graphing, and other mathematical symbols enables effective online tutoring.
   

METRICS
Every tutoring company, SMARTHINKING included, touts its student survey results, quotes from satisfied customers, and sample tutoring interactions. Frankly, all of these are easily manipulated for marketing purposes. The only outcome metric that is more objective than the others are independent studies conducted by clients or others. While these will certainly have their share of methodological flaws, the bias of the company is removed.

REPUTATION
Because outcome data is so manipulable and input data is hard to discern, reputation and, by extension, brand, plays a role in determining educational quality. In large part, reputation is created by quality service over time. It is also reflected by a company's client base. For instance, to determine educational quality, one might look at the tutoring services chosen by other schools and educators. Presumably, other educators will vet a tutoring company on its educational features more fully than a parent, student or library might.

Despite the emphasis on testing in No Child Left Behind, the pressure being put on college accrediting agencies to measure school quality, and the growing demand for consumer educational services, the question of what is educational quality is not likely to be solved soon. In the meantime, those who need to look at quality are best served by evaluating an education provider holistically on inputs, metrics, and reputation, with an emphasis on inputs.