advice about graduate school. getting the right advice


Think twice about trading a full course load for higher grades

Originally posted December 5, 2011 — My choice of topics to write about today was inspired by a conversation I had with a student during a recent academic advising session. She is a Psychology major, about halfway through her program. She said she hopes to go to graduate school, and she wants to know if her prospects of getting in will be jeopardized if she takes a break from school, next semester.

I could see from her transcripts that she has good grades, but not excellent by any stretch of the imagination. More importantly though, I noticed that since she began her program, she had been taking only 3 courses each semester, rather than the normal full-time course load of 5 courses per semester. She explained that she has difficulty handling a full course load, but she can get good marks if she has a lighter load. It’s not that she has other things going on that compete with school for her time. She doesn’t have a job, or a time-consuming hobby, or anything like that. She just needs to be able to take her time to study and learn, she explained.

She feels she’s been putting everything she can into school, and now she needs a break because she has never really had one. Lately, both she and her family are worried that she will experience burnout or a have breakdown if she doesn’t take an academic break.

To be frank, I think she should take the time off. It’s not worth it to push oneself to the point of exhaustion or exasperation. She should take the break, and come back to complete the program when she feels ready.

But, really, she needs to forget about graduate school in Psychology — not just for now, but also for good. And that would be my advice to her, even if she decides not to take a break from her studies, next semester.

If that seems harsh, let me explain why it is really just realistic for this young person to start making a move to join the workforce, and plan to complete her degree program, on her own terms, and within a time-frame that will enable her to finish with good grades, and without undue stress or anxiety along the way.

In most Psychology graduate programs in North America, an applicant is accepted if, and only if, a faculty member indicates an interest and willingness to supervise the student’s graduate research. Psychology professors supervise graduate students because they need the help of graduate students to accomplish their own research objectives. In most cases, a professor will agree to accept a new graduate student only if he or she believes this applicant is the one who is most likely to benefit the research program over the next few years. Only the most promising applicant will be selected from among those who indicate they want this professor as a graduate supervisor. That is, if the professor chooses anyone at all.

An undergraduate student who is unable to handle a full course load and get solid grades, semester after semester, is unlikely to be able to handle the high demands of graduate studies and research. Professors only want to invite hard-working people who can deal with a full load, all the time, over a period of years — because this is what professors need from their graduate students.

Hopefully, a time will soon come when the student in my story has gainful employment with some sense of job security, and also a bachelor’s degree in Psychology. One might not know exactly when good, long-term employment will actually come along, but in the context of today’s rising unemployment levels and struggling economies, it might be a while. Her best strategy would be to drop graduate school from her long-term plans, and focus on goals that are realistic in light of what she is willing or able to do.

There has been a trend for some years now, at least at my university, of undergraduates enrolled as full-time students taking course loads that are less than completely full. Many students are willing to take an extra semester or two to complete their degree, if it means they can avoid feeling overwhelmed with school work and get good grades along the way. Lightening one’s course load is a sensible way to achieve that goal. But, there might be a high price to pay, later on, especially if one is hoping to proceed to graduate school.

Students often tell me: “I have a job, and I need to work so many hours a week, and I just can’t deal with a full course load.” That’s too bad, because there are a lot of other people out there who also have a job, and who work a similar number of hours each week, and who have a full course load and still get excellent grades in all of their classes. And those who can handle it are not doing something above and beyond normal expectations, either. In fact, taking a full course load in each semester, and getting good grades in every course, is the bare minimum of what is expected of all undergraduate students (except for those who are expressly enrolled on a part-time basis, and those with disabilities that would normally preclude such expectations).

That last point about minimum expectations is an important one, so I’ll repeat it: If all a student does is take a full course load every semester and get good grades, he or she is doing nothing out of the ordinary. Someone who is enrolled in an undergraduate program as a full-time student, but who is taking less than a full course load — whether they began the semester that way or else dropped a course along the way — are doing less than the minimum of what is expected.

Note that the minimum required is far less than the minimum expected. There are no immediate negative consequences for a student who is doing less than expected. As long a student meets or exceeds the minimum requirements in terms of academic performance, the school will happily continue to accept tuition payments. So, most students just continue along until they eventually complete their program of study. Most will attempt to then join the workforce. But, a significant proportion will apply to graduate school, hoping that an advanced degree will bring greater opportunity.

Few, if any, professors are interested in accepting as a new graduate student someone who was an ordinary undergraduate. This means that students who are hoping to go to graduate school need to do more than just take a full course load and get good grades. They need to stand apart from the crowd. There are a lot of ways to accomplish this. For example, one could volunteer to be a professor’s research assistant, or regularly attend symposia or workshops in the field of interest. If a student’s current school has a work-study or co-op program, that might be a good way to get valuable work experience and begin establishing a network within the field.

There are other ways to stand out from the crowd, but that is the topic of another column, so I won’t get into all the options, here. I think you get the point: Most undergraduate college and university students are not exceeding minimum expectations. Even the majority of those who think they will succeed simply by getting excellent grades are not really doing anything special. This is one reason why only a small fraction of college students end up in graduate school. Few are exceptional enough in terms of work-ethic and readiness to make personal sacrifices.

Choosing Among Multiple Grad School Offers


This is the time of year when most people who have applied to graduate school for next September receive the decision letters regarding the fate of their applications. For those who have been following the advice I dispense on this blog and in my book, there is likely to be some good news in one or more of those letters! And if one has made prudent choices about how many programs to apply to, there might even be multiple acceptance offers. The more the better, of course, but having more than one choice of where to go poses a natural dilemma: How does one make that final decision when faced with more than one attractive choice?

If one is applying to graduate programs in which he or she will have a graduate supervisor right from the outset, then presumably, all of those who were initially chosen as potential supervisors and to whom applications were made are highly appealing because of a good match in research interests, interpersonal factors, and supervising style. If these factors were taken into consideration when deciding where to apply, then they should not need to be weighed again just to determine whether accepting a particular offer would be good decision. Choosing the right programs and potential supervisors in the first place should have ensured that any final decision about which offer to accept would be good. But, now the distant possibilities have become much closer, and there are several things to consider that were too premature to discuss in detail with your potential supervisors prior to the application.

As I have mentioned many times before, beyond a person’s character, their intellect, and the work habits that he or she adopts, nothing is more important in determining the quality of skill and training received in graduate school, and career prospects afterward, than the mentoring and guidance one receives from the graduate supervisor. And one of the most common reasons why students drop out of graduate school before finishing is because of problems they have with their supervisors. Unfortunately, more and more schools and professors are using financial incentives to attract strong candidates to their graduate programs and labs. If you are lucky enough to have people competing for you like this, read my recent post on Pitfalls of a Grad-School Bidding War.

The best way to avoid an unpleasant relationship with your supervisor is to find out in advance what is expected in terms of work habits and communication. Once these expectations are clear, it is much easier to develop and maintain a positive and productive relationship. It might also help you dodge a bullet if you discover that someone has unreasonable expectations that you cannot agree to. You can go elsewhere, if you have another option. Both the student and supervisor have expectations, and it is in the best interests of both parties that they are compatible. The following passages are excerpted from the 2nd edition of my book, Graduate School: Winning Strategies for Getting In.


Independence of research  Is the professor actively and directly involved in research, or does he rely on the graduate students to conduct all the research and report the findings? Some professors prefer to operate their research program at arms-length – managing the directions and priorities of the research conducted by the students they supervise. If a supervisor is too busy doing other things, you might not be able to count on getting timely advice or feedback. A professor who is actively involved in research alongside of his or her graduate students, however, is likely to be available for frequent consultation.

Background knowledge and skills  Does your potential supervisor have any particular expectations regarding your background knowledge, experience, or skills? Examples might include computer programming, or a particular laboratory technique. If you are missing some essential background, what do you need to do to get it?

Research direction  Will the supervisor expect you to take on a particular research project? This happens frequently at the Master’s level, and also to some extent for most students working toward a Ph.D. There is no reason to go begin a graduate program without advance knowledge of the research you will undertake while there. You should be aware of any projects the prospective supervisor already has in mind for you.

Work habits  When a faculty member becomes unhappy with a graduate student, it often has to do with some aspect of the student’s work habits. Misunderstandings or misperceptions are often part of the problem, and many situations could be avoided by setting out clear expectations at the outset. Of course, if you have not yet started your program and are just deciding whether or not this potential supervisor is a good match for you, it is premature to discuss expectations of your work habits. You can ask this person’s current graduate students, however.

Control over the direction of research  It is essential that the student and supervisor see eye-to-eye on this issue. Often, the new graduate student will just let the supervisor dictate the terms of the research to the student, who is then responsible for carrying out the work and writing a thesis. If this type of relationship develops early between student and supervisor, it is very hard to change, later. Not surprisingly, the lack of control leads many graduate students to feel somewhat oppressed by their graduate supervisors. This is another touchy subject, which is easier to raise with someone’s current graduate students than directly with that person.

Time and accessibility  How much time will your supervisor have for you on a weekly or monthly basis? Find out whether your potential supervisor prefers to communicate by e-mail, telephone, or in person, and ask how frequently you can meet.

Feedback  This is another topic that is easier to discuss with someone’s graduate students. What kinds of feedback do they get? Of course, you may need to simply accept the manner in which your graduate supervisor provides feedback. Based on what you learn about that person’s style of feedback, ask yourself the relevant questions: For example, how well would you deal with receiving frequent negative feedback mixed in with constructive criticism? Can you work with feedback that is general, or do you need detailed comments?

Financial support  You should also ask potential supervisors about their general expectations regarding financial support for graduate students. Does he or she require students to have scholarships, or are there other forms of financial support that are normally available to students in this program? This may be a more difficult topic to raise than most, but there is no need to be overly shy about it. Any potential supervisor you contact will understand that financial support is a central topic for nearly any graduate student. Believe it or not, it may also be a major issue for the faculty members who decide whether or not to supervise your graduate work.

Most letters of recommendation are never read! 


A strategy I sometimes use to get students’ attention during a lecture, so they are ready to learn a key concept, is to surprise them with something unexpected and provocative, just before I explain the ‘big picture’ key concept. The goal is to arouse their intuition and allow them to prepare for some important analytical thinking. An “eyebrow-raiser” can help get a point across in such a way that helps it sink in.

I do the same thing when I’m speaking to a group of students about preparing for graduate-school applications. One of my favorites comes up when discussing how letters of recommendation are used in the evaluation of grad-school applicants. I like to point out that these letters are often the most influential part of a successful application. No controversy there. But, then, I tell them that most letters of recommendation are never actually read!

I have to admit to getting a bit of pleasure out of those four or five seconds of stunned silence from a crowd of avidly attentive and fixated people. They stare, with perplexed expressions, waiting for me to explain what I really meant to say. But, instead of clarifying or correcting my comment, I repeat it: “Seriously, most letters, or at least a large proportion of them, are never read by anyone, other than being proofread by the letter writers before they seal them in an envelope.”

I might play a bit more by saying something like, “Oh, the envelopes with the letters in them are all opened — that’s necessary to confirm that the required documents are inside. But, it would take too long to read all the letters, and the people deciding who gets in might not even find it helpful to do so.”

This is usually when the low-level murmur among the audience picks up, and I notice some of the puzzled looks are changing to expressions of annoyance. The time has now arrived to make my point — and everyone is ready and paying full attention.

Exactly what I proceed to talk about may be different on separate occasions, because there are a number of reasons why most letters are never actually read. I will usually go on to explain how the process of selecting applicants actually works, and how not all applications get the same amount of attention, partly because different people may be responsible for evaluating different applications to the same program. Alternatively, I could describe the student evaluation form that the person writing a letter of recommendation is normally required to fill out and submit along with the letter. Understanding how this evaluation form is used in the selection process can go a long way to explaining why many of the letters attached to them are never read.

Here are some other provocative statements I use to garner attention and interest when talking to students about grad-school applications:

“Decisions about who gets in have nothing to do with who deserves it the most.”

“Helping a professor with his or her research is the best way to set up an effective letter of recommendation. This strategy backfires, more often than not.”

“Many students are accepted into a graduate program before they even apply.”

“I’m dedicated to helping students prepare for graduate school, and to helping them get into the right program. But, I won’t encourage my own children to go to graduate school after college.”

Your Applications Are In, But It’s Not Too Late To Hurt Your Chances


We’re nearing the end of January, and application deadlines for many graduate programs, for entry in September, have already passed. Decisions will not be announced for several more weeks. In the meantime, some applicants will find the wait unbearable, and all sorts of irrational ideas about what might be going on will creep into their thoughts (especially at night). If this describes you, then you really need forget about your applications for a while. They are out of your hands.

Importantly, although you cannot do anything now to improve your chances of being accepted, it’s not too late to make a mistake that will hurt your chances. I have known it to happen to applicants who got overwhelmed with worry as weeks went by and eventually decided to contact a graduate program to ask about the status of their application. They contacted either a graduate program director, or a potential supervisor, and due to the timing, their inquiries were perceived negatively, as either an attempt to manipulate the decisions, or a reflection of someone who does not deal well with uncertainty or stress. Contacting a graduate program between the application deadline and the time that decisions are announced won’t always have dire consequences for an applicant, but it is still better to resist any temptation to do it. Besides, one should not be contacting the important decision-makers at any point after the application deadline. There is always a secretary or administrative assistant whose responsibilities include dealing with questions from applicants. That person would be the right person to contact to check on an application, but it is still better to be patient. If you absolutely must phone or send an email to find out what’s happening, in order to avoid going crazy, don’t do it more than once. It could give the impression that you are egocentric, imagining your candidacy is of monumental importance to the program. Or it could suggest that you are impulsive or neurotic. If someone from a program wants to talk with you about your application, that person will contact you.


Not all experience is created equal: What kinds of experience counts as relevant when applying to graduate or professional school

Students often fail to realize the variety of ways there are to get the experience they need for graduate  or professional school, and there can be confusion about what types of experience are seen as relevant. Academic advisors are helpful sources of advice and direction, and anyone interested in applying to graduate school should speak to an academic advisor before getting into the application process. They should be able to explain how students in your field obtain relevant experience. They should also be able to tell you if there are classes you could take that require students to work on a research project for course credit, or whether there is an opportunity to do an independent study. Academic advisors might also be able to tell you what kinds of off-campus employment or volunteer opportunities exist in your locale, or they might be able to direct you to someone who can provide you with this type of information. Check out this article on what you can expect from your college career center.

Some professors hire students to work as research assistants and pay them from a research grant, but opportunities to work as a volunteer are far more abundant. An academic advisor might be able to tell you which faculty members in your department provide such opportunities. You can check departmental bulletin boards for help-wanted ads, but the best opportunities are seldom advertised, so you need to be proactive and ask professors directly whether they have an opportunity for you. Some professors never solicit students to help them with their research, but instead wait until volunteers come knocking at their door.

If you do get hired as a volunteer assistant to one of your professors, be willing to make a commitment and put in sufficient time and effort so that you will actually be of benefit to them and to their work. A mistake that some students make is to volunteer to help out for only a few hours each week, and in some such cases, once the time and effort required to train them is taken into account, the arrangement proves not to be beneficial to the person whom they were intending to help.

Summer can be an excellent time to find employment or volunteer opportunities as a professor’s assistant. For many professors, being free from having to deliver lectures and grade papers during the summer means they can spend more time on their research. This is when they are most in need of a student assistant to help get things done.

Work-study and co-op programs

Find out if your school runs a work-study program. These are usually government-sponsored programs designed to share the cost of employing students in relevant work, often with faculty members in certain departments who can provide such opportunities. Many work-study programs are intended only for financially needy students, so not everyone is eligible.

Most of the larger universities in the U.S. and Canada have co-operative education programs that integrate classroom studies with paid, real-life work experience in a degree-related field. Co-op students take regular classes on a reduced schedule while they work at a real job and earn a wage. Co-op program are primarily created as a way to get students the hands-on experience that will make them more employable once they graduate. Employers also like to use these programs as a way to recruit new young talent.

A prospective graduate advisor might also view positively the co-op experience of a graduate-school applicant. Compared to applicants who have only classroom experience in their field of interest, the co-op student may be assumed to have a better understanding of how things work in the “real world”, and better personal insight into whether or not this is the right career path for them. This can make them seem “less risky” from the point of view of graduate-school faculty members.

Start early

Most students who are serious about graduate school eventually realize the importance of getting some experience, the majority of them fail to take measures to get any until it is too late to take full advantage of the best opportunities. A good time to begin trying to find relevant work experience in your field is in the second semester of your sophomore year or during your junior year. One reason for looking for these opportunities as early as possible is that you might not end up with something immediately. Perhaps you wish to work as a volunteer research assistant in the laboratory of one of your professors, but when you ask her about it she regretfully tells you that her lab is already full and she really doesn’t have anything for you to do. She may suggest, however, that you come by and ask again at the end of the semester, or perhaps next year.

If you are already in your senior year and you realize that you still do not have any work experience or other practical experience in your field, you might still have time, but it is important that you immediately move this objective to the top of your priority list before it really does become too late. If you are determined to get into a good graduate program but you are a senior and lacking some of the kinds of experience discussed in this article, your best strategy may be to delay applying to graduate school until a year after you finish your undergraduate degree, and use the intervening time to get some of that experience needed.


Paying the Price for Higher Education: Don’t Do It!

Today’s post is aimed at helping anyone who is currently trying to decide which college or university to attend, starting next September. Many factors will likely be considered in making the final decisions of where to go, and no doubt, a lot of people will give much consideration to differences in the costs of attending different schools. Tuitions can vary a great deal, and there is a general positive relationship between the costs of attending a particular institution for an undergraduate degree and the ‘prestige’ of that institution, as perceived by the public. Of course, critical to justifying the higher costs of attending some colleges, there is also a widespread belief that the highly-prestigious institutions deliver a higher quality education than what is available at the ‘less-knowns’. This latter belief is an illusion. It is based on the mistaken expectation that you get what you pay for when it comes to higher education. In some ways you do, but not in the ways that are relevant to the majority of education consumers — the students and their parents.

This morning, I came across an illuminating report of a study that was done by researchers at Wabash College, which basically shows that there is almost no relationship between the amount of money a college spends on education and the quality of the education it provides. The study was reported at the recent annual meeting of the Association of American Colleges and Universities, and you can find the details, here.

Reading about this study inspired me to re-post something today that was originally published here several months, on June 25, 2012, Choosing a University for an Undergraduate Degree? Ignore the Rankings Lists. In this commentary, I explain why the prestige of a university is not significantly related the quality of undergraduate education it delivers, or to the quality of the student-experience. This is a total cut-and-paste, so if you read that post recently, you can move on to somewhere else from here, without missing anything new.


Choosing a University for an Undergraduate Degree? Ignore the Rankings Lists

Most students have options when it comes to choosing which college or university to attend for their undergraduate education. Some of the important factors to consider when making choices include, the availability of the desired program of study, the location of the institution, and the costs of attending. Different people may weigh each of these factors differently, but nearly everyone considers one or more of them when deliberating over the options.

Many people will also consider another factor — one that is much less tangible than program availability, location, or cost. I am referring here to the general reputation that an institution has among the lay population. Such reputations are often unqualified and vague. Rather than being based on genuine comparisons of the value of education or training available at different schools, they tend to be based on “what one hears” about a particular school, or how often it is mentioned in the news, or in other contexts (TV shows, movies, magazine articles, etc.). The general repute of an institution will, nonetheless, sway the decisions of many students (and parents) about which university or college to attend for a postsecondary education.

While there is no doubt that unaccredited diploma mills are a poor choice for any serious student who wants a worthwhile education, general reputations vary greatly among the thousands of accredited colleges and universities in North America. Most of us have acquired implicit respect for certain institutions merely from hearing them referred to often and in mostly positive contexts. Many of us will also make unsubstantiated generalizations about an institution based on its overall reputation. In most instances, an unwarranted overgeneralization about a college or university does not lead to any significant problems. On the other hand, it may become a problem for people who are trying to decide where to invest in a postsecondary education, especially if it leads them to make compromises in terms of the more valid considerations of program availability, location, or cost. Unfounded beliefs about the relative quality of undergraduate teaching at different schools can lead to flawed choices. Excellent opportunities may exist at schools with less recognizable names.

Okay, so subjective impressions that are based on indirect evidence may be flawed and shortsighted. But, what about those college or university-rankings lists that various organizations publish from time to time? In general, such rankings tend to be based on objective criteria, so it seems reasonable to have some faith in their validity. But, does that make them useful?

Although they can be mildly interesting to some, university rankings are virtually useless to the average person. At least, they are not useful for those purposes for which many people will actually use them. As I will explain, such rankings should be ignored when deciding where to go to for an undergraduate degree in most disciplines within the sciences, social sciences, or applied sciences, the arts, or fine arts.

Importantly, I am referring here only to rankings that deal exclusively with universities, without including undergraduate colleges. When it comes to comprehensive rankings-lists for all U.S. colleges and universities that offer undergraduate programs, the best I have seen is published by Forbes. Unlike university-rankings lists, the undergraduate college rankings tend to be more useful for discriminating between the “good” places to go for a bachelor’s degree and the “not so good.”

I had the inspiration for today’s blog post while recently perusing the Times Higher Education World University Rankings for 2011-12. The Times Higher Education list is one of the better known and most comprehensive ranking of global universities. Some of the other well-known university rankings lists include US News National University Rankings, QS World University Rankings, and Academic Ranking of World Universities, to name just a few. Each list has a particular geographical scope, which is usually limited to a particular country or continent. A few are global, including the THE list. A respected and widely-consulted ranking of Canadian universities is published each year by McLean’s.

I rarely check out these types of ranking lists, even though one might expect I would be more than a bit interested in them, given that I am a university professor, I am active in research and teaching, and I spend a lot of time giving students advice about how to achieve their higher-education goals. I also have three children who are likely to be heading off to college or university over the next few years. Yes, I would seem to have a number of good reasons for wanting to know which schools are the best.

But, the truth is, I would never consider using a university-rankings list as an aid to student advising. They simply are not useful for that purpose. To understand why, one must appreciate the variety of important activities that are conducted at any global university, beyond the teaching of bachelor’s students. In my experience, most members of the public who have never been employed in a university setting grossly overestimate how much these institutions focus their resources on undergraduate teaching. Experienced academics, on the other hand, understand that it is the research mission that is most highly valued and nurtured by university administrators, and by the governments that provide public funding. Most university professors dedicate more blood, sweat, and tears to their research, and perhaps also to training of Ph.D. students, than they do to teaching undergraduate students. Universities tend to hire new faculty members on the basis of their research profiles, and give somewhat less consideration to teaching ability. In other words, professors are generally hired to do research, and expected to teach, whether they are good at teaching or not. Of course, this is also true at some of the “highest ranked” universities. Most university professors have never received any formal training on how to teach effectively. I often tell students that this explains why so many of us are lousy teachers!

Back to the rankings lists… Let’s be straight on what I’m saying, here. My position is that the relative ranking of universities on these lists should not be used to decide which schools are likely to provide a better undergraduate education. The simplest reason why university rankings should not be used to decide which school to attend is because those rankings are based on many dimensions or aspects of a university that have very little, or nothing at all, to do with content or delivery of undergraduate programs. Below, I’ll say more about the types of factors that go into the compilation of a university-ranking list, using the methodology behind the THE list, as a general example.

For now, let me make the point that only around 5% of a university’s score on the THE ranking is based on factors that are directly relevant to undergraduate education. The other 95% of a university’s score is based on factors that have little or no relevance to determining the quality or delivery of undergraduate education available to its students. Consider the central missions of any global university — research, teaching, knowledge transfer, and international activity.

The following is an overview of how THE ranking scores are determined.

There are 13 performance indicators, grouped into 5 areas:

Teaching — the learning environment (worth 30 per cent of the overall ranking score)

Research — volume, income and reputation (worth 30 per cent)

Citations — research influence (worth 30 per cent)

Industry income — innovation (worth 2.5 per cent)

International outlook — staff, students and research (worth 7.5 per cent).

Factors related to teaching account for less than one-third of a university’s overall score. THE also provides alternative rankings based on the specific performance areas. So, what if we just look at the rankings based only on the Teaching indicators? Well, let’s look at how they determine this particular 30% of the overall score — you will see that only a tiny fraction of it comes from undergraduate teaching considerations.

Half of the Teaching score is based on the results of a survey. Quoting from the methodological description on the THE website:

            ” Thomson Reuters carried out its Academic Reputation Survey – a worldwide poll of experienced scholars – in spring 2011. It examined the perceived prestige of institutions in both research and teaching… The results of the survey with regard to teaching make up 15% of the overall rankings score.”

There are two points I want to make about this measurement: First, notice that it’s based on the “perceived prestige” of a university in teaching and research. I would venture to say that it’s not too difficult for an experienced scholar to judge the prestige of a university based on quality and quantity of research conducted, because there are many visible indicators of research funding, activity, and output. Unless someone was once a student at a particular university, however, it is unlikely that he or she will have a clear view of the quality of undergraduate teaching that goes on at most universities, other than the ones with which they are currently associated. Admittedly, there are some scholars who happen to do research or administrative work, which, in one way or another, gives them a close enough vantage point to a few universities that they may be able to provide valid assessments in terms of the general quality of undergraduate teaching. But, individuals with real insight into the quality of undergraduate teaching at different universities are exceedingly rare.

The second limitation I want to point out about the “perceived prestige” measurement is that when pondering their views on the quality of teaching that exists in universities at which they have never been a student or instructor themselves, most experienced academics will consider what they know about the “products” of doctoral-level training, or even the postdoctoral training environment. These products, of course, are the people receiving a Ph.D., many of whom go on to have significant impact in various areas of research, engineering, or some other type of creative production. In other words, perceptions about teaching quality are based on perceptions of postgraduate training, not undergraduate teaching.

Other factors that contribute to the Teaching category include: 1) Ratio of PhD to bachelor’s degrees awarded by each university, which is worth 2.25% of the overall ranking scores. 2) Number of Ph.Ds awarded relative to the number of faculty members (i.e., academic staff) at the university, worth 6% of the overall score. 3) institutional income scaled against academic staff numbers, … adjusted for purchasing-power parity so that all nations compete on a level playing field, …” This is worth 2.25% of a university’s overall score.

Factors 1 and 2 are more relevant to training of graduate students. Most students join the workforce after college, so only a small proportion of undergraduates would have anything at stake in the quality of graduate training available where they choose to earn their bachelor’s degree. Although some undergraduates may appreciate being in an environment that includes graduate students, most do not care. Factor 3 is about money; having more of it may contribute in some ways to having superior undergraduate teaching resources, but those are seldom the spending priorities for a university, these days. In other words, none of the factors that have been considered so far are valid indicators of the quality of undergraduate teaching.

If you’re keeping track, you may have noticed that we still need to account approximately 5% of the overall THE ranking score. Finally, we’re getting to something that’s actually relevant to predicting the quality of undergraduate teaching — or at least, the quality of the undergraduate learning experience:

            “Our teaching and learning category also employs a staff-to-student ratio as a simple proxy for teaching quality – suggesting that where there is a low ratio of students to staff, the former will get the personal attention they require from the institution’s faculty,…”

As the folks at THE are quick to point out, “… this measure serves as only a crude proxy – after all, you cannot judge the quality of the food in a restaurant by the number of waiters employed to serve it…” Accordingly, it accounts for just 4.5 per cent of the overall ranking scores.

Despite it’s crudeness, the staff-to-student ratio is, in my opinion, the only factor contributing to the overall ranking score that is clearly relevant to determining the quality of undergraduate education for the majority of university students.

I hope my analysis of the methods behind the Times Higher Education global university rankings makes the point that universities exist for the sake of much more than just teaching undergraduate students. University professors are hired to do research, and expected to teach — not the other way around. Things are somewhat different at most liberal arts colleges, however, so it’s important to keep in mind that I’m talking about universities, here. Of course, different organizations use different formulae to compile their university-rankings lists, so there is some variation in terms of how relevant the rankings are to the concerns of undergraduate students. But, its important to remember, if the rankings are comparing universities and not just undergraduate colleges, much more weight will be given to various aspects of the research mission, including doctoral-level training.

The problem I’m getting at is the way these rankings lists end up being used by many regular people to make important decisions that should not be made on the basis of such rankings. Don’t get me wrong — it’s not that I don’t think the rankings lists are useful, nor am I about to criticize the methods that are used to compile them. They are relevant for regular folks, for certain reasons. But, none of those reasons have much of anything to do with the undergraduate training mission of the typical global university. These rankings lists can contribute to the impressions that typical consumers have about the “quality” of particular universities. This is fair enough. After all, there is a lot of good research and objective analysis behind some of rankings lists. The Times Higher Education World University ranking is a fine example of that.


Letters of Recommendation for Grad School: Beware the Bad Letter-Writer

Back in the mid-1990s, I was collecting material for the first edition of a book on applying successfully to graduate school, and I interviewed several Graduate Program Directors and other university faculty members in a wide range of disciplines. The people I met were all insiders to the graduate-admissions process — graduate-school faculty members — the only true insiders. I have continued discussing grad school with other faculty colleagues, ever since. One topic that always comes up is the common shortcomings of grad-school applications that tend to lead to those applications being rejected. Turns out, there are a lot of common shortcomings, and students still make the same mistakes when applying to graduate school that I made, back in the mid-1980s! I was successful in my bid to get into grad school, but in retrospect, I was lucky in many respects, and it could have easily turned out differently.

Today’s blog post is about just one of the fatal flaws that can afflict an application to graduate school, but this is a particularly harsh one for students whose applications end up being rejected only because of this particular weakness. It’s a harsh one, I think, because this flaw is not the product of anything the applicant actually does, or fails to do. Instead, when this particular problem shows up, it’s more accurate to describe the applicant as an unfortunate victim.

Unintentionally screwed

I was a bit surprised the first time I heard about this problem from another graduate faculty member. But, I was a brand new assistant professor at the time (1994). Since then, I have heard it repeated by many others, and I have also seen it firsthand countless times over the years. The problem has to do with letters of recommendation, which, all too often, end up being of very low quality. Importantly, when I say “low quality” here, I’m not referring to the caliber of the applicants. Instead, I’m referring to the utterly awful job some referees do of writing recommendation letters!

There are good letter writers and there are bad letter writers. I’m not referring here to people who write good or bad things about a student. The fact is that some professors simply do not know how to write an effective letter of recommendation, even when they have only the most glowing regard for a student. And then there are the professors who don’t care enough to spend the necessary time writing a really effective letter for a strong student — professors who actually know how to write a good letter, but usually don’t.

Ineffective letters are usually short, one or two paragraphs, and describe the student’s qualities in vague or general terms. These can kill an application. Good letters should provide informative anecdotes or some other revealing evidence to back up the positive claims that they make about the student. Many professors do not put in the required effort to work those things into their letters. Some just fail to use good judgment, by including irrelevant, or sometimes, even inappropriate comments. A statement like, “This student rocks!” is going to have a bad effect, no matter what else is in the letter.

The effectiveness of a letter of recommendation depends on much more than simply how many good things the referees say about the student, or how well they back up their claims. It also matters how relevant the accolades are to the concerns of the potential graduate supervisor or admissions committee. The evaluation forms provided by some graduate programs request that referees comment on specific qualities of the students. For example, they might be especially interested in the students’ writing skills, commitment to a career in a particular field, and industriousness, to mention only a few. All too often, however, the referee ignores the instructions, or only partially follows them, and instead they just write what they believe is most important to include, which may be of significantly lesser importance to the people for whom the letter is intended.

I realize that the majority of students who are thinking of applying to grad school do not have an abundance of great options when it comes to professors to ask for a letter of recommendation. But, some do have more options for suitable referees than the number of required letters. So, those students have to decide whom to ask for one (Note: Do not assume it will be okay to submit more than the requested number of letters).

The main message here is worth repeating: Someone with high regard for a student can still write an ineffective letter of recommendation, one that does little to enhance the quality of the student’s graduate-school application (or scholarship, or job application). Professors who are bad at writing letters of recommendation do not come with signs or markings to distinguish them from those who are good at it. The only reliable indicator of a professor’s proficiency with letter-writing that is potentially visible to students is the track-record of advancement, or scholarships or fellowships, enjoyed by the professor’s former students. If a professor’s former students — undergrad, grad, or postdoc — tend to be successful, this is probably at least partly because the professor writes effective letters of recommendation.

Improving the odds

Although it’s not possible to completely eliminate the risk of having your grad-school application torpedoed by a poor letter of recommendation, there are several things you can do to make it less likely:

1. Make it easy for the referee.

Professors are busy people, and it takes time and effort to compile truthful, relevant and positive statements about a student, along with anecdotes or other evidence to support the claims. It can take even more time to compose it so it is truly convincing. Ease the burden on your referees by furnishing them with material they can use to prepare your letter. Provide them with as much relevant information about yourself as possible. Having the foresight to provide these materials might also add to your referee’s impression of your good judgment and consideration. Keep in mind that your referees will probably be busy writing for other students around the same time as yours. The easier you make their task of writing your letter, the more likely they are to spend the time and effort needed to make it a good one.

2. Give your referees the time they need to prepare a good letter.

Solicit your letters of recommendation a few weeks in advance of when you will be need them. Students often underestimate the amount of time that goes into writing an effective letter of recommendation. If someone takes only ten or twenty minutes to write a letter of recommendation for you, then it is not likely to be much of a letter; it might say only good things about you, but it probably will be ineffective. Don’t expect your letter to be anywhere near the top of your professor’s list of priorities. Your letters may be extremely important to you, but they probably won’t make it onto your professor’s top-10 list of things to deal with. Asking for a letter weeks in advance of an application deadline is no guarantee that your referees won’t still leave the task of writing them until the last minute and end up rushing anyway. It may, however, increase the likelihood that they will spend more time on your letters.

3. Solicit your letters in an appropriate manner

Your interpersonal and social skills may be described in the letter, and the impressions that you make when soliciting the letter may contribute to the referee’s attitudes about you. As we have already discussed, proper timing is important and it can be perceived as rude or inconsiderate when a request for a letter of recommendation comes too close to the deadline by which it is needed. Please read my previous post on how to properly request a letter of recommendation.

4. Don’t implicitly request a mediocre letter.

This tip couldn’t be expressed more clearly and succinctly than it is in the following quote I get from Dr. Matt Might, a computer science professor at University of Utah [He has a great website where he shares advice and insight on a range of topics relevant to science students at all levels of training (undergrad, graduate, postdoctoral)].

“When you ask for a letter of recommendation from a professor, don’t ask them if they can write a letter of recommendation. Of course they’ll say, “yes,” to that. Ask a professor if they can write a strong letter of recommendation. This provides them a way to say “no,” and saves you the embarrassment of a crappy recommendation letter.”

Dr. Might also has a lot of other good tips on how to get into grad school.

5. Show proper gratitude

Do not forget to express your gratitude for the time and effort your referees are going to spend trying to help you. Remember, a good referee who really wishes to help you will probably spend a considerable amount of time writing an effective letter of recommendation. When I write a letter for a very strong candidate, it usually takes me a few hours. This is a few hours of my time that I could have spent on something else. Your professors are probably busier people than they appear to be. You will owe them a great debt for this favor, whether or not their letters end up helping you get into graduate school.