Law in Contemporary Society

View   r13  >  r12  ...
GradingProfessors 13 - 17 Feb 2010 - Main.EbenMoglen
Line: 1 to 1
 

a.k.a. Grading Professors So WE Get Better Feedback

From Eben:

Line: 6 to 6
 @Eben Thank you for your guidance. I would like to hear more about why the below idea is "ridiculous," but understand that you do not want the class to go in that direction.
Added:
>
>
All right, let's start there. Students do not "grade professors" through course evaluation forms. Grades would be at least as stupid for teachers as they are for students, and even grades for courses are stupid. The utility of course evaluations, in my view, is slightly higher than the utility of letter grades because they do not reduce all qualitative measurements to a single quantity, but they have all the other difficulties I discuss in the EvaluationPolicy. The actual learning about teaching that I do, like the actual learning about law that students do, is done in the relationship between teacher and student. That's no more about anonymous scaling for me than it is for you.

What course evaluations actually do is to regulate elective enrollment. A teacher who wants to maximize the pay he receives while minimizing the work he does in order to receive it will minimize teaching effort, because teaching is hard. Being known to grade exactingly, or to do some other thing students dislike and teachers profess to admire reduces workload without penalty. Indeed, there is essentially no penalty for driving down elective enrollment by any means for any teacher, tenured or untenured, and the skill is widely practiced, with different degrees of self-consciousness, throughout the firm.

"Feedback" questions on an evaluation are essentially, in my evaluation vocabulary, an effort measurement; indeed, they're a good one. A teacher not giving you much feedback may be exerting effort to create good classroom experiences, or to choose material for you wisely, but these are the fixed costs of teaching. The variable costs are in the relationships one has with students, and one cannot have meaningful relationships with students in their learning process without interaction, which we call "feedback," unwisely. So in measuring quality of feedback we are essentially measuring quantity of student-specific effort.

But tradition of a century's standing has determined how much effort is "enough" at law school student-faculty ratios. So a teacher reading low on the feedback scale is actually doing his job. He has no incentive to increase his level of effort, if that would increase his enrollment which would require increasing his effort level (a process that is technically and correctly known as "feedback"). No reputational penalty will be paid for doing enough, rating low on the effort scale (helpfully now named in a euphemistic way "Feedback"), and depressing enrollment in a socially-acceptable way.

So in my analysis from both theoretical and practical perspectives the idea is ridiculous: inappropriate, insufficiently self-critical, half-baked and likely to cause the reverse of its intended effects if it has any effects at all. These are positive qualities in an idea. That's because every idea leads to other ideas, and there's no guarantee that an idea which is "wrong" will have inferior ultimate intellectual effects to an idea which is "right." (I have mentioned this point before.) But although a ridiculous idea is an enormous advantage in a sequence of ideas, it's a disastrous social tactic, that is, a tool for achieving finite objectives given finite resources. Small ridiculous ideas turned into tactics are what result in horrendous casualties for no strategic benefit, while large ridiculous ideas turned into strategies are what result in imperial calamity. When you start turning this notion into an objective of political organization, it goes from being inventive and therefore helpful regardless how naive to being perilous. So I try to head it off by sending a small cavalry force to the pass with instructions to use the flat rather than the edge of the blade.

Now, do we really need to spend a great deal of time on why I think that trying to reform law school when you've not yet seen five-sixths of it once is sort of like offering legal opinions about cases you haven't read?

You actually solemnly give me sentences of argument on why lawyers can be educational reformers, when the whole point is that if you undertake to be lawyers, you won't do educational reform or anything else by thinking you can know the case by reading the press coverage, or know the intricacies of the system by watching television, or know the alphabet by mastering the first 19% from A to E.

I have every confidence, more confidence than you know, in your class's ability to mobilize itself to change law school. If law school has not substantially changed itself by the time you reach the last semester of your third year—which I very much doubt it will have done, or even shown inclination to do—you will have an opportunity that comes only once a generation to make your mark in forcing it to change.

But you're not ready yet. You haven't been trained enough. You don't understand the environment enough. You don't have institutional memory because you've just arrived, and without institutional memory you have no basis to evaluate the effects of your actions. You can know now only why law school doesn't work well for you; over time that will permit generalizations for which I am doing my best to provide you with real intellectual support. But the hasty adoption of an aggressive tactical posture consisting of knowing what should be done and how to force it to happen is puerile. By the time you are a well-trained lawyer I hope you'll have learned to approach situations differently. I hope you'll have come to appreciate the pleasure, as well as the necessity, of learning about social situations in a less bias-cultivating "advocative" fashion, and thus to build strategies maturely, on a sound factual basis, as well as creatively, by incorporating many forms of social knowledge in your eventual arrangements. I hope you'll have learned also to adopt tactics in close underlying relationship to the strategies that determine what should be achieved and how much blood and treasure can be allocated to achieving it. Such strategic wisdom and tactical adroitness would allow each of you to devise the master strategy of your practice, to balance getting the resources that you need (including those that support you and your family) with a mix of professional activities that achieves real, valuable goals for you and your community, "feeding back" sufficient resources to sustain the practice in its next phase. With such knowledge you could do what you all quite rightly say you don't see the way to doing now. On the way out the door you could do something good for the future of legal education, but that's the least of it.

I'm trying to create a place of relationships among us in which the basic parts of that learning can be communicated (this is a first-year course, after all, and you are still at the beginnings of your learning process—not everything could be communicated in fourteen weeks even by a perfect teacher to a perfectly-prepared and ideally-behaved student). We are still far from socially committed to the process however, and week after week we are still clearing away brush and building trust. There is still a prevailing belief that I'm trying to get you to have my ideas about what lawyers should do. And there's still a prevailing idea that in order to learn what you need to learn you'd have to fix law school. Both are wrong.
 I am not sure where to go now however. Perhaps you can help. While you make a strict distinction between education reform and lawyering, isn't it largely lawyers who write education policy. Certainly law school policy is created and changed by lawyers. From Robinson I took away that a "real lawyer knows how to take care of a legal problem." Advocating for an administrative change to improve a problem is exactly the kind of thing I hope to do as a lawyer. I thought as an aspiring lawyer it is appropriate for me to learn to take care of legal problem. Am I thinking about being a lawyer incorrectly or Am I thinking about your class incorrectly? [Alex, I changed the order of your I(s) and am(s) in order to make sense with your ?, if this is not what you intended I apologize.-Rob]



Revision 13r13 - 17 Feb 2010 - 22:59:05 - EbenMoglen
Revision 12r12 - 17 Feb 2010 - 08:54:13 - RobLaser
This site is powered by the TWiki collaboration platform.
All material on this collaboration platform is the property of the contributing authors.
All material marked as authored by Eben Moglen is available under the license terms CC-BY-SA version 4.
Syndicate this site RSSATOM