Why the law school rankings are flawed

Shambo Nandy, part of a group of students and faculty from NUJS that has preferred a complaint against the purportedly flawed Law School rankings in India Today and Outlook to the Press Council of India, explains the reasons for the same.

At NUJS, we had hoped that the 2010 rankings in different magazines would give us good reviews particularly because of our recent achievements which includes the following:

  • Hiring of new and experienced faculty
  • NUJS winning the internationally reputed ELSA Moot and also the NLS arbitration moot for the third time in a row besides winning other moots.
  • There being unprecedented research output by NUJS faculty with many of them publishing in peer reviewed journals with a high international impact factor.
  • NUJS Law Review being ranked twice as the best law review of the country.

Hence, we had fairly expected that our rankings would improve majorly (in the case of India Today) or at best would remain the same (in the case of Outlook). Now, when the rankings were published (both of them coming out in the June 28, 2010 edition of India Today and Outlook) we were crestfallen and some of us were very angry with the dismal rankings that we got.

Most national law schools are run to a great extent by its students and as a consequence the development of a national law school depends largely on the quality of students who came in. Hence, we were worried that CLAT aspirants who tend to rely on such rankings will not give higher preference to NUJS.

Since Prof Shamnad Basheer had expended considerable amount of time gathering the data and sending them he was also greatly perturbed by the rankings. One day when he told me and Debanshu that he was looking for a team who could do some research for him in relation to the rankings we were more than willing to do it because we were also greatly dissatisfied with the gross inaccuracies and methodological flaws.

While researching we found out that not only NUJS but many other law schools were given lower marks than what they deserved. It was then that we thought of writing a generalized letter that would highlight the faulty methodology that these surveys employed.

We found out the following flaws:

1. Points/Weightage for “Selection Process”- All the leading national law schools conducted the very same joint entrance exam (CLAT) to select candidates and the entire process is overseen through a common committee (viz. CLAT Committee, consisting of heads of all law schools), but Outlook gave them different points under the head “selection process”.

2. “Academic Excellence” given relatively lower marks/weightage- A severe methodological flaw was the fact that colleges were marked on “288” under the category “Selection Process”, whereas the total marks/weightage given to “Academic Excellence” was only 200. Academic Excellence of a college is a more important criterion than selection process and hence merited higher weightage as the college’s functioning depends on it.

3. Discrepancies in marks allotted for placements- It was rather strange that NLSIU which had the best placements overall was given lower marks (139.3) than NALSAR (148.5).

4. Faculty Performance Not Taken Into Account- Faculty performance is critical to the reputation of any educational establishment. But Outlook did not consider this in their rankings. This is despite the fact that they had asked for various data relating to faculty performance and we had accordingly sent in all these details, including faculty publications.

5. Influence of Advertisement- We were very concerned of the prospect of sponsorships and paid advertisements influencing individual rankings. This was more so because even NUJS had received such an offer to advertise in Outlook for varying rates starting from Rs. 1,00,000 and going up to Rs. 5,00,000. We also found out that any college that had advertised in that issue in any of these magazines had only seen its ranking improve relative to the previous year or at the least remained the same.

6. Sudden drop in rankings- Colleges may drop or gain ranks year after year. However, any sudden drop in rankings must surely have some causal demonstrable link. NUJS was ranked second in 2009 and ranked fifth in 2010. Potential reasons for a drop in rankings such as this could have been that some of the star faculty left, or that there were no significant achievements by students, or significant research output by the faculty, etc. But in all these areas, NUJS performed exceptionally well in the year 2009-10. There was also no demonstrable link to also show that other law schools got better than NUJS during the period under survey.

7. Risk of Inflated Data- The market survey agency sent out a questionnaire to every college and they were marked on the basis of the responses that the colleges sent them. However, we have reason to believe that the data sent by the law schools was not independently verified by the agency since the data sent by NUJS was also not further verified. Without independent verification, there is unbridled scope for the individual colleges to send inflated and glossy data.

8. Overall methodological flaws and lack of transparency in the survey- We found out that Outlook used three different agencies to rank different colleges over the past few years. The criterion adopted in the different years was different, without any accompanying explanations for the changed methodology or why a particular methodology/heads were preferred over others in the first place. Illustratively, in 2008, the respondents were asked to rate institutes on the basis of “faculty competence” and “pedagogic systems”, where in 2010, “faculty competence” was dropped as an indicator altogether. The 2008 survey methodology explains that 120 people were interviewed. However, the Outlook issue did not elaborate on who these 120 people were, what cross section of the legal sector did they represent and how qualified were they to express a view in this regard. Similarly, in 2009, the methodology explains that experts were asked to rate the colleges, but does not mention as to who these experts are or the broad nature of their institutional affiliations and what specific legal sector they represented.

Based on the above, we demanded that Outlook released all the data that the survey agency had procured from the various law schools in relation to the questionnaire that was circulated with a direction to also elaborate the ranking methodology in greater detail and why certain criteria were chosen and weighted.

We had given them one week to send us their reply and since they had failed to do so, we have now filed a complaint with the Press Council of India under the Press Council (Procedure for Inquiry) Regulations, 1979.

Posted in Law Shool | Tagged | 5 Comments

How the Maharashtra Gov ended Famine

I’d invite our readers to read Sainath’s editorial in The Hindu about food security and as to how the Maharashtra Government ended famine in its state; i.e. by refusing to recognise the term in law. Excerpt below;

In 1963, the government of Maharashtra ended famine forever in the State. It did this without adding a morsel to anyone’s diet. It did so simply by passing an Act in the Legislature that deleted the word ‘famine’ from all laws of the State. No kidding. This was called ‘The Maharashtra Deletion Of The Term “Famine” Act, 1963” (And was dug up after decades by an independent researcher from Bangalore.)

The basis for this? Let the Act explain itself. It asserts that “there is now no scope for famine conditions to develop.” Why so? Because “the agricultural situation in the State is constantly watched by the State government.” And “relief measures as warranted by the situation are provided as soon as signs of scarcity conditions are apparent.” Goodbye Famine.

The next para says the term ‘famine’ “has now become obsolete, and requires therefore to be deleted” (emphasis added) from “other laws on the subject in their application to the State.” It decrees that “for the words ‘famine or acute scarcity’ the word ‘scarcity’ shall be substituted,” in all laws of the State. Lucky Maharashtra — it can’t ever have acute scarcity either.

The entire article may be read here.

Posted in Uncategorized | 1 Comment

When Every Tom, Dick and Harry Turn to Being Hart and Fuller

The other day as I sat watching the Motley theatre group perform Antigone on stage, I was constantly reminded of the law school staple of the Hart-Fuller debate. The tussle between positive law and natural law has been around since long and will continue to be so. Thus, as Antigone defied the law of Thebes and went ahead to bury her dead brother with honour, Creon argued for how he as the king had the obligation of ensuring that the law is adhered to in order to bring order to the kingdom, and in keeping with this ideology he executed his niece Antigone.

Those in the legal business pick sides in the debate, consciously or otherwise, with some sticking to the black letter of the law and others going beyond. But those not in this business are also engaged in the debate. A look at popular culture is a good indication of this.

Cinema based on the Holocaust and freedom struggles, among others, showcase instances of human conscience urging one to go beyond the law. Schindler’s List, the Reader, what have you. There are of course scores of movies and books and documentaries that I’ve left out of this post, which too engage in the debate.

And it’s important for this debate to be carried out in every possible forum, not just in the court room. It’s important, in my opinion, for the subjects of law to understand that the laws that they are ruled by are not infallible. This is not to say that there ought not to be obedience of every law one has a grouse with. Only that as a society, the obligation we owe to the rest of the society sometimes trumps the one we owe the State; an understanding that stood in good stead while countries fought for independence from colonizers, and Jews were helped from the wrath of a tyrant. So if in the future we are faced with equally difficult choices to make, these debates would have gone a long way in sensitizing us enough to use good judgment.

The beauty of the debate between natural and positive law is that it’s one of those debates that can be carried out in Ivory Towers, courtrooms, coffee shops and street corners with equal passion and relevance.

Posted in Legal Theory | Tagged | Leave a comment

The Intent to Deceive

The furore over the recent changes to the Nuclear Liability Bill is well founded. Its ironical that after all the ruckus that was created by the Centre over liability in the Bhopal Gas leak disaster, the Centre now has introduced changes in the Bill to further dilute the liability of suppliers in case of nuclear accidents. First, to start with the crucial Section 17;

“the operator of a nuclear installation, after paying the compensation for nuclear damage in accordance with Section 6, shall have a right of recourse where –

(a) such right is expressly provided for in a contract in writing;

(b) the nuclear incident has resulted as a consequence of an act of supplier or his employees, done with the intent to cause nuclear damage, and such act includes supply of equipment or material with patent or latent defects or sub-standard services;

(c) the nuclear incident has resulted from the act of commission or omission of an individual done with intent to cause nuclear damage.”

In a background, Section 6 of the Bill provides for compensation that an Operation ought to pay upon the occurrence of an accident (which is fixed by the way). The Bill further gives the Operator a right to recourse, i.e., to recover some amount from the Supplier which is provided in Section 17. As one would notice, this option of recourse is severely limited only to those situation where the Supplier supplied faulty material and equipment with the intent to cause nuclear damage.

Most of us would have studied torts in first year law school. While studying Rylands v. Fletcher, we are prompted to understand as to how the Indian situation is way better with the pronouncement of ‘Absolute Liability’ by Bhagwati J. In MC Mehta v. Union of India (Shriram Chemicals, Oleum gas leak case). Absolute liability is the determination of liability of a defaulter without the consideration of intent. The consequence of the recent amendments, after already fixing the amount of compensation, is the dilution of the this principle of absolute liability on part of the supplier. On part of the Government, this seems as the best way to ensure that foreign suppliers of nuclear material don’t face any action despite the accident having occurred as a consequence of the fault in their material.

One may ask whether it is right (legal) for the Parliament to dilute a judicially evolved principle by a statute? The answer is in the affirmative and is an instance of parliamentary superiority over the judiciary. Unless such statute is against the Constitution, the Parliament is entitled to do so.

Posted in Uncategorized | 3 Comments

Journal Posterboard

We’ve a new page dedicated exclusively to announcements and call-for-papers from law journals across India and elsewhere. Editorial board members are requested to send a condensed version of their CFPs to put them up in the new page. Announcements are displayed in reverse chronological order of release.

Posted in Law Shool | Tagged | Leave a comment

The Judge and the Grudge

The treatment meted out to two new transferred Chief Justices of High Courts is a study in contrasts. On the one hand is Justice J. H. Khehar, who is taking over the Chief Justice of the Karnataka High Court on a transfer from Uttarakhand. And on the other is Justice P. D. Dhinakaran, on a transfer from Karnataka to Sikkim. The former was welcomed with warmth in a huge turnout at the court. The latter took oath amidst boycotts from the bar associations in Sikkim. The former is not mired in controversy, has no charges of alleged corruption against him; which is more than can be said about the latter.

So what is it that Karnataka has done right to deserve a squeaky clean Chief Justice that Sikkim has not? True, the charges against Justice Dhinakaran haven’t been proved, but they haven’t been disproved either. Was the government not thinking about the signal such an appointment would send to the people in Sikkim? We don’t care about the state enough to ensure a Chief Justice with a clean record, but of course when China stakes a claim on the land, we will scream and roar and protect the land that is ours. Seems like we’ve just celebrated another unholy marriage of law and politics.

Posted in Court, Politics, Uncategorized | Tagged | 6 Comments
  • RSS
  • Twitter
  • Facebook
  • NetworkedBlogs