In the recent past, many organizations have started publishing rankings of engineering colleges in India. The readers get confused as not all rankings match each other. We have attempted to clarify a few points here regarding methodology so that readers can look at these rankings in a more informed way. One of the main reason for difference in rankings comes from the methodlogy used by each organization. The second reason which can lead to a lot of variation is the participation or refusal of some organizatrions to participate in the survey.
We at i3RC have studied the ranking methodology being used by many organizations worldwide and also had discussions with experts in India to finally arrive at a robust ranking system. Our preliminary research showed that ideally a weightage of 50:50 should be given to perceptual and factual ratings. Further we learnt that less than 5-6 parameters made too much generalization and hence compromised the final results. On the other hand more than 10 parameters made it too difficult for people to rate and rank. Hence 8-10 easily understood parameters for evaluation was the best solution.
We also learnt that importance of parameters is a dynamic process and the focus keeps shifting as the environment is changing, needs of the society and nation are changing, technology is changing, the deliveries are changing. Thus, a subjective system of assigning weightages to various parameters by a few experts was not the best solution. For this we finally developed a more robust statistical approach using a regression model. We do not claim to be the most robust methodlogy but we do take utmost care to be statistically sound and un-biased in our apporach as well as ensure wide coverage. We are also continuously learning and modifying our approach incorporating new suggestions and improvements every year.
An extensive 5 week field work was conducted beginning the 2nd week of March 2016
In module 2, more than 800 engineering colleges were sent the factual data questionnaire and then rigorously followed up through different modes such as telephone, email and even face-to-face.
The factual data sheet was focused on the following information areas:
In this module, a strucutred Questionnaire was administered to selected respondents to get rating of various engineering colleges in India at overall level as well as on specific parameters. The initial list had over 800 Engineering colleges, though each respondent was asked to give ratings for only those colleges that he/she was aware, considered them as one of the top colleges at the national level and at their zonal level. A respondent was asked to rate a maximum of 20 colleges to avoid investigation fatigue to ensure quality data.
A sample survey of 1500 was conducted in select cities – Class A (Delhi-NCR, Mumbai, Chennai, Kolkata, Bangalore, Hyderabad and Ahmedabad) and Class B (Chandigarh, Pune, Indore, Jaipur, Lucknow, Bhubaneswar and Ranchi). In each city a geographical spread of the sample was ensured by selecting multiple starting points spread across the city.
There were two main respondent categories who were interviewed to evaluate an engineering college viz. those who had the experience of such Colleges (Experiential) and those who were searching, aspiring for engineering and evaluating these colleges/ universities (Perceptual). The respondent categories included:
Respondents were provided a list of parameters to evaluate the engineering college & rate on a scale of 1-10 where 1 was poor & 10 was excellent. The list of parameters to be covered in the survey was arrived at based on past surveys as well as discussions with experts from the engineering fraternity – faculty, HR, etc.
As mentioned above 6 different stakeholders were taken into consideration for the national perceptual rating survey viz. Faculties, HR Executives, Alumni, Current students, Parents of aspiring students, Students aspiring for an Engineering course. The questionnaire was so designed that both experiential & perceptual target respondents were exposed to the same parameters – this ensured that the scores of different stakeholders could be correlated and collated to arrive at a single final score.
A robust approach was followed to arrive at the final rankings. The step by step process is given below:
It must be noted that not every engineering college that got established since 2010 gets included in the Emerging Engineering Colleges but only those who achieved a comparable mention and perception score.
Some of the well known institutes including IIT Madars, IIT Kanpur, IIT Hyderabad, IIIT Bangalore, VJTI Mumbai wished to be excluded from the ranking process during the factual survey thus not featuring in the ranking