IIRF Ranking Methodology
The Ranking of Institution
Indian Institutional Ranking Framework (IIRF), India, presented by Education Post, a monthly magazine on Higher Education, is a non-government body working on ranking of various institutions on a periodic basis. There are separate ranking surveys for Indian Universities, Indian B-Schools, Indian Engineering Colleges, Indian Executive MBA offering institutes etc. This organization has experts from education, academics, statistics and management, who discuss and develop ranking methodology and approach. Currently, IIRF is conducting a survey to rank the top universities of India. This document is pertaining to this research and cover methodology and approach.
Knowledge Partner
IIRF expert team has a research tie up with Maction Consulting Pvt. Ltd., Ahmedabad, to support them as their dedicated knowledge partner for these ranking surveys. Maction Consulting is a full services research organization in India, and has branches in US and Canada. Maction Consulting in association with IIRF, conducts the survey. Maction Consulting a ssociates with IIRF for data collection, analysis and reporting. Primary research data collection from the institutes, Secondary research / literature review from various education related websites, institute websites, academic publications, reports, statistical data publications etc. are conducted by Maction Consulting. The methodology is jointly developed by IIRF and Maction Consulting, and all statistical analyses and report on research findings are carried out by Maction Consulting.
Data Collection
The survey form is open and available through Maction Consulting. Institutions provide their respective institutional data for use in the rankings. Institutions, those do not provide data in any rare occasions, we enter a conservative estimate under the performance indicator of External Perception. Also, available secondary research data about the institute will be collected to validate their details and add additional relevant details in the report. By doing this, IIRF and Maction Consulting avoid penalizing an institution too harshly with a “zero” value for data that it overlooks or does not provide, but we do not reward it for withholding them.
Data Conclusion
It is planned to apply the standardization approach for each indicator and then combine indicators in the proportions indicated in the weightage table given above.
The standardization approach is based on the distribution of data within a particular indicator (attribute). A cumulative function is arrived and then analyzed where a particular institution’s indicator ranges within that function.
The Methodology
The broad seven parameters considered for ranking are these:
- Placement Performance indicates how good the institute students are getting employment.
- Teaching Learning Resources & Pedagogy explains about faculty, their qualifications, Guest lectures, accreditations etc.
- Research covers the details about research influence and reputation of institution.
- Industry Income and Integration covers the details about corporate leaders visit, revenue generation from knowledge transfers and tie-ups, internship for students etc.
- Placement Strategies & Support provides the details about support from institute to the students to get job, alumni support for placements etc.
- Future Orientation includes the details about Incubation centre availability for start-ups and entrepreneurs, Idea developed by professors and students etc.
- External Perception & International Outlook covers the details about clarity of vision and mission, investing in development activities, public views on the institute in various aspects, number of international students and staff and other collaborations.
- All the data are pertaining to the year 2019-20 (April 2019 to March 2020).
- All the data are for the full time courses /programmes only. (Distance education, part time courses, online courses are not accounted here).
Methodology Details: Broad Level Parameters
Though IIRF has assigned maximum marks for these seven parameters as 100 each, the institutes are also asked to assign their marks out of 100 for the seven parameters to understand their importance order among these seven attributes.
Finally a weighted Index will be arrived. Total value of Index 1000 is the maximum.
| Step 1 | Arrive score for 7 Parameters out of 100 |
| Step 2 | Multiply 1.4286 with every dimension score |
| The total becomes 1000 | |
| Index | Weighted index calculation for 1000 |
| IIRF Weight | As above |
| Institute Self weight | Collect data from institute on the weights (based on the importance they provide for each parameter) they assign for these 7 parameters, out of 100% (the total should tally 100%) |
Methodology Sub-Level Attributes
The following portion explains about the different sub-level attributes under these seven parameters and marks for each attribute.
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 1 | Placement Performance (2019- 2020 Batch) | 100 | ||
| 1 | Number of departments | 5 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | |
| 2 | Number of courses | 5 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | |
| 3 | Students: Approval vs. Actual Intake (2019-20) (all UG AND PG courses) (%) | 5 | (No. of students intake / No. of students approval) x 100. This % will be divided by 5. | |
| 4 | Number of Company Visited (having turnover of 500 cr and above) | 5 | Based on the data, 5 levels will be arrived. Very Low, Low, Medium, High, Very High. Marks will be 2,4,6,8, and 10. | |
| 5 | Number of Placements offered | 10 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | |
| 6 | Number of companies visited (less than 500 Cr turnover) | 5 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 2, 4, 6, 8, 10 | |
| 7 | Number of Students placed | 10 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | |
| 8 | Percentage of Placements (%) | 5 | (No. of placement received/No of students attended the campus placements) X 100. This % will be divided by 5 | |
| 9 | Average Median Salary | 50 | Percentile will be arrived: 20th, 40th, 60th, 80th and 100th Percentile from survey data. Marks will be 10,20,30,40, and 50 | Question can cover: Minimum salary, Median Salary, Maximum salary for each institution |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 2 | Teaching Learning Resources & Pedagogy | 100 | ||
| 1 | No. Ph.D. Faculty | 15 | (No. of Ph.D. faculty/No. of total faculty) x 100.Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 2, 4, 6, 8, 10 | |
| 2 | No. of Faculty without Ph.D. (but PG, PG with M.Phil., PG and currently doing Ph.D.) | 12 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | |
| 3 | Full time and Part time Faculty ratio | 5 | To arrive as 75%: 25 %, and then classify | Refer Mandatory Disclosure in their website |
| 4 | Faculty Student Ratio | 15 | Expected Ratio: 1: 20. Higher ratio will get lower marks and Lower ratio will get higher marks | 1:15 mentioned by Other firm |
| 5 | No. of Faculty Development Programs conducted | 5 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 1,2,3,4,5 | Refer Mandatory Disclosure in their website |
| 6 | Number of Students completed Ph.D. or Equivalent Programme | 15 | Based on the data, 5 levels will be arrived. Very low, Low, Medium, High, Very High. Marks will be 2, 4, 6, 8, 10 | |
| 7 | Faculty Performance Assessment/ Teaching Skills | 15 | Number of Articles Published in national Newspapers and standard magazines | Assessment on Faculty read well, write well |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 3 | Research (Volume, Income and Reputation) | 100 | Details of Ph.D. of top 10 faculties of institution | |
| Research Influence: 1. Input (From where has the faculty done Ph.D.) | 20 | 5 level rating will be created. | Please Be Aware That These Criteria Are Tough And Many Institutes That Are Academic 'Panwari' Shops Will Get Very Low Marks; However, It Will Enable Upgrading. The Standards Of The Institute And Also Consultancy Assignments. | |
| Research influence: 2. Throughput (Publications). All publications will be weighted as per the categories of impact factor (ABDC listed journals) and cite score for Scopus indexed journals) a) Publications emerging from the Ph.D. (A determinant of the quality of Ph.D.) b) No of annual research paper publications by faculty in FT50/ABDC/Scopus indexed journals and their impact factor. So, there will two criteria in this: quantity (nos of publication) and quality (published in which journal) | 20 | Journal standard is the impact. 5 level rating will be created. | Publication Reference link is important to get high score. | |
| Research Influence 3. Is the research publication used to develop corporate/consultancy assignment (This is the impact of the research). The consultancy assignment should be an outcome of research. Criteria can be the number of assignments/ organizations and the revenues generated. | 20 | Project revenue generation. Research implemented anywhere. successful? 5 level rating will be created. | ||
| Reputation Survey | 40 | Use secondary research data from other surveys/ research paper on institution image and reputation. 5 level rating will be created. (Low, medium, high etc.) |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 4 | Industry Income and Integration | 100 | ||
| Number of Corporate Leader visited in Campus for Lectures | 20 | 5 levels will be created, marks will be allotted | ||
| Knowledge transfer Income | 50 | No. of trainings outside, Webinar arrangement, Knowledge tie ups. 5 levels will be created, marks will be assigned. No income value is required. | ||
| Internship or Exchange Programme | 30 | No. of stipend paid and unpaid (for students) Interns by the companies recruited them. 5 levels will be created, marks will be assigned. |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 5 | Placement Strategies & Support | 100 | ||
| 1 | Institutional Support | 60 | Availability of following (Yes or No) Having Separate placement cell and activities (max. marks 15) Mock interviews (max marks 15) HR expert discussions (max marks 15) Resume development supports (max marks 15) | |
| 2 | Alumni Support for students providing placements in their companies/reference companies | 40 | Availability of following (Yes or No) |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 6 | Future Orientation | 100 | ||
| 1 | Incubation / Start Up Cell | 50 | Availability (Yes, No) Max 50 marks Incubator/Entrepreneurship cell or Tie up with any Start-Up consulting firm to provide advice. Based on number of years this cell is available and function, this will be arrived | New institutes may not have this |
| 2 | Idea Development by Professors | 20 | Availability (Yes, No) Max 20 marks | |
| Idea development by Students | 20 | Availability (Yes, No) Max 20 marks | ||
| 3 | Separate Research team for Incubation research | 10 | Availability (Yes, No) Max 10 marks Full time separate research team for Incubation research |
| Sr. No. | Marks | Scoring weights | Notes | |
|---|---|---|---|---|
| Parameter: 7 | External Perception & Future Outlook | 100 | ||
| External Perception | 70 | |||
| 1 | Vision, Strategy and Governance Mechanism- Availability of clear cut Vision, Strategy and how to achieve it procedures (Strategy is communicated to students? Faculty?) | 20 | 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10) Primary research data will be validated with available secondary research data. Based on the data, 5 levels will be arrived. Very Low, Low, Medium, High, Very High. Marks will be 8,16,24,32,40. | |
| 2 | Investing the income generation on further Development Activities | 10 | 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10). Mainly from primary research data. | |
| 3 | Public views: Current brand image | 10 | Use of secondary research data. assumptions. Survey perceptions on current brand image 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10) | |
| 4 | Public views: Degree validity in job markets | 10 | Primary research data will be validated with secondary research data. 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10 | |
| 5 | Public views: Skill development for students | 10 | Activities by the institute. Primary research data mainly. 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10) | |
| 6 | Public views: New courses or New branches started | 5 | Primary research data, also validated with secondary research data. 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10) | |
| 7 | Public views: Pride of Students | 5 | Primary research data, validation with secondary research data. 1= Low, 2=Medium, 3=High, 4= Very high (Maximum value gets 10) | |
| INTERNATIONAL OUTLOOK | 30 | |||
| 1 | International Staff (% of total staff) | 10 | A value will be arrived from maximum number. Proportionate % value will be assigned. | |
| 2 | International Students (% of total students) | 10 | A value will be arrived from maximum number. Proportionate % value will be assigned. | |
| 3 | Number of International collaborations | 10 | A value will be arrived from maximum number. Proportionate % value will be assigned. |