Evolution of a Scoring Method

Updated on 27 Apr 2022
2 Minutes to read

Article summary

Did you find this summary helpful?

Thank you for your feedback

Introduction

This white paper is about the evolution of the scoring methodology of the Access to Seed Index. The index measures and compares the efforts of the world’s leading seed companies to enhance the productivity of smallholder farmers. Matching the expectations of stakeholders in and around the seed industry with company performance helps to clarify the role of the industry. It also brings transparency to the contributions of individual companies. Index findings contribute to an informed dialogue on how companies can step up their efforts. The index was published in 2016, 2019 and 2021. The analysis was made on measurement area, categories of indicators, weightage, change in indicators and scoring.

Legends

Colour	Meaning	Display
Green	An increase/added from the previous year	🟢
Yellow	Same as the previous year	🟡
Red	A decrease/removed from the previous year	🔴
Blue	New	🔵

Measurement area + Weightage + Change in indicators

2021

Measurement Areas	Number of indicators		Weightage
Governance and strategy	3	🔴	10%	🟡
Genetic resources and intellectual property management 🔵	6	🔵	15%	🔵
Research and development	6	🔴	20%	🟢
Seed production	4	🔴	15%	🟢
Marketing and sales	8	🔴	25%	🟢
Capacity building	5	🔴	15%	🔴

2019

Measurement Areas	Number of indicators		Weightage
Governance and strategy	9	🟢	10%	🟡
Genetic resources	7	🔵	10%	🔵
Intellectual property	7	🔵	10%	🔵
Research and development	10	🟢	20%	🟡
Seed production	7	🟢	10%	🟡
Marketing and Sales	11	🟢	20%	🟡
Capacity building	8	🟢	20%	🟡

2016

Measurement Areas	Number of indicators		Weightage
Governance and strategy	3	🔵	10%	🔵
Public Policy & Stakeholder Engagement	3	🔵	10%	🔵
Genetic resources & Intellectual property	3	🔵	20%	🔵
Research and development	3	🔵	20%	🔵
Marketing and sales	5	🔵	20%	🔵
Capacity building	3	🔵	10%	🔵
Local Seed Sector Advancement	5	🔵	10%	🔵

Categories of indicators

There are 4 categories of indicators in each measurement area. Below mentioned is an image from 2019.

Commitment indicators evaluate whether companies have policies, targets and codes of conduct in place that guide their activities.
Performance indicators evaluate actual practices, programs and activities the company has implemented.
Transparency indicators evaluate whether companies publicly report on their policies and practices.
Leadership indicators reward activities or approaches that stand out or can be an example for other companies.

2021

Removed it from the scoring methodology.

2019

Categories of indicators	Weightage
Commitment	20%	🔴
Performance	60%	🟢
Transparency	10%	🔴
Leadership	10%	🔵

2016

Categories of indicators	Weightage
Commitment	25%	🔵
Performance	50%	🔵
Transparency	15%	🔵
Innovation	10%	🔵

Scoring

2021

2019

2016

Scoring takes place at the indicator level. The index will typically use a three-point scale with one point increments of 0, 1 and 2; or a five-point scale of 0, 0.5, 1, 1.5 and 2. In each case, 2 is the highest score, 1 is the midpoint and 0 is the lowest. The increments are linear and equal.

Each indicator is scored against a set of predefined criteria related to the elements outlined in the indicators section below. The elements for each indicator reflect what is expected of the company and what it will be assessed and scored on.

The company was scored using a five-point scale. Both at measurement area and indicator categories. How the company rankings work per measurement area?

A company’s overall score is the weighted sum of its scores on all indicators.

Indicators

Measurement Area	Indicators (Only from 2021)	2021	2019	2016
	TOTAL	32	59	25
Governance and strategy
	Access to seeds for smallholder farmers	🟡	🟡	🔵
	Governance and accountability	🟡	🟡	🔵
	Stakeholder engagement	🔵	-	-
Genetic resources and intellectual property management
	Conservation of genetic resources	🟡	🟡	🔵
	Access to company genetic resources	🟡	🟡	🔵
	Benefit-sharing	🟡	🔵	-
	Breeders’ exemption	🟡	🔵	-
	Farmers’ privilege	🟡	🔵	-
	Licensing	🟡	🔵	-
Research and development
	Plant breeding activities in index regions	🟢	🔵	-
	Local participation in breeding/variety development	🟢	🟢	🔵
	Variety testing	🟢	🟢	🔵
	Developing improved varieties of global crops	🟡	🔵	-
	Developing improved varieties of local crops	🟡	🔵	-
	Breeding programme for specific traits	🔵	-	-
Seed production
	Seed production activities in index region	🟡	🔵	-
	Engaging smallholder farmers in seed production	🟡	🔵	-
	Quality management in seed production in index countries	🟡	🔵	-
	Social and labour rights in seed production	🔵	-	-
Marketing and sales
	Quality and safety of varieties	🟡	🟡	🔵
	Distribution channels	🟡	🔵	-
	Diverse portfolio	🟡	🔵	-
	Packaging and labelling	🟡	🟢	🔵
	Affordability	🟡	🟢	🔵
	Quality assurance and after-sales	🟡	🟢	🔵
	Demonstration and promotion strategies	🟡	🔵	-
	Other agricultural inputs	🟡	🔵	-
Capacity building
	Extension services	🟡	🔵	-
	Programmes for women farmers	🟡	🔵	-
	Next-generation farmers	🟡	🔵	-
	Information and communications technology (ICT)	🟡	🔵	-
	Access to output markets	🟡	🟡	🔵