Evaluation Process

Evaluation Process for Best Usability 

Stage 1: Pre-screening

After nominations close, the nominated Informational Websites will be pre-screened based on GovTech’s Digital Services Standards to ensure nominees fulfil baseline standards of intuitivity, usability, accessibility, and inclusivity. The Top 10 nominees that fulfil all or the most standards will proceed to the next round and be included in the Most Popular Informational Website award.

Stage 2: Top 10 Evaluation by Judges

The panel of judges will evaluate the Top 10 nominees based on Nielsen Norman’s Group 10 Usability Heuristics for User Interface Design, Web Content Accessibility Guidelines (WCAG) 2.2, and their own expert domain knowledge. The Top 3 nominees that achieve the best scores will move on to the next round.

Stage 3: Top 3 Evaluation by Citizens

A minimum of 100 Citizen Evaluators including Persons with Disabilities (PwDs) will assess the Top 3 nominees based on the System Usability Scale (SUS). The nominee that receives the highest combined score from the Judges and Citizen Evaluation will be announced as the winner of Best Usability during the award ceremony.

Evaluation Process for Most Popular Informational Website

Stage 1: Pre-screening

After nominations close, the Top 10 nominations for the Best Usability Award will automatically be included in the Most Popular Informational Website award category. The nominated Informational Websites will be pre-screened based on GovTech’s Digital Services Standards: Principles 1 and 2, to ensure nominees fulfil baseline standards of intuitivity, usability, accessibility, and inclusivity. The Top 10 nominees that fulfil all or the most standards will proceed to the next round.

Stage 2: Top 10 Evaluation by Live Voting during Award Ceremony

Only registered event attendees will be able to vote for the Most Popular Informational Website during the award ceremony, and the results will be revealed live during the event.

Evaluation Process for Best Accessibility (Government)

Stage 1: Pre-screening

After nominations close, the nominated Informational Websites will be pre-screened based on WOGAA Inspect Accessibility and Oobee scan results.

Stage 2: Top 10 Evaluation by Judges

The panel of judges will evaluate the Top 10 nominees based on manual accessibility checks in accordance with WCAG 2.2 guidelines.

Evaluation Process for Best User Engagement (Government)

Stage 1: Pre-screening

After nominations close, the nominated Informational Websites will be pre-screened based on user engagement practices across key stages of the development journey. This covers the evaluation of feedback collection and loops in both the design and build phase, and the post-launch phase. Submissions should be supported by relevant evidence, such as data from VICA, WOGAA Sentiments, CrowdTaskSG, or CRM systems.

Stage 2: Top 10 Evaluation by Judges

A panel of judges will evaluate the Top 10 nominees based on the quality and effectiveness of their user engagement efforts, including responsiveness to user queries or feedback, the quality of responses provided, innovation in engagement approaches, improvements made based on feedback, and overall user satisfaction.

Evaluation Process for Outstanding Citizen Contributor

Whole-of-Government

Stage 1: Pre-screening

After nominations close, an internal pre-screening will be conducted to sieve out nominations that do not meet the criteria.

Stage 2: Top 3 Evaluation by Judges

The panel of judges will evaluate the nominees to select the Top 3 nominations based on a matrix consisting of several criteria like impact, scale, participation, and contribution.

Citizens in Tech (Smart Nation Ambassadors & Tech Kaki)

The Top 3 Citizens in Tech (Smart Nation Ambassadors & Tech Kaki) community members with the highest participation rate in their engagements for the year will be selected as the winners.

CrowdTaskSG

The Top 3 most active CrowdTaskSG users during the year will be selected as the winners.

Evaluation Process for Remaining Award Categories

Winners for the following categories will be selected based on technical scores:

The categories “Best Discoverability”, “Best Functionality”, “Best Improvement” and “Best Customer Satisfaction for Transactional Services” are evaluated using the Whole-of-Government Application Analytics (WOGAA) platform.