thumbnailA-04.jpg

Ontario Subscriptions Platform

Ontario Subscriptions Platform

Modernizing Ontario Newsroom — a solution for all Ontario Subscriptions


Role (Project UX lead)

Design and business strategy
UX and market research
Service design
Product design
UX/UI design
Content design
Usability testing
Frontend development
Accessibility testing
Ongoing refinement based on user feedback

Tools Used

Figma
HTML, CSS, SASS, JavaScript, Bootstrap, Angular 5
WAVES Web Accessibility
HTML Code Sniffer
BrowserStack
GitLab

My Team

Backend Developers
DevOps
Data Scientists
Product Owner

Duration

8 months


Background

  • Setting: The Ontario Cabinet Office, Tech and Delivery Team

  • Target audience

    • Phase 1: Ontarians looking to personalize Ontario News subscriptions

    • Phase 2: Ontarians looking to personalize any type of Ontario government communications

Challenge

Ontario Newsroom is a legacy distribution tool created in 2009 as a way to distribute and archive Government of Ontario news items. Although it served its purpose in early 2000s, the data collected was no longer relevant and not aggregated properly to create personalized subscriptions to meet modern business requirements. Thus, the Newsroom Modernization initiative was dedicated to revamping the user sign-up experience in a way that addressed these challenges.

Legacy signup form to subscribe to Ontario News

Legacy signup form to subscribe to Ontario News

Phase 1: For subscribers of Ontario News

The flow to sign up for subscription was cumbersome. Infrastructure behind email notification needed to be enhanced to match our accessibility guidelines. From a visual and aesthetics perspective, the look and feel of the platform needed to be revamped to maintain consistency with the Ontario Design System.

As we problem-solved for our primary target audience in phase 1, we also looked into how we might repurpose the same solution for other government digital services in Phase 2.

Phase 2: For subscribers of any type of Ontario government communications

With a revamped process to subscribe to government communications, other digital services would benefit by adapting a similar flow. Data collected through this signup form such as subscription preferences would allow us to better anticipate Ontarians’ needs and deliver them information proactively (ex. government services available for business owners).

challenge statement2.png

Solution

A Subscription Platform that

  • Provides a consistent experience with Ontario government branding

  • Walks users through 6 simple steps to signup for subscription

  • Allows high level customization using single-select dropdowns

  • Improves users’ trust in the system with increased data transparency

  • Includes a backend administration panel that (1) visualizes aggregated subscriber data, and (2) allows the Tech & Delivery team to easily modify the signup form

 

Design Process

Web 1920 – 2.png

My Role

As the project UX lead, I directed all aspects of user experience design through all stages of product development. I also designed the backend administration panel and data collection system to aid the team in monitoring the Subscription Platform.

Competitive research
I researched email communications delivered by other jurisdictions, and how their subscriber management tools effectively segmented their subscribers based on demographics and sent them highly customized emails. 

Success stories such as gov.uk and usa.gov indicated that emails should be optimized for mobile and tablet interfaces accordingly. Using first party data (data collected directly from the target audience), they were able to identify their subscribers as homeowners, retirees and parents of school-aged children, and sent them personalized emails.

UX research on frontend signup
I assessed the current signup process to subscribe to Ontario News and created a user journey map with pain points.

screencapture-subscription-news-ontario-ca-subscriptions-en-signup-2021-03-28-00_09_51.jpg

Being a legacy system, there were four major pain points:

  1. Too many steps: could be overwhelming to users, making it difficult to keep track of their information

  2. Lack of high level customization: users were limited to one type of subscription (either news types, ministries or topics)

  3. Outdated and inconsistent layout with the rest of Ontario government branding

  4. Users unclear about what they subscribed to: lacking an overview at the end of the subscription process

To solve the pain points above, I brainstormed four directions to pursue:

  1. Simplified the signup form into 6 distinguishable steps. That way, users would have a good grasp of the entire signup process.

  2. Allow users to subscribe to news across multiple parameters, ex. subscribe to news releases posted by the Ministry of Health regarding Health and Wellness.

  3. The look and feel would be updated to provide users a web experience cohesive with Ontario government branding.

  4. Include a summary page of all information entered into the system towards the end of the signup process for users to review before submitting.

To collect first-party data relevant to high level customization, I also grouped all demographic questions into one of the steps in signup, temporarily known as ‘subscriber profile’.

User journey with assumptions

User journey with assumptions

 

Planning for user research participant recruitment
After preliminary research, I built three personas:

Hoping to consult users from the public with different experiences, backgrounds and perspectives, I drafted a User Research Plan and Participant Recruitment Package outlining the importance, benefits, and logistics of user research and testing.

Documents in Participant Recruitment Package

  • Recruitment brief

  • Consent form

  • Compensation form

  • Media release form

Link to user interview questions.

 

UX/UI design of backend admin panel
Through discussions with the team, I established two key components for the admin panel: analytics and system management.

Data analytics would give the team a comprehensive overview of all demographics, growth of subscribers, email analytics, and a summary of top insights.

System management allowed developers to easily modify 4 subsections in the signup form: applications, categories, tags, and demographics. Take Newsroom for example, if the team would like to add or remove a parameter for users to subscribe (other than ministries, news types, and topics), they would do so by going to the ‘Categories’ section. They can also edit existing categories.

 

User testing on signup form with OPS staff
I conceptualized two functionalities that required rapid testing. First, users should have the ability to subscribe to news across multiple parameters (ministries, news types and topics). Second, users should also be able to stack multiple sets of highly customized subscriptions. Two sets of low-fidelity mockups were prepared for users to test.

Since this project was done 100% virtually, paper prototypes were quickly digitized into interactive low-fi mockups.

In a bid to not reinvent the wheel, Prototype 1, based on multiple checkboxes, was designed to be similar to the legacy flow of customizing subscriptions. Inspired by gov.uk, Prototype 2, based on multi-select dropdowns, was brand new to the system.

Participants were instructed to perform a number of scenarios on both sets of prototypes ex. Subscribe to News Releases by the Ministry of Anti-Racism Directorate about Law and Safety. After testing each mockup, they were asked the following questions to test my assumptions:

  1. Looking at the final set of subscriptions, does this match your expectations of what you are subscribing to? Is it intuitive? Any confusion?

  2. Looking at this interface, how clear is it to you that you are able to ‘stack’ multiple subscriptions?

Desktop - 126.png

Prototype 1: Customize subscriptions with multiple checkboxes

The process of ‘customizing subscription’ caused confusion especially when users attempted to subscribe to multiple ministries, topics and news using checkboxes. With multiple checkboxes selected (as seen in the mockup below), the majority of the users perceived it to be one big subscription of all feature stories and news releases posted by the Ministry of Anti-Racism Directorate and Finance regarding Arts and Culture and Law and Safety. Though three users appreciated the overview of all checkboxes and options available, it was overall unclear that they were able to stack multiple subscriptions.

Phase 2: Customize subscriptions with multi-select dropdowns

With the multi-select dropdowns, users would be able to select multiple options under each parameter ex. News releases under the Ministry of Health regarding Health and Wellness + Government. Looking at the overview of all subscriptions, users found it clearer than the first prototype that they were able to stack multiple subscriptions. This prototype was well-received by all users who participated in user testing.

Recommendations
Users still need to assume a lot with both prototypes, more instructions such as success/error messages and a summary page of information entered into the system would be ideal.

Manage Subscriptions and Unsubscribe
A similar flow was developed for users to manage their subscriptions and update preferences. Low-fi prototypes were produced and developed in collaboration with developers.

 

Joint efforts with developers

Improved user journey after testing

Improved user journey after testing

Based on the improved user journey, developers focused on the functionality while I took the lead in styling and making the platform responsive and AODA compliant.

UI changes made for accessibility

  • From customized subscription modal to ‘click to expand’
    When testing with a screen reader, the screen reader would read all dropdown menu options of ‘Customized Subscriptions’ in a continuous loop, in other words, it would not stop reading until users exited the modal. To resolve this issue, the dropdowns were moved from being stored in a modal to a click-to-expand component.

  • From multi-select to single-select
    The vue.js component used for multi-select was not AODA compliant; the screen reader would only read ‘blank’ for each option under the dropdown menus. To compensate for this loss, I discussed with the team and decided to change the component into a single-select dropdowns. This change resulted in users only being able to select one option under each parameter, but it was the most feasible decision at this point of product development.

Testing in staging environment with selected branch staff
On March 29-30, 2021, our team selected several volunteers within the branch of Cabinet Office - Marketing and Digital Strategy to test our signup form and email notification system. The majority of volunteers responded positively regarding the signup and considered it a big improvement from the legacy system.

 

Limitations and Takeaways

Unable to test with members of the public

Senior Management wanted to err on the side of caution in testing with the public. As a result, I was only able to test with OPS staff.

User testing with a small sample size

Given the tight deadlines during Christmas and the New Year, I was only able to test with a group of six. Testing with a user with accessibility needs would have been a valuable experience for the signup form—a public facing component that should be accessible to all.

 

What I might have done more of or differently…

  • I should have started on the content design earlier at the stage of exploring UX/UI for the signup form.

  • For the users’ convenience, I would propose making the step indicator clickable to provide users another way to go back and forth between steps.

  • I would continue testing on the user flow of customizing subscriptions. More UX/UI would be required for users to better distinct the path to subscribe to all news vs. customizing subscriptions.