AI Chatbot Enhancements

AI Chatbot Enhancements

AI Chatbot Enhancements

AI Chatbot Enhancements

AI Chatbot Enhancements

AI Chatbot Enhancements

AI Chatbot Enhancements

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Senior Product Designer, Upwork

Role

Product design, Product strategy, Roadmap prioritization

Team

Product Manager, UX Copywriter, Engineers (x7)

Product Manager, UX Copywriter, Design Systems Team, Engineers (x7)

Timeline

April-June 2023

Role

Product design, Product strategy, Roadmap prioritization

Team

Product Manager, UX Copywriter, Engineers (x7)

Timeline

April-June 2023

Background

Upwork is the largest online talent solution connecting businesses and skilled freelance professionals. Our user-centered approach has allowed for a more intuitive and personalized work marketplace experience across the Globe.

Opportunity

Getting started on Upwork can be daunting and difficult for new visitors on the Upwork homepage. With the rise of AI heading into 2023, Upwork introduced its first chatbot to logged-out visitors, hoping to alleviate this problem. Upon first response, engagement with Upwork chat was lower than expected at 2.2%, hypothesizing due in part to friction in context (CL/FL) selection.

Background

Upwork is the largest online talent solution connecting businesses and skilled freelance professionals. Our user-centered approach has allowed for a more intuitive and personalized work marketplace experience across the Globe.

Opportunity

Getting started on Upwork can be daunting and difficult for new visitors on the Upwork homepage. With the rise of AI heading into 2023, Upwork introduced its first chatbot to logged-out visitors, hoping to alleviate this problem. Upon first response, engagement with Upwork chat was lower than expected at 2.2%, hypothesizing due in part to friction in context (CL/FL) selection.

Background

Upwork is the largest online talent solution connecting businesses and skilled freelance professionals. Our user-centered approach has allowed for a more intuitive and personalized work marketplace experience across the Globe.

Opportunity

Getting started on Upwork can be daunting and difficult for new visitors on the Upwork homepage. With the rise of AI heading into 2023, Upwork introduced its first chatbot to logged-out visitors, hoping to alleviate this problem. Upon first response, engagement with Upwork chat was lower than expected at 2.2%, hypothesizing due in part to friction in context (CL/FL) selection.

Challenge

How could we allow for an increase in OpenAI chatbot engagement?

Business Goal

Increase registrations on Upwork

platform via a more conversational

OpenAI chatbot

User Goal

Provide logged-out visitors with an easier, more conversational way of learning about Upwork via an OpenAI chatbot

LoFi Design Explorations

This project required rapid design explorations as we sought to release an updated AI chatbot for immediate release as part of V2 of our Beta test.

Option 1: "Frame"

Pros

Fits the brief in that it’s embedded

directly on the page
Doesn’t insert new screens or steps into

the user’s journey (easy to ignore)

Option 1: "Frame"

Pros

Fits the brief in that it’s embedded

directly on the page
Doesn’t insert new screens or steps into

the user’s journey (easy to ignore)

Cons

Competes for the user’s focus
Two scrollbars: One for the chatbot, one for the page
Potential to miss the chatbot despite its size
Looks like an iFrame so doesn’t feel modern

Option 1: "Frame"

Pros

Fits the brief in that it’s embedded

directly on the page
Doesn’t insert new screens or steps into

the user’s journey (easy to ignore)

Cons

Competes for the user’s focus
Two scrollbars: One for the chatbot, one for the page
Potential to miss the chatbot despite its size
Looks like an iFrame so doesn’t feel modern

Option 2: “Push the page down”
Bold takeover above the fold

Pros

Easier for users to notice, appears on load
Chat takes the full focus of the user
Full page takeover is a common pattern to other chatbots
No changes to rest of content on the homepage

Cons

Potential complexity above the fold as we may need to include CL vs. FL buttons to start the conversation
Too much of a statement, or potentially the issue of banner blindness

Option 3: “Replace the Hero illustration”
Animated sequence with chat prompt

Pros

Adds motion and visual interest to Hero
Chat takes the full focus of the user
Full page takeover is a common pattern to other chatbots
No changes to rest of content on the homepage

Cons

Users who scroll quickly may skip

sequence entirely
May compete with the Get Started

primary action
Chat prompt in hero may feel unexpected

Mid-Fi Exploration

Following several reviews, we decided to move forward with the embedded approach to allow for a more seamless experience.

The mobile experience became increasingly important to ensure the same quality experience for our users, as well as thinking about how we could approach micro-interactions within the full-screen experience.

Option 3: “Replace the Hero illustration”
Animated sequence with chat prompt

Pros

Adds motion and visual interest to Hero
Chat takes the full focus of the user
Full page takeover is a common pattern to other chatbots
No changes to rest of content on the homepage

Cons

Users who scroll quickly may skip

sequence entirely
May compete with the Get Started

primary action
Chat prompt in hero may feel unexpected

Option 3: “Replace the Hero illustration”
Animated sequence with chat prompt

Pros

Adds motion and visual interest to Hero
Chat takes the full focus of the user
Full page takeover is a common pattern to other chatbots
No changes to rest of content on the homepage

Cons

Users who scroll quickly may skip

sequence entirely
May compete with the Get Started

primary action
Chat prompt in hero may feel unexpected

Mid-Fi Exploration

Following several reviews, we decided to move forward with the embedded approach to allow for a more seamless experience.

The mobile experience became increasingly important to ensure the same quality experience for our users, as well as thinking about how we could approach micro-interactions within the full-screen experience.

Additional Areas of Focus

From additional research and iteration, the team focused in on the user journey, noticing that our customers lack the ability to start the conversation over if they desire to context-switch. Additionally, we had very little insight into how helpful the chatbot was in answering customer questions. In order to observe if the chatbot is providing value we would need to implement a method of feedback to train and improve the overall experience.

Current Updates for AI Chatbot

Customers seeking to get started on Upwork oftentimes have difficulty doing so. As we learned from the initial release of this OpenAI chatbot, engagement was low- at 2.2%. Currently, customers lack the ability to start the conversation over if they desire to context-switch. Additionally, customers need a way to indicate if the chatbot is providing value or not, which in turn Upwork can use to train and improve the overall experience.

Default- Modified Subhead

Previous UX feedback indicated that subheader
makes the embedded modal feel cluttered.

The subhead content previously was redundant
and therefore it was updated to streamline
the design

Previous UX feedback indicated that subheader makes the embedded modal feel cluttered.

The subhead content previously was redundant and therefore it was updated to streamline the design.

Self-Identification Buttons

With overall lower than expected engagement, we hypothesize that the initial entry with it's 2-click self-identification is a contributing factor.

The prior design also strangely employs a drop-down in the place of an input field, which in turn behaves atypically by surfacing options above (instead of below).

With this new update, we are removing a step for the users as well as removing distractions by temporarily hiding the input field.

Logged-out Prompted Message

Rather than logged out users only seeing a floating avatar, we hope to engage users who have been
on the page for 10 seconds by surfacing a
welcome prompt to encourage
a helpful conversation.

These prompts will display for all logged-out
pages other than the homepage.

Performance + Impact

Following the release of this V2 Chatbot beta test, we saw a drastic increase in engagement with a


+15%


increase in chatbot engagement over the course of the first 3 months. Moving forward, the beta remains running, with tweaks as needed, including feeding the system information of our Enterprise platform as well. We hope to see an overall engagement of 20-30% by the completion of our next test, making this chatbot extremely successful.

Performance + Impact

Following the release of this V2 Chatbot beta test, we saw a drastic increase in engagement with a


+12.5%


increase in chatbot engagement over the course of the first 3 months. Moving forward, the beta remains running, with tweaks as needed, including feeding the system information of our Enterprise platform as well. We hope to see an overall engagement of 20-30% by the completion of our next test, making this chatbot extremely successful.

Conversation Reset Button

In the original design, there was no mechanism to allow users to restart their chat in order to context switch.

This reset button will allow users to start a clean slate in their chat at any point after the initial self-identification has been made.

Thumbs Up/Down

Users had no ability to communicate the value or effectiveness of the Up Chat's responses.

With the simple use of an "up"/"down" mechanism,
we hope to give users a bigger say in shaping their
AI chat experience, as well as letting users help
train our AI to become smarter and more efficient
in getting users to the outcomes they desire.

Users had no ability to communicate the value or effectiveness of the Up Chat's responses.
With the simple use of an "up"/"down" mechanism, we hope to give users a bigger say in shaping their AI chat experience, as well as letting users help train our AI to become smarter and more efficient in getting users to the outcomes they desire.

Users had no ability to communicate the value or
effectiveness of the Up Chat's responses.

With the simple use of an "up"/"down" mechanism,
we hope to give users a bigger say in shaping their
AI chat experience, as well as letting users help
train our AI to become smarter and more efficient
in getting users to the outcomes they desire.

Performance + Impact

Following the release of this V2 Chatbot beta test, we saw a drastic increase in engagement with a


+15%


increase in chatbot engagement over the course of the first 3 months, and a 6% increase in new marketplace registrations. Moving forward, the beta remains running, with tweaks as needed, including feeding the system information of our Enterprise platform as well. We hope to see an overall engagement of 20-30% by the completion of our next test, making this chatbot extremely successful.

Have a Project In Mind?

Let's Create Together!

Reach out through the form, and I'll respond within the next 24 hours.