Blog

Research Rundown: September 2023 to January 2024

Welcome to the first research rundown from the User Research Center at Harvard Library. In this quarterly newsletter, the URC will be sharing recent research that our team has conducted at Harvard Library.

If you have any questions about the research or would like to consult with our team about helping you plan or conduct research at Harvard Library please reach out to libraryux@harvard.edu.

Survey on Student Use of AI for Academic Work

This survey was conducted in Fall 2023 with 376 undergraduate (50%) and...

Read more about Research Rundown: September 2023 to January 2024

Comparative Insights: AI and Human Analysis in Educational Research

BY Katie Kim, URC Intern Fall 2023

At the URC we are interested in student and faculty perspectives on generative AI. To explore how it is affecting our faculty we conducted a study in Fall 2023. During this process, I engaged in an intriguing experiment: after analyzing the AI Focus Group meeting notes myself, I tasked generative AI with the same analysis to compare the outcomes. This experiment was designed to examine how the AI's interpretation and insights might differ from a human perspective. Let's examine various aspects of these differences....

Read more about Comparative Insights: AI and Human Analysis in Educational Research

A Strategic Approach to the UX Internship

By Amy Deschenes

Each summer, our team hosts three interns from the University of Michigan’s School of Information (UMSI). These interns may be part of the library science or the user experience tracks of the program. The interns work as an online cohort for 35 hours a week for 10 weeks over the summer. Because of the participants’ varied backgrounds and distinct goals, we approach the internship with a “choose your own adventure” mindset. With a little bit of preparation before the interns start, we can determine the best projects for them to work on and...

Read more about A Strategic Approach to the UX Internship

Get Informed About Forms

By Meg McMahon

Recently, I have conducted two studies about online web forms. One study was for an internal form related to managing e-resource acquisition and maintenance. The other study was to create a better form experience for special borrowers on our website’s Visitor Access page. After both of these studies were conducted I attended a presentation by the NC State User Experience Research team. The talk was called "Better...

Read more about Get Informed About Forms

Recruiting and Incentives

By Sara Price

Even when the weather forecast is completely clear of rain, the URC team can sometimes be seen on campus carrying around boxes containing hundreds of umbrellas. This is because we set up tables at widely attended student events in order to invite signups for our participant pool. Small incentives such as umbrellas decorated with Harvard logos, handed out in exchange for completed signup forms, help us to recruit future user research study participants.  

Building A Participation Pool

Even the best survey,...

Read more about Recruiting and Incentives

Exploring Dovetail's AI-Generated Summary Feature: A Review

By Amy Deschenes

Our team recently transitioned to Dovetail for interview analysis and reporting. We've found its basic features to be highly beneficial, particularly for managing exploratory research projects. Dovetail allows us to handle interview recordings, tag transcripts, create video clips, and extract themes from user interviews with ease.

Since I've been using ChatGPT in other areas of my work, I decided to test Dovetail's AI summary tool. According to Dovetail's interface, the Automation > Summary option employs AI to...

Read more about Exploring Dovetail's AI-Generated Summary Feature: A Review

Review of Generative AI Chatbots' Accessibility

By Meg McMahon

It’s no secret that generative AI chatbots are gaining popularity. With that popularity comes questions about the accessibility of these tools. I conducted screen reader reviews on the top three chatbot AI tools on August 25, 2023. Screen readers are an assistive technology primarily used by folks who have vision impairments. They convert the text on a webpage to speech. 

I have ordered the chatbots from most accessible to least accessible by a screen reader below and have added notes on what makes each chatbot...

Read more about Review of Generative AI Chatbots' Accessibility

Are we on the right track? Researching the user experience of our peers’ finding aid instances

By Meg McMahon

The Approach

In February 2023, Amy Deschenes, the Head of UX and Digital Accessibility, and I attended the online conference UX360. For me, the stand out idea of the day came from Zachary Schendel, the Head of Research at DoorDash. He spoke of conducting UX research in the style of a landscape review. A landscape review is a qualitative study of a small sample of peers' products. When he worked at Netflix, for example, he would conduct research on Amazon Video audiences about...

Read more about Are we on the right track? Researching the user experience of our peers’ finding aid instances

User Research Analysis Guide

By Meg McMahon

Analyzing the notes from a user research study is an essential part of answering the research questions that prompted the study. 

During the analysis, you or your team decide what insights are generated from the notes taken about the research studies. The insights should relate to the research questions posed at the beginning of the study or point to future research.

Before Analysis 

Become familiar with the study

Read over the research...

Read more about User Research Analysis Guide

Pages