College class’ online video rates iPhone 4 and a Samsung Focus running Windows Phone 7 as superior to the Android-based HTC Thunderbolt and a RIM BlackBerry Storm
A “minor” college class project intended to demonstrate how first-time users fared in doing basic tasks on different smartphones has triggered an Internet wave of mockery, condemnation and invective. In a 10-minute video, the iPhone 4 and the Samsung Focus running Windows Phone 7 are rated superior to the Android-based HTC Thunderbolt and a RIM BlackBerry Storm.
Best Microsoft MCTS Training, Microsoft MCITP Training at certkingdom.com
The video was originally posted on YouTube this week by the students who made it, as part of a project for a Harvard University summer course, “Human Factors in Information Systems Design.” It was later made private, but then reposted on YouTube from cache by Surur at WMPoweruser.com. His accompanying post had almost no details on the video’s background.
SMARTPHONE COMPARISON: 4 reasons Windows Phone 7 will beat iPhone and Android
The class is taught by Dennis Galletta, who is a professor of business administration at University of Pittsburgh. His main research areas are, according to his biography page, “human-computer interaction, with specific attention to user attitudes, behavior, and performance,” and his teaching interests include human-computer interaction and electronic commerce. He’s been an adjunct professor for the Harvard summer program for several years.
The six-week summer course focused on human factors and corporate website design. Galletta gave the students a menu of related class projects, including a usability comparison of the four smartphone platforms. That’s the one they chose.
The result, and intent, of the project was a “fun initiation into usability testing but NOT a definitive or reliable test of the platforms,” Galletta says. His project requirements were to “compare the usability of the four platforms in an objective way, with points taken off for being subjective” and “squish it into 10 minutes or less [on video].”
The project was simplicity itself: All the students owned smartphones and they lent them to each other to test the three tasks. Each tester had no previous experience with that phone or its UI. The intent was to see whether and how users could figure out each task, without any familiarity with the phone or operating system and without any instruction or guidance.
Each user was videotaped performing each task in sequence and the resulting video was edited to keep it the 10-minute limit imposed by Galletta. The on-screen narrator is one of the students involved in the project.
In the video, the ratings for each task on each phone seem loosely correlated with the number of touches and taps and the length of time each task takes. But the actual criteria are not spelled out. The demonstration is organized by task, so we first see each user trying to make a phone call, then in the same order trying to add a contact, and finally sending a SMS message. Each separate test by the different users shows a close-up of the phone on a flat surface, and the hand or hands of the user.
Taken at face value, the video is most intriguing when one tries to follow the thought process of the novice user, as revealed by his or her touches and taps to the phone’s screen. For example, the first test shown is making a phone call with a Samsung Focus, running Windows Phone 7. The user taps correctly on an icon, or “tile,” with the image of a phone’s handset. But what next appears is the “History” page of recent calls. The user apparently doesn’t readily see how to make call from that page, and presses the home button to go back to the homescreen. After trying out a number of other actions, the user taps the phone tile again, finds another soft button at the bottom of the history page and is finally able to type in a phone number and make the call.
