Wednesday, August 26, 2009

More On Productivity (Serious) Games

Serious Games for people doing regular work




Via: Productivity Games – Ross Smith

Following my prior posting Productivity (Serious) Games, Ross Smith, an 18-year veteran of Microsoft and now director of the Windows Security Test Team Director, reports that they've had some great success using games at work, with a focus on using gaming technology and game elements to help make work more fun while increasing productivity.

Hard evidence can be found on their book The Practical Guide to Defect Prevention and the companion site http://www.defectprevention.org/, that cover what they learned about using games in Windows.

Chapter 5 addresses a theme that is very close to my heart: “using the carrot, not the stick” and the corollary topics: “Use Scoring to Encourage Participation, Keep the Players Coming Back to Check Their Score, You’d Be Surprised at What People Will Compete For”, and much more. In addition, they share some Examples of Using Games for Defect Prevention.

The Language Quality Game

As briefly referred to on my previous posting, The Language Quality Game was developed to encourage native speaking populations to do a final qualitative review of the Windows user interface and to help identify any remaining language issues.

The article Microsoft Uses Video Game To Help Windows Speak Like A Local, published earlier this year, explores further how playing a video game can ensure the accuracy and simplicity of the dialog boxes and prompts, inside each of the 36 localized versions of Windows around the world.

“The size, scale and impact of the Windows localization process made it an ideal candidate to enhance with gaming. The first pilot of the game began in January, followed by a version deployed more broadly across Microsoft that is still running.”

The Language Quality Test game emerged from an initiative called 42Projects, which explores management innovation, workplace behaviors, and issues of multiple generations in organizations. Ross Smith and Robin Moeur, a former Microsoft employee, helped launch 42Projects.

42Projects

42Projects is an experiment using trust as a fundamental element in improving the lives of the managed.

Ross Smith, leading an 85-person test team in the company’s Windows division, is working to show that innovative management techniques are alive and well inside the world’s best-known technology company.

The team works to ensure the quality of Windows security-related features. Expectations are high as hundreds of millions of people trust – and demand – that features work correctly and Windows is trustworthy.

The team is filled with people routinely labeled “Generation Y.” As Smith got to know his new team and started to understand what made them tick, he saw an opportunity to do things differently. The challenge was how to apply Theory Y to Generation Y. Theory Y says humans are intrinsically motivated to do a good job, and if the right conditions can be created, employees will give their discretionary time for free. Theory Y behavior came naturally to Smith. Two decades at Microsoft had given him a good intuitive feel for how to get the best out of people.

The team began to think about how trust worked in the Microsoft environment. People are more likely to have fun at work if they trust each other. With that realization, the team thought it had something tangible it could pursue.

The first step, therefore, was to brainstorm to identify the behaviors affecting trust that people saw in their day-to-day work. As this progressed, the team created some games and experiments with voting to try to prioritize the lengthening list and to learn more about what could be done to increase trust.

At http://www.defectprevention.org/trust, readers can view one of the games the Microsoft team used to develop its trust model. Users are asked, “Which trust factor is more important to you?” and then given a series of two-option responses. More research led to the creation of a playbook for people to reference and use. Things like “be more transparent” or “demonstrate integrity” were highlighted. The challenge was to link these notions to tangible activity. embers of the team then worked to write up a paragraph on each trust behaviour. This information was then opened up as a wiki to generate community participation and build understanding. Around 40 per cent of the Windows Security Test Team actively contributed to this process.

The spirit of learning, trust and respect for new ways of working was coming alive in the Windows Security Test Team, but it needed a name. They needed a brand to represent the changes that were happening. They settled on 42Projects.

The number 42 helped to capture the quirkiness of the team’s approach and the broad objectives of the program itself. It also tapped into the Generation Y spirit. During 2007 and 2008, the program grew organically, and tentative steps led to a profound cultural shift within the team.

Playing Games - Building The Principles Of Gaming Into Our Work




Games, and the spirit of gaming, are fundamental to Generation Y. The importance of game playing as a means of learning was not lost on the team. Smith explains: “When a product needs a bit of a push toward a certain behavior, building a productivity game around it can help. A common approach in the past was for the Windows Security Test Team to host a ‘bug bash’ for an evening and give a prize to the person who found the most bugs during the event. We’ve tried to take this a step further. Using games is a powerful method to influence changes in organizational behavior, though it requires care in the design and use.”

Ben Sawyer, co-founder of the Serious Games Initiative, a Washington, D.C.-based start-up, concurs. “While everyone in the enterprise is chasing games for training, the real promise for games is in changing how enterprises work, think and administrate, which will have much more dramatic changes on productivity through games than the odd training efficiency. I sincerely believe that, and few people spend more time thinking about serious games than I do.”

If a game is built around the activity, and each “player” is awarded points, or there is a leader board on display with the latest standings, then volunteerism and participation skyrockets. Games built around a goal like this have resulted in a 400 per cent improvement in participation levels for some activities.

Success has not come easy for the team. Dramatic change doesn’t normally bubble up from the bottom. But there is now solid evidence that the change program kicked off by Smith in early 2007 is paying dividends.

Friday, August 7, 2009

Productivity (Serious) Games

Serious Games for people doing regular work



Page Hunt shows users a Web page, without the URL, and asks them what search query they would type to get to that page.

Via: Productivity Games – Ross Smith

According to Ross Smith, Director of Test, Windows Security, at Microsoft, Productivity Games are a sub-category of Serious Games designed to improve the productivity and morale of people doing "regular work”, or in other words:

Play your Work!

In his extensive post Portfolio Selection and Game Theory in Defect Prevention, he states that Productivity Games could be the Six Sigma of the 21st century.

Ross Smith also states that Productivity Games attract players to perform tasks that humans are good at but computers currently are not.

“Although computers offer tremendous opportunities for automation and calculation”, he says, “some tasks, such as analyzing images, have proven to be difficult and error-prone and, therefore, using computers can often lower the quality and usefulness of the results. For tasks such as this, Human Computation can be much more effective.”

“Additionally, by framing the work task in the form of a game, we are able to quickly and effectively communicate the objective and achieve higher engagement from a community of employees as players of the game.”

Research Background


The use of Productivity Games at Microsoft stretches back several years. Early use of games to increase quality improvement efforts in Windows began in 2006. In August 2008, Forrester released a report on Serious Games ("It's time to take games seriously," by TJ Keitt and Paul Jackson) with the insightful prediction that "the strongest ROI and ultimate adoption will be in Serious Games that help workers do real work."

In his post, Ross Smoth also provides three examples of Productivity Games they’ve used at Microsoft to improve quality :

Code Review Game

The Windows Security Test team deployed a game designed around code reviews in March 2009. The belief was that work and fun need to co-exist to help keep employees motivated through the ebb and flow of the product cycle and that you must vary defect detection approaches to get the best results.

PageHunt Game

The goal of the PageHunt Game is to improve the relevance of the search results. Page Hunt shows users a Web page, without the URL, and asks them what search query they would type to get to that page. If their query does return the Web page on Microsoft's search engine, they get points.

The Language Quality Game

the Language Quality Game was developed to encourage native speaking populations to do a final qualitative review of the Windows user interface and to help identify any remaining language issues.

Skill Tracker

In addition to the abovelist, there's a lot of work going on in the Office Labs group to experiment with the use of games in Microsoft Office.

The Office Labs Skill Tracker adds elements of game play into Office to motivate users to explore more of the applications, learn new features, and boost their productivity.

Skill Tracker will be released in late 2009. Office Labs Program Manager Jennifer Michelstein, who is coordinating the Skill Tracker project, believes that "adding elements of game play to Office can motivate people to learn more features and boost their productivity, while having fun, competing, and feeling good about learning. A key variable is integrating the right level of fun in Office, so that game elements boost instead of reduce overall productivity."