Reward Systems — the Art of Giving

Rewards!

When I play a game, I expect my experience to be a rewarding one. When a player feels rewarded, dopamine level increases in his/her brain and consequently creates a pleasurable feeling. This in turn positively reinforces the player’s behavior and keeps the player glued to the screen. This is true for everyone, but what makes an experience rewarding, exactly? Psychologists would break rewards down into these four types:

  1. Variable Ratio Schedule
  2. Fixed Ratio Schedule
  3. Variable Interval Schedule
  4. Fixed Interval Schedule

When designing a game, it is crucial to employ the right combination of reward systems that align with the gameplay. A mismatched reward system can misguide the player and easily result in a different experience regardless of the designer’s intention. For instance, if critical hits happen on a fixed timer, players will be less inclined to make more frequent attacks and wait for the timer. This creates a less action-oriented combat system.

Variable Ratio Schedule

We’re all so happy when we’re gambling.

A variable ratio reward system is powerful. It capitalizes on human behavior so well that us players are sometimes slaves to its will. In summary, a variable ratio system has an element of randomness and rewards a player after he/she performs an unpredictable number of actions. It’s the reason why casinos and gambling addictions exist. What makes variable ratio rewards so tantalizing? Turns out, dopamine levels also rise when one anticipates a reward. Being unable to predict its occurrence causes us to anticipate it on every action, keeping us on a heightened state of arousal. If we do happen to get it, the rise in dopamine level would also be higher compared to say, a fixed ratio schedule, because our brains did not expect it. The human brain is wired to be more sensitive to unexpected stimulus — this is the basis of our fight-or-flight system — it keeps us alive. The promise of a sudden, unpredictable surge of pleasurable stimulus exploits this to keep us engaged.

<3 digital cards.

In the realm of the increasingly popular “free to play with microtransactions” paradigm, variable ratio asset rewards are abused to the core. Take Hearthstone, Clash Royale and Dota 2, for example, card packs and chests give out random rewards. We know we’ll get the legendary card or epic card if we keep opening packs, but we can never predict when. So what happens next? – We keep buying and opening packs. To show how immensely effective such a model is, Hearthstone’s revenue is a sheer $24 million per month. “Oh boy a legendary!”

Oh yeah.

Variable ratio rewards are also heavily used in gameplay mechanics and have withstood the test of time. Critical hits, card drawing, and dice rolling provide players with small pleasurable moments throughout the game. With critical hits, for example, players anticipate these moments every attack. This results in a more dynamic combat experience. In Fire Emblem, I distinctly recall looking forward to the occurrence critical hits the most in combat, simply because of how it was designed — a special animation followed by four times the damage. See the animations for yourselves! It’s indescribably satisfying.

Fixed Ratio Schedule

100 coins for shrooms? I’ll take one, please.

With all the praise I’ve been giving to variable ratio rewards, surely there’s some merit for our other pals — fixed ratio rewards. Fixed ratio schedules reward players after a known, fixed number of actions. It’s basically a transaction. As explained previously, the pleasure we derive from such types of rewards is not as great compared to variable ratio rewards. However, fixed ratio systems do have an important role to play as well.

Image result for 3 in a row meme

Daily quests.

Fixed ratio reward systems form the foundational experience for many games. It provides the base level of satisfaction and rewards to players, thereby promoting a consistent and predictable player behavior.  A category of quests does precisely this: “Kill X boars; obtain 5 watermelons; win three games…” Take Heroes of the Storm, for instance. There are daily quests that reward us with gold for completing certain tasks a number of times, such as winning a game 3 times. If the parameters of the daily quests are unknown and the rewards are relatively small in proportion to the amount of effort invested, players are certainly not going to invest in them. Why not randomize and increase the range of rewards then variable ratio style? Well, it’s because simply inflating randomized game rewards in exchange for player commitment can cause inconsistency in terms of the basal player experience. Some players get huge rewards on a daily basis and some don’t. This unfair distribution of daily resources creates needless disadvantages for certain players.

I give up.

The allure of variable ratio reward systems can also fade rapidly, especially if players are allowed to repeatedly try for it. For an initially motivated but unlucky player, he/she can easily get tired and give up. I remember giving up Brave Frontier because it was tiring to constantly gamble for the latest units.

Variable Interval Schedules

Similar to variable ratio systems, variable interval schedule systems does a pretty good job of eliciting a slow, steady response rate from players.  Variable interval schedule systems reward players repeatedly after an unpredictable period of time. This system is usually employed to motivate players to perform activities over a period of time rather than after an explicit, tangible user action.  It is thus generally difficult to pinpoint these systems in games.

Image result for fishing waiting meme

Finally a bite.

Treasure goblins and power shrines in Diablo 3 are examples of this. The spacing of these two elements is designed so that the player encounters them after spending an uncertain amount of time exploring uncharted areas. The player’s interest level spikes when encountering these treasures, reinforcing his behavior of exploring the map. Variable interval schedules are often used to reinforce the user’s activity within game loops in single-player focused activities.  Rare encounters/respawn rates (WoW, Pokemon), air drops (for other players in H1Z1), and fishing (Stardew Valley) are instances of variable interval schedules in games.

Fixed Interval Schedules

Rewarding players after a known, predictable time period is the role of a fixed interval schedule. Unlike variable interval schedules, we know exactly when the reward will come. Since it is predictable over a fixed time period, we are usually responsive and interested when it’s close to reward time, and our interests wane sharply afterward. Furthermore, it’s not as stimulating as a surprise reward from its variable counterparts. Why would anyone use this then?

Image result for cramming

Yes. Examinations are fixed interval systems.

Many games employ the use of daily quests to incentivize us to play the game on a daily basisa regular commitment. Fixed interval reward systems do a good job of developing player habits and commitment to a game. It is hence common to see daily quests and rewards being implemented as it encourages the development of consistent play habits and investment in a game. This is especially important in competitive multiplayer games that require a large player base. Daily rewards benefit the interested players and the developers. As players, we want that competitive edge that daily rewards give us. As developers, they want concurrent active players. As I am writing this paragraph, I was reminded that I have faithfully logged into Hearthstone daily since its launch just to not miss out on these carrots dangling in front me. Oh my god.

Another common implementation of fixed interval schedules is — leveling up. In Pokemon, the excitement when my Charmeleon is close to level 36 is immeasurable. After reaching that and evolving, the excitement dies down substantially. Across most games, leveling up is essentially a constant mini-goal that we can constantly achieve. Similar mechanics based on these mini-goal concepts include charging of ultimate abilities (Final Fantasy 10, Overwatch) and whittling down enemy HP meters. More often than not, these elements have visual elements that signify your progress bit by bit.

So which one do we use?

Image result for rewards funny

A combination of several layering types of reward systems seems to be the winning formula these days. Let’s use Hearthstone as an example.

  1. We are given gold for daily quests (fixed interval) that requires us to complete certain measurable tasks such as winning a certain number of games (fixed ratio).
  2. Opening card packs give out random rewards (variable ratio) with a possible legendary card in each pack. A pity timer is implemented to ensure that there will be at least one legendary card in 40 packs (fixed ratio).
  3. Dust system that allows disenchanting and crafting of cards gives players a limited ability to get the cards they want after opening a large number of card packs. (fixed ratio).

Hopefully, this article provided an analysis of how your game’s rewards should be. Now, time to hand out the goodies in your game!

Lenses Analysis of Don’t Starve

Hm, do you ever get the feeling that you’re being watched…?

We’ve just covered several lenses in the Game Design lectures, and I am incredibly curious to analyze a game based on some the lenses covered in Jesse Schell’s book: “The Art of Game Design“! To provide a greater depth of perspective, I will base my analysis not just from my playthrough but a friend, Chua’s as well. Without further ado, here’s the game: Don’t Starve. Let’s not forget the lenses too:

  1. The Lens of Curiosity
  2. The Lens of Punishment
  3. The Lens of Visible Progress

The Lens of Curiosity

This is perhaps one of the most crucial lenses that Don’t Starve is based on. Both my friend and I had had many questions at the start which motivated us to continue playing the game. We had the overall question of: “How do we beat the game?” However, the type of intermediary questions we asked differed. I wanted to know more about the world and the rules of survival, which led me to ask, “What does this item do, exactly?”. On the other hand, Chua appreciated the game’s combat and action-oriented aspects. Hence,  his question was more inclined to: “How do I become stronger?”. Both these questions were most likely somewhere in both of our minds, but it was interesting to see that we prioritize them differently based on the type of enjoyment we derive from the game.

Run Forrest run!

The game had an overall goal of survival, but the means of achieving it were designed to cater to different playstyles. The game could simply be exploration and survival against nature, but that would result in zero interest from action-seeking players such as Chua. Being able to satisfy the curiosity of different types of players is thus important when trying to appeal to a wider audience. If we are motivated to seek the answers that make the game fun for us, we will play the game.

The Lens of Punishment

The hallmark of any great game is the delicate balance between punishment and reward. However, that is tricky. Some players welcome brutal challenges, others just get pissed off. I’m the former (I played Dark Souls). Don’t Starve substantially punishes you for performing incorrect actions, either by draining one of your stats or, in some cases, certain death. It is clear that the game wants you to learn through death. Personally, dying repeatedly did not deter me from playing the game because the deaths were justified — I screwed up.

Chua, however, was not at all pleased. He felt that his deaths were unjustified and was annoyed at the game for killing him all the time. To make matters worse, Don’t Starve offers few direct clues as to why you died. Needless to say, his frustration at the game soon outgrew his satisfaction from playing it.

At least I hit 55 days.

For players who want an easy and straightforward gameplay, Don’t Starve can come across as an unforgiving and frustrating game. Simply lowering the difficulty isn’t wise as some appreciate the challenge. If we compare this game with Dark Souls, the deaths in the former game can sometimes be attributed to an unknown or misunderstood game mechanic — your screen flashes red —and you die. However, dying in Dark Souls follow after a distinct visual display of an attack. Players are thus more receptive to try again as they know what to avoid the next time. It’s just not a pleasant feeling to waste hours knowing that an unknown entity is blocking your progression.

 

The Lens of Visible Progress

Being able to visually gauge one’s progression is tantamount for any player who invests long hours in a game. The main visual displays of progression in Don’s Starve are base structures, seasonal changes, and environmental scars. As someone who appreciates exploration and building stuff, I derive much satisfaction from watching the permanent visual impact of my actions.

In terms of combat, however, there is little indicator of progress. There is no level-up system, no progress bar for killing monsters, and corpses disappear after a while. For Chua, the game felt stagnant and repetitive due to the lack of his own definition of progression. The game isn’t designed based on combat. Killing monsters simply serve as a means to get more resources.

Great base, better beard.

The progression system and feedback show how the game should be played. They tell the players that they’re doing it right or wrong. Being able to show progression in various aspects of the game is beneficial in retaining players’ interests. Games today often have an “Achievement” or statistics section that lists information about the player’s action. Adding such a feature is trivial in proportion to the motivation that it gives to the players. To many players, getting a 100% is a huge deal. This just shows how important it is to implement visual indicators of a player’s progress not just for the main gameplay, but for the other game mechanics as well.

Conclusion

It is interesting to see how I can break a game down to see how they fare in each of the lenses. With just three lenses, I am able to analyze the game from different perspectives and see possible weaknesses of a game. Imagine how detailed it would be with a hundred lenses!