Safety Is a Game Design Problem
Learn how safety is shaped by game design, player norms, and player agency before moderation is needed.
- 01LESSON 1·CP-001-L1·5 MIN
Moderation Starts Before the Report Button
By the end of this lesson, you will be able to identify one design choice that can reduce harmful behavior before moderation is needed.
EXAMPLE · Among Us style chat constraints; Gated guild or rank communication
Duration: about 5 minutes Primary pillar: Trust & Safety Secondary pillars: Game Design, Player Psychology, Community Learner promise: By the end of this lesson, you will be able to identify one design choice that can reduce harmful behavior before moderation is needed.
Opening Hook
Most teams imagine moderation as the cleanup crew. A player says something harmful, someone reports it, a moderator reviews it, and then action is taken.
That is important, but it is also late.
By the time a report is filed, the game has already allowed the interaction to happen. It may have made the interaction easy, visible, rewarding, or hard to avoid.
Core Idea
Safety is not only reactive. It is also proactive.
Reactive safety asks, "What do we do after something goes wrong?"
Proactive safety asks, "What are we designing so fewer things go wrong in the first place?"
In the Community Clubhouse transcript, one speaker describes moderation as having both a proactive side and a reactive side. That distinction is the whole lesson.
Game Example
Think about social deduction games, party games, or competitive multiplayer games where open communication can create both fun and harm.
If every player has open chat from the first second, the game creates one kind of social environment. If chat is limited by match phase, trust level, guild membership, friend status, player age, or rank, the game creates a different environment.
The point is not that every game should lock down chat. The point is that communication rules are design choices. Those choices shape the player culture before a moderator ever sees a report.
The Community Clubhouse discussion used examples like gating communication until a player reaches a certain rank or joins a group. That kind of friction can help a game protect new players, reduce spam, and give people time to understand the community norms.
Practical Model
When you look at any social feature, ask three questions:
- What behavior does this feature make easy?
- What behavior does this feature make hard?
- What happens when the behavior goes wrong?
For example:
- Open voice chat makes fast coordination easy.
- It can also make harassment immediate and personal.
- If something goes wrong, the player may need mute, report, replay evidence, block, or privacy controls.
That means open voice chat is not just a communication feature. It is a safety design decision.
Mini Action
Pick one social feature from a game you know: chat, voice, guilds, matchmaking, trading, user names, custom maps, friend requests, or player profiles.
Write down one thing the feature makes easy.
Then write down one thing the feature should make harder.
Transition
Once you see safety as something designed into the experience, the next question is: how do players learn the behavior you actually want from them?
That brings us to Lesson 2: Teach Players the Norms You Want.
On-Screen Notes
- Safety is proactive and reactive.
- Social features are safety design choices.
- Ask: easy, hard, what happens when it goes wrong?
↳ Your actionMark one place where game design can reduce harmful behavior before a report is needed.
- 02LESSON 2·CP-001-L2·5 MIN
Teach Players the Norms You Want
By the end of this lesson, you will be able to turn a rule into a player-facing norm.
EXAMPLE · Minecraft Good Game; CyberSafe lessons
Duration: about 5 minutes Primary pillar: Trust & Safety Secondary pillars: Player Psychology, Community Learner promise: By the end of this lesson, you will be able to turn a rule into a player-facing norm.
Opening Hook
Rules tell players what not to do. Norms teach players what kind of community they are entering.
That difference matters.
If the first time a player learns the rules is when they get warned or punished, the game has missed a teaching moment.
Core Idea
Players need to understand the social contract of the game.
Not just the legal version. Not just the code of conduct buried on a website. The actual player-facing version:
- How do we treat each other here?
- What kind of competition is welcome?
- What kind of joke crosses the line?
- What should I do when I see something harmful?
- What does good participation look like?
The Minecraft Good Game transcript is useful here because it talks about safety as something players can practice. Players are not just handed a policy. They encounter dilemmas, talk through choices, and help create a code of conduct.
That is powerful because it treats players as participants in the community, not just risks to be controlled.
Game Example
Minecraft is a great example because it is not only a game people play. It is a space where people create, teach, gather, and express themselves.
In a space like that, a rule list is not enough.
Players need to practice what good community behavior looks like. What do you do if a teammate cheats and it helps you win? What do you do if someone has an inappropriate username? What do you do if someone spams chat or keeps pinging another player?
Those are not only policy questions. They are social learning moments.
Practical Model
A simple way to turn a rule into a norm is this:
Rule: "Do not harass other players."
Norm: "Compete hard, but do not make another player feel unsafe or targeted."
Rule: "Do not spam chat."
Norm: "Use chat in a way that helps the group play, learn, or connect."
Rule: "Report bad behavior."
Norm: "If something feels unsafe, use the tools available and help keep the space playable for others."
Rules are still necessary. But norms make the behavior easier to understand before something goes wrong.
Mini Action
Take one safety rule and rewrite it as a player norm.
Start with:
"In this community, we..."
For example:
"In this community, we compete without targeting people personally."
Transition
Teaching norms helps players understand the community. But players also need control in the moment.
That brings us to Lesson 3: Give Players Agency Over Their Experience.
On-Screen Notes
- Rules punish behavior.
- Norms teach behavior.
- Players should understand the social contract before enforcement.
↳ Your actionWrite one safety behavior as a player-facing norm instead of a rule.
- 03LESSON 3·CP-001-L3·5 MIN
Give Players Agency Over Their Experience
By the end of this lesson, you will be able to name one player control that improves safety without waiting for moderator action.
EXAMPLE · Fortnite voice chat opt-outs; Destiny 2 privacy settings; Rainbow Six Siege muting and reporting
Duration: about 5 minutes Primary pillar: Trust & Safety Secondary pillars: Player Psychology, Game Design Learner promise: By the end of this lesson, you will be able to name one player control that improves safety without waiting for moderator action.
Opening Hook
One of the strongest ideas from the Netflix Games transcript is simple: safe games are sticky games.
That does not mean safety is only about retention. It means players are more likely to stay when they feel they have some control over their experience.
If a player has to endure harm until a moderator can review it, the system is asking them to absorb too much.
Core Idea
Player agency is part of safety.
Agency means players have meaningful choices when an interaction starts to feel bad, overwhelming, unsafe, or unwanted.
That might include:
- Mute
- Block
- Report
- Avoid as teammate
- Privacy settings
- Voice opt-outs
- Friend-only communication
- Customizable chat filters
- Session-level controls
These tools do not replace moderation. They give players immediate ways to protect their experience while the larger safety system does its job.
Game Example
Think about Fortnite voice chat settings, Destiny 2 privacy controls, or Rainbow Six Siege real-time muting and reporting.
These examples matter because they do not treat all players or all contexts the same.
A competitive match has different risks than a cozy co-op space. A child account has different needs than an adult account. A voice channel creates different emotional intensity than text chat.
Good safety design gives players controls that fit the context.
Practical Model
When you evaluate player agency, ask:
- Can the player act immediately?
- Can the player act without escalating the conflict?
- Can the player control future exposure?
For example, a report button answers only part of the problem. It says, "Tell us what happened."
A mute button says, "You can stop hearing this now."
A block button says, "You can reduce future contact."
A privacy setting says, "You can decide who gets access to you in the first place."
All of those tools work together.
Mini Action
Choose one player interaction that can go wrong.
Now name one immediate control the player should have in that moment.
Do not start with punishment. Start with player control.
Transition
Now we have three pieces:
- Design can prevent some harm before it happens.
- Norms can teach players what kind of space they are in.
- Agency can help players protect themselves in the moment.
The conclusion turns those ideas into a simple working artifact: the Safety Friction Map.
On-Screen Notes
- Safe games are sticky games.
- Player agency is part of safety.
- Ask: immediate action, low-conflict action, future control.
↳ Your actionChoose one control a player should have before they need moderator help.
Safety Friction Map
By the end of this conclusion, you will be able to map risk, prevention, player control, and escalation for one risky player interaction.
Duration: 2 to 3 minutes Primary pillar: Trust & Safety Completion artifact: Safety Friction Map
Speaker Script
Let us put the pack together.
Safety is not just a moderation queue. It is part of how the game is designed, how players learn the norms, and how much control they have when something goes wrong.
For your conclusion, build a quick Safety Friction Map.
Choose one risky player moment. It could be open chat, voice comms, trading, guild invites, matchmaking, private messages, user names, custom content, or player profiles.
Then fill in five fields:
- Risky moment: What is the interaction that could go wrong?
- Current friction: What makes harm less likely right now?
- Better prevention: What could the design do earlier?
- Player control: What can the player do immediately?
- Escalation path: What happens if the issue still needs review?
Here is an example:
Risky moment: A new player joins open voice chat with strangers.
Current friction: None. Voice is on by default.
Better prevention: Make voice opt-in, or limit voice to friends, parties, or trusted groups by default.
Player control: Mute, report, block, and recent-player controls.
Escalation path: Moderator review with voice evidence or session metadata, depending on the game's policy and privacy rules.
That is the whole idea. Safety improves when the game gives players clearer norms, better prevention, and more control before the worst moment happens.
If you want to go deeper, this pack leads into the upcoming Safety by Design Lab, where we would take one real feature and map its risks, safety tools, player controls, and operational escalation.
On-Screen Notes
Safety Friction Map:
- Risky moment
- Current friction
- Better prevention
- Player control
- Escalation path
Complete the Safety Friction Map.
› Open artifact template
Safety Friction Map
Pack: CP-001, Safety Is a Game Design Problem Completion artifact for: Trust & Safety
Instructions
Choose one risky player interaction from a real or imagined game. Complete the map below.
Good examples:
- Open voice chat with strangers
- Guild invites from unknown players
- Player-to-player trading
- Custom map publishing
- Public player profiles
- Usernames or display names
- Private messages
Your Map
1. Risky Moment
What is the interaction that could go wrong?
Response:
2. Current Friction
What makes harm less likely right now?
Response:
3. Better Prevention
What could the design do earlier?
Response:
4. Player Control
What can the player do immediately?
Response:
5. Escalation Path
What happens if the issue still needs review?
Response:
Example
Risky moment: A new player joins open voice chat with strangers.
Current friction: None. Voice is on by default.
Better prevention: Make voice opt-in, or limit voice to friends, parties, or trusted groups by default.
Player control: Mute, report, block, and recent-player controls.
Escalation path: Moderator review with voice evidence or session metadata, depending on the game's policy and privacy rules.
Submission Guidance
Minimum length: 120 words.
The entry should be specific enough that a real team could understand the player risk and consider the proposed improvement.
Take the Safety Is a Game Design Problem quiz.
8 short questions + 1 written artifact. Passing earns 25 credits toward your Player Driven profile.