A multiplayer snake like game where you goal is to outlive or kill the opponent.
TO-DO
- Basic game mechanics.
- Enemy player (AI).
- P2P Multiplayer.
- Power-ups.
- Set-up: players appear at random positions & initial direction
- Goal: outlive all opponents.
- Agent Reward Function:
- +0.01 at each step
- +1.0 To the last alive agent.
- -1.0 To all dead agents.
- Behavior Parameters:
- Vector Observation space: Size of 210, corresponding to 17 ray casts (stack of 3) distributed over 60 degrees at max ray length 20.
- Vector Action space: (Discrete) Size of 3, corresponding to left/right/forward movement.
- Visual Observations: None
The bot is able to survive in a friendly environment.
However, it fails versus an aggressive opponent. In the image below you may notice that the agent always wants to go clockwise. This can be easily exploited and will lead to an agent's death in the long run.
Human- cyanAI- pink, yellow, green
Another issue is that agents can sometimes trap themselves. For instance, when a snake (e.g. pink in this case) is looking directly at the edge of the map, the longest ray is casted in the same direction, which falsley makes it think that this is the best route. This could potentially be fixed by using a longer stack of rays (acts like memory) to avoid situations that lead to inevitable death.