You've been logged out of GDC Vault since the maximum users allowed for this account has been reached. To access Members Only content on GDC Vault, please log out of GDC Vault from the computer which last accessed this account.

Click here to find out about GDC Vault Membership options for more users.


Session Name:

LIGHTSPEED STUDIOS Developer Summit: Multi-agent AI Production of FPS Game Based on Reinforcement Learning (Presented by LIGHTSPEED STUDIOS)


In-game AI is a vital element in the creation of FPS games, as it can be implemented in various situations including PVE gameplay, to take over for disconnected players, and populate online matchmaking services. These circumstances necessitate a high level of both AI power and human-like behavior, thus creating a challenge for classical rule-based AI solutions.Gerry and Zhichao will be delivering a presentation to discuss the implementation of a reinforcement learning AI solution that LIGHTSPEED STUDIOS is incorporating into an FPS game. This solution requires minimal human replay to create training data and has been demonstrated to be more efficient than imitation learning AI solution. The reinforcement learning AI proves to have a win rate that surpasses 90% when pitted against behavioral tree AI, and its performance throughout the game has been highly acclaimed by game developers.

Did you know free users get access to 30% of content from the last 2 years?

Get your team full access to the most up to date GDC content

  • Game Developers Conference 2023
  • Gerry SUN
  • Zhichao Shu
  • free content
  • Programming
  • Programming