Session Name: | Tools Summit: Efficiently Shuffling Loads of Data from Place to Place |
Speaker(s): | Adrian Astley |
Company Name(s): | Activision |
Track / Format: | Tools Summit |
Did you know free users get access to 30% of content from the last 2 years?
Overview: | Games and tools are big and only getting bigger. Games are expanding to be developed by multiple studios in potentially distant physical locations. In addition, the game data and assets are also growing. Thus, using a network file server to transfer data for both Continuous Testing servers as well as individual developers is no longer viable. This talk is a postmortem of a tool we created to manage data transfers in order to optimize for speed, space, and bandwidth. The talk will discuss the reasons for needing this tool, the architecture we ended up with, an analysis of how well it's working, and finally a discussion of all the issues / pitfalls we ran into while developing the tool and running it at scale. |