How we scaled AI Dungeon 2 to support over 1,000,000 users

Source: AI Dungeon Classic
Source: AI Dungeon Classic
Source: AI Dungeon

How to spend $50,000 on GCP

Source: Google Colab

Deploying GPT-2 at scale — without going broke

  • Wraps your model in an API and containerizes it
  • Deploys your model to the cloud, exposing your API as an HTTP endpoint
  • Auto scales your instances to handle traffic fluctuations

Scaling AI Dungeon has been a community effort

  • BYU PCCL paying our initial GCP bill
  • The users who brought AI Dungeon 2 back online via torrent within 12 hours of it shutting down
  • Braydon Batungbacal, who volunteered to build the iOS and Android apps
  • The Patreon supporters who continue to fund AI Dungeon’s development
  • Open source projects like Cortex that have worked to support AI Dungeon

--

--

--

Making AI a tool of creativity and freedom for everyone. https://play.aidungeon.io

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

AI Network Monthly Update: Feb 2021

Adoption Of Technologies Like AI, ML by the Insurance Sector

Neurons — The Nuts and Bolts of our Intelligence

AI and IoT enabled framework for automatic pandemic management

AI: are you ready for the coming revolution?

The New Era of AI Powered Lead Qualification

Better Ways To Leverage Voice Search in Online Store

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Latitude Team

Latitude Team

Making AI a tool of creativity and freedom for everyone. https://play.aidungeon.io

More from Medium

An AI watching bubbles

An artistic impression of a humanoid robot thoughtfully examining bubbles

Timeline of AI - Ai in Making

Collaborative Intelligence — An Artificial Intelligence and Human Initiative

You are Not Using the Right AI/ML API: Here’s Why