Need to handle users leaving the channel

[mgyucht]

Currently there is still one bit of state that is kept in memory, which is the current users on the channel. If someone is on the channel at one point but leaves the channel later, we don't want to crash, but we should still be able to show stats about them.