/facepalm
Multiple users can cast to the TV provided they are both using Cast supported apps and are on the same Wi-Fi network. The only way to prevent others from casting to your TV would be to password protect your Wi-Fi network.