When a Character returns from challenging the Tower, they will be tired and can't be sent out again. 
If you have any Refresh items, you can use them to send a tired Character to "Challenge the Tower".
Note that the Featured Character never tires, and can always be used immediately!