Yes, in fact, all buff/heal items will benefit both players when used, eliminating the need to fight over them.