More than half of Americans are rethinking summer travel as soaring prices, safety concerns, and stress push many to cancel plans.