TripTide: A Benchmark for Adaptive Travel Planning under Disruptions

Recent work, such as TripCraft and TravelPlanner, has shown the promise of Large Language Models (LLMs) for personalised, constraintaware travel itinerary generation, but real-world travel often involves disruptions. To address this gap, we introduce TripTide 1 , the first benchmark for evaluating LLMs' ability to revise itineraries under realistic disruptions. TripTide models disruption severity and traveler tolerance, enabling systematic evaluation of LLM responses to events such as transit cancellations, weather closures, and overbooked attractions. We conduct a three-fold evaluation: (i) automatic metrics measuring Preservation of Intent, Responsiveness, and Adaptability (semantic, spatial, and sequential), (ii) an LLM-as-a-Judge evaluation, and (iii) a human study assessing revision quality. Our findings show that LLMs largely preserve semantic and sequential structure, while spatial deviations are higher for shorter itineraries and diminish for longer ones. However, disruptionhandling performance declines as itinerary length increases. TripTide 2 provides a foundation for benchmarking robustness and adaptability in LLM-based travel planning. Subtype Example / Description Disruption Category Transport Flight Delays, cancellations, missed connections, baggage mishandling, labour strikes, adverse weather conditions, airport closures Accommodation Poor hygiene, unsafe/remote locations, missing promised amenities, overbooking Restaurant Unexpected closures, changes in operating hours, poor hygiene, inadequate dietary support, overcrowding, long waits, surge pricing Attractions Closed for maintenance, weather-related issues, government restrictions, ticket sell-outs, ID rules, overcrowding, limited open days. Event/Activity cancellations, rescheduling, venue changes, ticketing issues, weather or safety risks Miscellaneous traveller illness, jet lag, fatigue, inclement weather, forgotten documents. Severity Step-Level Affects an individual activity or segment Day-Level Impacts all activities on a particular day Plan-Level Necessitates major plan or route overhauls Traveler Tolerance Flexi-Venturer Open to rerouting, substitution, or plan changes Plan-Bound Prefers minimal changes and high plan adherence following Disruption severity.