"Previously on..." from Recaps to Story Summarization

Recap -That's Jack Bauer! -[Jack] Get up or I will kill you right here. -Who is it you're looking for? -I need you to break the story... -Novakovich was just murdered. -... Bauer has no idea...Novakovich was operating under my orders? -It's about the people...murdered your father. -... working under Russian agents. -Bauer contacted Meredith Reed. -You're suggesting muzzling the press? -... Meredith Reed. Call her publisher and demand not to run the story. -... muzzling press. The freedom of press is constitutionally protected? -You are the President. Tell them this story will create a war. -... I don't need to tell what damage your criminal prosecution will do. -You're poison. ... never should have let you do this. -Where's Novakovich? What did he say to Bauer? -Nothing ... was bleeding ... wounded by one of the guards. -... murdered. Bauer learned that Novakovich killed Omar and Renee. -Lunatic was gonna kill me, Yuri. Think of it as sacri cing a rook for a king. -... orders? There's nothing more dangerous than a wounded animal. Figure 1 . We illustrate how TV show recaps can be used to generate labels for multimodal story summarization. The top half features the recap shown at the beginning of the episode S08E23 based on key moments (shots and dialogs) from S08E22 of the TV series 24. As recaps help viewers recall essential story events, we extend these aligned segments to create summarization labels (visualized in the bottom half where the actual shots and dialogs inherited from recap are marked in deep red). For example, in the sub-story (left), the recap hints at Jack Bauer relaying classified information to the press, while the summary presents the complete sub-story, including Logan informing President Taylor about their failure to catch Jack and their disagreement over muzzling the press.