Lune

EMNLP Findings2024

Multimodal Procedural Planning via Dual Text-Image Prompting

Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Wang, William Yang Wang

Abstract

Step 5: Add other ingredients like sichuan peppercorn powder and chili bean paste, then stir fry.

Step 6: Pour in remaining marinade mixture into the same wok and stir fry until combined.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

12 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation cites High-Resolution Image Synthesis with Latent Diffusion Models
  • LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation cites Language Models are Few-Shot Learners
  • LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation cites Learning Transferable Visual Models From Natural Language Supervision
  • LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation cites Training language models to follow instructions with human feedback
  • High-Resolution Image Synthesis with Latent Diffusion Models cites Denoising Diffusion Probabilistic Models
  • PlanGenLLMs: A Modern Survey of LLM Planning Capabilities cites Language Models are Few-Shot Learners
  • RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis cites Training language models to follow instructions with human feedback
  • Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents cites Learning Transferable Visual Models From Natural Language Supervision
  • Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents cites Training language models to follow instructions with human feedback
  • Learning Transferable Visual Models From Natural Language Supervision cites Language Models are Few-Shot Learners
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
  • Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models cites Language Models are Few-Shot Learners
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers12

  1. Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsPan Lu, Baolin Peng, Hao Cheng, Michel Galley et al.NeurIPS 2023 · 515 citations
  2. LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis EvaluationYujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang et al.NeurIPS 2023 · 119 citations
  3. Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied AgentsWenlong Huang, Fei Xia, Dhruv Shah, Danny Driess et al.NeurIPS 2023 · 102 citations
  4. PlanGenLLMs: A Modern Survey of LLM Planning CapabilitiesHui Wei, Zihao Zhang, Shenghua He, Tian Xia et al.ACL 2025 · 78 citations
  5. RoboCodeX: Multimodal Code Generation for Robotic Behavior SynthesisYao Mu, Junting Chen, Qinglong Zhang, Shoufa Chen et al.ICML 2024 · 50 citations

Builds on29

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
  3. Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
  4. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  5. High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations

Related papers

  1. Loom: Diffusion-Transformer for Interleaved GenerationMingcheng Ye, Jiaming Liu, Yiren SongCVPR Findings 2026
  2. ShowHowTo: Generating Scene-Conditioned Step-by-Step Visual InstructionsTomás Soucek, Prajwal Gatti, Michael Wray, Ivan Laptev et al.CVPR 2025
  3. Scaling Context-Aware Task Assistants that Learn from Demonstration and Adapt through Mixed-Initiative DialogueRiku Arakawa, Prasoon Patidar, Will Page, Jill Lehman et al.UIST 2025 · 3 citations
  4. Thinking with Map: Reinforced Parallel Map-Augmented Agent for GeolocalizationYuxiang Ji, Yong Wang, Ziyu Ma, Yiming Hu et al.ACL Findings 2026
  5. ChefGAN: Food Image Generation from RecipesSiyuan Pan, Ling Dai, Xuhong Hou, Huating Li et al.ACM MM 2020 · 32 citations
Dusk over the sea between two cliffs drawn in fine vertical lines