Searching with Intuition: Exploring (the bounds of) LLM-guided Search with Unknown Objectives
Author(s)
Kaashoek, Justin H.
DownloadThesis PDF (6.698Mb)
Advisor
Raghavan, Manish
Terms of use
Metadata
Show full item recordAbstract
Large language models (LLMs) can perform a wide range of search and optimization tasks over discrete spaces. This work seeks to explore the limits of LLM-guided search. We construct a set of text optimization tasks with different levels of "intuitiveness'' and evaluate whether LLMs can effectively optimize objectives. We show that the LLM's performance depends not only on its intuition for the objective, but also on the alignment between the objective and its priors. We also find that the LLM can successfully optimize an objective even without an explicit description of the objective. Our results largely focus on greedy search strategies; we develop a theoretical characterization of conditions under which greedy search is optimal, meaning the LLM's failures result from a fundamental inability to take gradient-like steps, not suboptimal search.
Date issued
2025-05Department
Sloan School of ManagementPublisher
Massachusetts Institute of Technology