I don’t get the hype around LLM, it is a terrible way to search
I’ll be playing devil’s advocate here just for a moment (despite the huge ecological, moral, political and economical costs) :
what LLM does provide is a looser linguistic interface. That means instead of searching for exact words, one can approximately search for the “idea”. That means instead of hitting just the right keywords that an expert might know, one can describe a partial solution, a very rough guess of what the problem might be, and possibly get a realistic sounding answer. It might be wrong yet it might still be a step in the right direction.
So… yes I also don’t think the hype is justified but IMHO it’s quite clear that providing a solution that makes an interface easier to get some OK-looking result would appeal to masses. That means a LOT of people get their hopes up about potential empowerment and a few people ride that bubble making money on promises.
PS: for people interested in the topic but wanting to avoid the generative aspect I believe en.wikipedia.org/wiki/Semantic_search is a good starting point.