Programming the LLM

I have been dabbling over past 6 months with LLM for different applications. All of them in some way relate to unstructured documents - largely text, and something fundamental seems to come to me: LLM is like an operating system, and we are essentially programming it by writing prompts - with one big cavate - while the traditional programming is all about precision, correctness and predictability - the LLM is kind of fuzzy in all of these characterises - and in that way it is more like how humans actually think.