Give the models concise engineering principles
I've said to let the models breathe more and be less prescriptive. Lauren Tan put a more coherent version of that into words: encode tried-and-true engineering principles as concisely as possible, so the model can use what it already knows.
Knowing those principles takes experience and often some battle scars. Classical software engineering skills still matter because they help you recognize when one of those insights will make a big difference in steering the model.
Originally posted on X. Lightly edited for reading here.