Using expert interviews to improve the system
For some of my builds, I've put a workflow around interviewing users and domain experts about the outputs. I prepare structured questions, record and transcribe the interviews, and feed the transcripts into a skill in my custom harness.
The feedback then flows into improving the system. Getting people to talk through what they like and don't like gives the model a lot to work with.
It feels weird how easy that part can be. Building the system around it takes work, but once it's in place, it often just works.
Originally posted on X. Lightly edited for reading here.