How to Compare Two Prompts Using the Same Test Inputs
A fair prompt comparison changes one thing: the prompt. Hold the test inputs, scoring rubric, repetitions, tool access, and model settings steady, record the full configuration, and…
FROM THE AUTHOR
Explore the published guides and contributions from John C. Mullen.
87 published articlesA fair prompt comparison changes one thing: the prompt. Hold the test inputs, scoring rubric, repetitions, tool access, and model settings steady, record the full configuration, and…
Ollama can run local models, connect to cloud models, and serve desktop apps, coding agents, and APIs. This guide explains the setup paths, first working commands, log…
Start with retrieval augmented generation (RAG) when your project must answer questions from documents that change and cite sources. Choose fine-tuning when the model needs to match…