https://nimbusarchitect.com/blog Solutions Architect at AWS. Writing about AI/ML, cloud architecture, cybersecurity, and quantitative research. en-us lilphd99@gmail.com (Benjamin Lee) lilphd99@gmail.com (Benjamin Lee) Wed, 14 Jan 2026 00:00:00 GMT https://nimbusarchitect.com/blog/ab-testing-llm-prompts-production https://nimbusarchitect.com/blog/ab-testing-llm-prompts-production Tweaking a chatbot prompt is easy; knowing whether you improved it is not. How to A/B test LLM prompts in production—the mechanics, the metrics, the tooling. Wed, 14 Jan 2026 00:00:00 GMT lilphd99@gmail.com (Benjamin Lee) llmai-agentsmlopsdata-science