Spent 2 hours tuning a support bot prompt and it still invents order numbers

Aman 3 months ago

Kept rewriting the system prompt thinking I just hadn't phrased it right. Eventually realized the issue wasn't the prompt at all — the model had no actual access to the order data, so of course it was guessing. Once we added a real lookup tool call it stopped immediately.

1 Reply

Shreya 3 months ago

This is such a common trap. Prompting can't fix a missing data source, it can only make the model better at PRETENDING it has one.

Always Active

Necessary cookies enable essential site features like secure log-ins and consent preference adjustments. They do not store personal data.

Remark

Functional cookies support features like content sharing on social media, collecting feedback, and enabling third-party tools.

Remark

Analytical cookies track visitor interactions, providing insights on metrics like visitor count, bounce rate, and traffic sources.

Remark

Advertisement cookies deliver personalized ads based on your previous visits and analyze the effectiveness of ad campaigns.