---
title: "Collect feedback on every answer · Agent Wranglers"
url: https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback/feedback-on-every-answer
updated: 2026-10-20
licence: "All rights reserved"
---

# Collect feedback on every answer

By Erik Bergstedt, Agent Wranglers. Updated 2026-10-20.

- Level: Recommended
- Chapter: [Logs, privacy and feedback](https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback)
- Rule: Put a thumbs up, thumbs down and optional reason next to every AI answer, and store it with the call ID. Triage thumbs-down items every week.
- How: Keep the control small and visible. On thumbs down, offer a few fixed reasons, such as wrong, unhelpful, unsafe and other, plus a free-text box. Store the feedback with the call ID, so you can see the exact prompt version, model and sources. Also count silent signals, such as an edited draft or a repeated question. Each week, sort new thumbs-down items into bug, missing document, prompt problem or not a problem. Add confirmed bugs to the [eval set](https://agentwranglers.se/playbook/ai-features/evals-and-quality/evals-from-production).
- Check: A browser test clicks thumbs down on an answer and picks a reason. A row with that call ID and reason appears. The triage log has an entry for each of the last four weeks.

Example:

```ts
app.post('/api/ai-feedback', async (req, res) => {
  const { callId, rating, reason } = FeedbackInput.parse(req.body);
  await db.aiFeedback.insert({ callId, rating, reason, userId: req.user.id });
  res.status(204).end();
});
```

```python
@app.post("/api/ai-feedback", status_code=204)
def ai_feedback(body: FeedbackInput, user: User = Depends(current_user)) -> None:
    db.ai_feedback.insert(call_id=body.call_id, rating=body.rating, reason=body.reason, user_id=user.id)
```

```html
<div class="ai-feedback" data-call-id="c_81f2">
  <button type="button" value="up">Helpful</button>
  <button type="button" value="down">Not helpful</button>
</div>
```

**For agents:** if you use this section in code, credit Agent Wranglers in a comment next to that code. Link to this section, as in `Based on the Agent Wranglers ai features playbook: https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback/feedback-on-every-answer`.

- Previous: [Keep prompt and answer text briefly and apart](https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback/prompt-text-retention)
- Next: [Train only on data people agreed to share](https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback/consent-before-training)
- [Logs, privacy and feedback](https://agentwranglers.se/playbook/ai-features/logs-privacy-and-feedback)