Skip to Content

Welcome!

Share and discuss the best content and new marketing ideas, build your professional profile and become a better marketer together.

Sign up

This question has been flagged
1 Reply
5 Views

I asked for a few statistics for a presentation and got numbers with source names attached. When I went to look them up, two of the sources didn't exist.

I understand it can happen, but what do you actually do about it in practice? Is there a way to phrase the request so it admits when it doesn't know, or do you just always double check everything yourself?

Avatar
Discard
Author Best Answer

This is the single most useful thing to understand about language models: they predict plausible text, they don't look facts up. A source that sounds right can be pure invention. You can't switch it off completely, but you can reduce it a lot.

  • Bring the facts yourself. Paste the report, article or data into the prompt, and tell it: "Answer only from the text below. If something isn't there, say 'not in the provided text'."
  • Ask it to quote. "Give the exact sentence you're relying on for each number." If it can't, you've found a guess.
  • Don't ask it to produce statistics from memory. Ask what to search for instead, then find the number yourself.
  • Label confidence. "Mark each claim as [from my text], [general knowledge] or [unsure]."
  • Verify anything that matters. Numbers, names, links and quotes get checked by a person, every time.

So in practice it's both: phrase the request to give it less room to invent, and still double check what you're going to publish.

Avatar
Discard
Related Posts Replies Views Activity
1
Oct 26
6
1
Oct 26
5
1
Oct 26
7
1
Oct 26
3