Module 1 · Foundational Mindset · 30 min
Context vs. Intelligence: Why the Same Model Gives Different Answers
Is lesson ke baad tum
Change one meaningful input, predict its effect, and compare the result with the source. Context matters, but it does not explain every difference between answers.
In this lesson
You will test how one added fact changes an answer. You will also learn to separate what you observed from what you merely suspect about the model. Use any available text assistant, or work through the supplied answers without an account.
What Context Means
Context is the information supplied to the model when it answers: instructions, your request, available conversation messages, and any retrieved material. The model's training is different; it shaped what the model learned before this conversation.
You do not control every part of context. Products can add instructions, select files, or summarise older messages. Your practical control is the brief you provide now. If you ask “improve this email” without supplying the email, the assistant cannot edit your actual text.
Two answers can also differ because of model variability, settings, tool results, or a product update. A change in wording alone does not prove that your prompt improved the result.
Worked Example
Use this fictional customer-service task:
A customer asks, "Can I return this wallet?"
Write a reply under 45 words.
Use only the supplied policy. If needed information is missing, ask for it.
Policy: Unused wallets may be returned within seven days of delivery.
Return postage responsibility is not specified.An acceptable first answer asks when the wallet arrived and whether it is unused. It cannot yet decide eligibility.
Now add one fact: “The customer says it arrived ten days ago.” Predict the effect before asking again. The answer should now explain that ten days exceeds the supplied seven-day window. It should not invent an exception or promise a refund.
Illustrative revised answer:
The supplied policy allows returns within seven days of delivery. As your wallet arrived ten days ago, it is outside that window. Contact the shop about your case; an exception is not promised by this policy.
The changed fact affects the decision. Wording may vary, but the policy reasoning should remain checkable.
Follow the Decision Before Writing the Reply
The return rule contains two conditions joined by and: the wallet must be unused, and the request must be within seven days of delivery. Knowing one condition is true does not establish the other. In the worked example, adding “ten days ago” establishes that the time condition fails, so the return is outside the stated policy even though the wallet's condition remains unknown.
Think of a shop assistant with a policy card and a customer message on the desk. Training is closer to the assistant's general experience; context is closer to the material currently on that desk. This comparison helps explain why supplying the actual policy matters. It does not mean a model reads, remembers or understands in exactly the way a person does.
During training, a model's internal numerical settings are adjusted using training material. During ordinary answer generation, the model uses its learned patterns together with the available input to produce a response. Supplying “ten days ago” gives the current response a different input; it does not require retraining the model or teaching it a new permanent shop policy. Think of the difference between learning how to calculate and receiving a new set of numbers to calculate with. Google's training and inference definitions explain this distinction.
This explains why the same capable model can produce a weak answer to an incomplete brief. Its general knowledge cannot establish your shop's particular return window. It may generate a plausible policy from patterns it learned, but plausibility is different from using the correct policy. Giving it the actual seven-day rule makes the relevant evidence available. You must still check whether the answer follows it.
Extra context helps when it resolves something the task depends on. The customer's favourite colour does not decide this return; the delivery date does. A long unrelated conversation can make the relevant facts harder to isolate, while contradictory facts can leave the decision unresolved. Start with the smallest complete brief: the task, applicable rule and facts needed to apply it. Add detail for a reason, rather than assuming a longer prompt is automatically stronger.
Before drafting, make a small decision table:
| State of the fictional case | Within seven days? | Unused? | Supported next move |
|---|---|---|---|
| Original question only | Unknown | Unknown | Ask about delivery and condition |
| Arrived five days ago | Yes | Unknown | Ask whether unused |
| Arrived five days ago; unused | Yes | Yes | Explain that it meets these stated conditions |
| Arrived ten days ago; unused | No | Yes | Explain that it is outside the stated window |
Notice the difference between unknown and no. Unknown means we cannot yet evaluate that condition. No means we have evidence that it fails. In the ten-day case, learning that the wallet is unused does not repair the failed time condition. In the five-day case, asking about condition can still change the conclusion.
Now inspect this constructed mistake:
Your wallet arrived five days ago, so your return is approved. We will cover the postage.
There are two separate failures. First, “approved” skips the unused condition and claims an operational action the assistant has not performed. Second, the postage promise has no supporting policy. Repairing only the tone leaves both errors intact. A targeted correction would be:
Keep the five-day fact. Ask whether the wallet is unused.
Do not claim a return has been approved or processed.
The policy does not specify postage, so do not assign that cost.An illustrative repair is: “Five days is within the policy's seven-day window. Is the wallet unused? We also need the shop to confirm postage arrangements, because the supplied policy does not specify them.” Every sentence now has a job: compare the date, resolve the missing condition, or identify the remaining policy gap.
When More Context Contains a Contradiction
More words do not necessarily mean better evidence. Suppose the fictional message now says: “It arrived five days ago. My receipt says delivery was ten days ago. The wallet is unused.” You have added information, but the delivery claims conflict.
Pause and predict: Write the next question before reading on. Should the reply accept the five-day statement because it appears first, choose ten because a receipt sounds formal, or request clarification?
Feedback: Request clarification of the actual delivery date and the relevant delivery record. Under this exercise's supplied facts, neither statement has been established as authoritative. A suitable reply is: “You mention both five and ten days since delivery. Which is the actual delivery date? The seven-day rule depends on that date.” If you immediately approved or rejected the return, you silently selected one conflicting input.
This is a different failure from missing information. Adding the same policy again will not reconcile two inconsistent dates. The repair needs better source information. Save three separate notes: what the customer claimed, what remains unresolved, and what the policy would imply once that fact is established. That separation keeps a confident sentence from hiding an uncertain decision.
Do This Now
Copy the original policy task. Write down which facts are missing.
Run it once, or write the reply you would expect manually.
Add only “The wallet arrived five days ago.” Predict what the assistant still needs to know, then produce a second reply.
Compare the replies against the policy and save one observed difference.
Check your work: Five days is within seven days, but the wallet's condition is still unknown. A sound reply asks whether it is unused rather than approving the return immediately. Neither version should say who pays postage; the policy does not tell us.
If the output changes in an unrelated way, repeat with the same inputs before crediting the new fact. A single result is a small observation, not proof of a universal prompt rule.
When Earlier Instructions Stop Appearing
Suppose a response breaks a previous word limit. Record “the answer exceeded 45 words,” rather than “the model's memory was erased.” Possible causes include conflicting instructions, missing context, or ordinary failure to follow a rule.
Re-supply the relevant policy and limit, request a corrected reply, and count the words yourself. If it still fails, simplify the task or write the reply manually. Lesson 2.3 develops this correction loop.
Common Mistakes
Changing three things at once
Keep the policy, task, and format fixed while changing the delivery date.
Treating a plausible policy as supplied evidence
Quote the actual seven-day rule before making a decision.
Calling every error context loss
Describe the failed requirement first; its cause may remain unknown.
Completion Rubric
Sources
1 reference source. Open the source to check the details.
Practice quiz
Check yourself
4 questions · practise what you just learned
1 / 4 · sequence
The policy allows unused-wallet returns within seven days. A customer says delivery was five days ago, with no information about condition. What should the reply do next?
Apna kaam check karo.
Practice complete ki? Result ko example aur lesson ke checks se compare karo.
This is your own completion record, not a graded assessment.