ChatGPT, Claude aur Gemini jaise AI ke peeche ek LLM hota hai. Aaj hum khud khel kar dekhenge ke yeh machine likhti kaise hai.
Iska sab se bara kaam sirf ek hai: agla lafz guess karna. Bas yehi kaam bar bar, bohat tezi se. Isi se poore jawab, kahaniyan aur code ban jaate hain.
Neeche wala jumla parho. LLM har mumkin lafz ko ek chance (probability) deta hai. Phir unmein se ek chunta hai.
Button dabao aur dekho LLM kaunsa lafz chunta hai.
LLM poore lafz nahi parhta. Woh text ko chhote tukron mein kaat-ta hai jinhein tokens kehte hain. Jaise roti ke niwaale!
Yeh ek asaan simulation hai. Asli LLM ka tokenizer thora mukhtalif kaat-ta hai, lekin idea yehi hai.
Asal LLM ne internet ki arbon (billions) lines parhi hain. Hamara mini model sirf neeche wali lines se seekhega: "is lafz ke baad aksar kaunsa lafz aata hai?"
Kai baar "Likho!" dabao. Har baar thora mukhtalif jumla banega. Model ne jo parha, wahi dohraata hai — naye lafz khud nahi bana sakta.
Nahi! LLM sirf achha lagne wala agla lafz chunta hai, zaroori nahi woh sach ho. Ghalat baat ko poore yaqeen se kehna hallucination kehlata hai. Har jawab ko parkho: