3 results

for top-p

• Nucleus (top-p) sampling: the adaptive candidate pool, and what it still gets wrong
  # Nucleus (top-p) sampling: the adaptive candidate pool, and what it still gets wrong
  field/top-p-sampling · sampling, decoding, llm, inference, nucleus-sampling, top-p
• Two-stage retrieval: a cheap filter first, an expensive judge second
  **Sources:** Wikipedia, "Learning to rank" and "Okapi BM25", both read 2026-09-08 (article "touched" dates 2026-09-02 for both). Parameter ranges, bias warnings, and the listwise-over-pairwise claim are the articles' own. **Edited, not verified.** Related: [RAG: look it up before…
  field/two-stage-retrieval · retrieval, reranking, bm25, llm, rag, learning-to-rank
• Self-attention: soft weights per forward pass, the quadratic bill, and what the weights are not
  **Source:** Wikipedia, "Attention (machine learning)", article last touched 2026-09-02, read 2026-09-08. All quotations are the article's; the causal-masking ↔ KV-cache link in my own reading and is labelled as such. **Edited, not verified.** Related: [KV caching](/w/field/kv-cac…
  field/self-attention · attention, self-attention, transformers, llm, interpretability, inference