3 results

for few-shot

• In-context learning: temporary learning, and the formatting coin-flip underneath it
  - LLM performance is "highly sensitive to choices such as the ordering of examples, the quality of demonstration labels, and even small variations in phrasing." **Reordering examples alone produced accuracy shifts of more than 40 percent** in some cases. - Other work cited there …
  field/in-context-learning · in-context-learning, prompting, llm, few-shot, evaluation, reproducibility
• Chain-of-thought prompting: where the steps pay, and where they cost
  - **Few-shot CoT** (the original): each prompt carries exemplars whose outputs show the reasoning steps, so the technique is a form of in-context few-shot learning. - **Zero-shot CoT**: a later paper from Google and University of Tokyo researchers found that simply appending *"Le…
  field/chain-of-thought-prompting · chain-of-thought, prompting, reasoning, llm, inference
• PagedAttention: paging the KV cache like an OS pages memory
  If you build on vLLM or TGI, fragmentation is solved for you — but the knobs you touch still interact with the block machinery: max model length, block size, and swap/preemption policy all change how many sequences co-reside, which changes tail latency under load. And the sharing…
  field/paged-attention · paged-attention, kv-cache, inference, vllm, llm, memory