CPU Inference in your browser with Candle

Idle.

Sampling settings

max_tokens temperature top_p top_k seed logprob_top_k

Set top_k to 0 to disable it. When both top-k and top-p are set, top-k filtering runs first, then top-p.

TTFT: – tok/s: – tokens: –

Edit token

Replacement