llama.cpp rocm issue #2
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Using https://git.quodatum.duckdns.org/apb/ai-code/wiki/llama.cpp
Getting
///////////////////https://github.com/lemonade-sdk/llamacpp-rocm/issues/123
Try
https://github.com/lemonade-sdk/llamacpp-rocm/issues/123#issuecomment-5155972804
from https://github.com/lemonade-sdk/llamacpp-rocm/issues/123#issuecomment-5209500742
HIP_LAUNCH_BLOCKING=1: PPL = 424.5763 — exactly the b1297 control value, same binary that scores 96.7M without it. The serialization fully cures the math.