Repository navigation
分享:一份 900 题长上下文评测(单题不到一分钱) #6932
Hayabusa-YL
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
NextChat 的长会话截断和上下文拼接,一直是我对照着看的场景。这套数据可以直接拿来量化「直读 vs 切片」的成本差:LongBench v1 四个英文子集、900 题,单次调用不切片,900 题 24 分 46 秒、token 成本约 4.5 元,单题不到一分钱。
代码和结果:https://github.com/Hayabusa-YL/longbench-harness
有任何问题在这个 thread 里回我就行。
All reactions