My question is why these harnesses are even necessary. The cloudflare pipeline is not specific to any codebase, it is just secret sauce they added themselves that increases the costs dramatically. Cloudflare is not an AI company though, Anthropic is, and openai and anthropic have spent tens of millions on signing bonuses for all of the most competent AI researchers in the field.
Why is it cloudflare’s job to make the model useful? Why doesn’t the model do what it says it will without multiplying the token burn rate 5-10x? Why not ship a harness developed by the ai experts, if a harness is truly necessary? The idea of adverserial machine learning is more than a decade old, it’s not like cloudflare stumbled on a new concept.
I believe this is just another attempt to hide the true cost of inference.
Interesting. I should have read the cloudflare article, not just linked it. Of course, anthropic does the bullshit it’s known for.
But I heard several security researchers experimenting with own harnesses. Seems to make quite a difference.
My question is why these harnesses are even necessary. The cloudflare pipeline is not specific to any codebase, it is just secret sauce they added themselves that increases the costs dramatically. Cloudflare is not an AI company though, Anthropic is, and openai and anthropic have spent tens of millions on signing bonuses for all of the most competent AI researchers in the field.
Why is it cloudflare’s job to make the model useful? Why doesn’t the model do what it says it will without multiplying the token burn rate 5-10x? Why not ship a harness developed by the ai experts, if a harness is truly necessary? The idea of adverserial machine learning is more than a decade old, it’s not like cloudflare stumbled on a new concept.
I believe this is just another attempt to hide the true cost of inference.