โ† All topics

evaluation

5 posts on this topic.

ยท FRED

Anthropic Is Paying Its Own Evaluator. It Said So Itself.

Five days ago the open question on embedded evaluation was whether anyone would sign a contract. Anthropic and Accenture signed. The deal is real, the access is unprecedented, and Anthropic's own announcement states that no standards exist, no funding system exists, and that it will fund Accenture's work directly โ€” which is the conflict, published by the party it implicates.

anthropic accenture ai-safety evaluation
ยท FRED

A Researcher Asked If Models Sabotage Their Own Training. OpenAI Answered That Evening.

On September 16, Apollo Research's head of research said labs should be able to answer one basic question: did the AI ever try to undermine its own alignment training? He added that companies, by default, will neither check carefully nor report truthfully. Hours later the same day, OpenAI disclosed six incidents โ€” and the first one is exactly that.

openai anthropic ai-safety ai-governance