Fable has been a hit or miss for me. It fixed a couple of my Github repos with specialized R packages for uncommon econometrics methods where Opus 4.8 had failed. However, for many apparently mundane requests, it just reverted to Opus.
Anecdotal, but working on a biodiversity-related project has made Fable completely useless to me. It sends literally everything to Opus immediately because it’s related to biology. No word from Anthropic since I sent feedback, so I won’t bother relying on it and I don’t plan to.
I get that it’s biology and there are potential risks in that field, but this is stuff like making sure the name of a worm exists in a database or coordinates where the worm was seen are valid. Fable won’t even inspect the purpose, though.
I totally understand the US admin played a significant role here. I don’t think it was the only role, though. I also think the classifier is way too crude. I doubt I could do better on short notice, or perhaps it’s due to external constraints entirely. Considering the cash my organization dumps on them, we hoped for better. Such a disappointment. We’re all pretty leery now and investigating other models.
I actually posted praising Fable’s code review quality when it first debuted, and someone accused me of being an LLM (ha). This new version gets no praise whatsoever, though. It’s such a contrast.
You apply to their biology program at Anthropic and they'll let you in. This is the same advice I gave here, based on a friend at Stanford going through the same thing: https://news.ycombinator.com/item?id=48778446#48781270
Not sure what to tell you then, that's their process and if you don't like it then you won't be able to use their models for biology, it's as simple as that.
Fable has been a hit or miss for me. It fixed a couple of my Github repos with specialized R packages for uncommon econometrics methods where Opus 4.8 had failed. However, for many apparently mundane requests, it just reverted to Opus.
Anecdotal, but working on a biodiversity-related project has made Fable completely useless to me. It sends literally everything to Opus immediately because it’s related to biology. No word from Anthropic since I sent feedback, so I won’t bother relying on it and I don’t plan to.
I get that it’s biology and there are potential risks in that field, but this is stuff like making sure the name of a worm exists in a database or coordinates where the worm was seen are valid. Fable won’t even inspect the purpose, though.
I totally understand the US admin played a significant role here. I don’t think it was the only role, though. I also think the classifier is way too crude. I doubt I could do better on short notice, or perhaps it’s due to external constraints entirely. Considering the cash my organization dumps on them, we hoped for better. Such a disappointment. We’re all pretty leery now and investigating other models.
I actually posted praising Fable’s code review quality when it first debuted, and someone accused me of being an LLM (ha). This new version gets no praise whatsoever, though. It’s such a contrast.
> I also think the classifier is way too crude
Developing a classifier can be a weird ordeal when you leave the ML world (of making it work) and enter the realm of policy makers applying it.
My guess is they're being ham fisted with little tolerance for false negatives. We can all guess why...
You apply to their biology program at Anthropic and they'll let you in. This is the same advice I gave here, based on a friend at Stanford going through the same thing: https://news.ycombinator.com/item?id=48778446#48781270
I don't think having to rely on the anonymous person's advice on a random forum would make me even less keen to trust Anthropic is right to me.
They raised it with Anthropic and were met with silence (as usual), not advice to join the programme.
Not sure what to tell you then, that's their process and if you don't like it then you won't be able to use their models for biology, it's as simple as that.
Skill issue. I've been building lots of cool things with Fable, it is especially good at one shotting and agent orchestration.
Same. Not sure what it is but I have never hit the guardrails on Fable, and its knowledge and code is seriously impressive.
Fable is utterly useless these days. Just good at burning tokens.