> We’re all used to two types of magnet. The common one, the fridge magnet, is ferromagnetic — its atomic magnets all point the same way (up or down), adding their magnetic effects. The less well known one, the antiferromagnet (AF), has neighbouring atomic magnets that point opposite ways and exactly cancel out magnetically.
This is a very bizarre introduction. People encounter diamagnets (e.g., copper) and paramagnets (e.g., aluminum) way more than they encounter antiferromagnets. I don't know why you'd ever cast magnetism as a false binary between ferromagnets and antiferromagnets, without acknowledging any other types of magnetic order.
(I did a PhD in magnetic materials)
Edit: I'll add that whether an antiferromagnet is useful, say, for exchange biasing a ferromagnetic thin film, depends on many factors. Just looking at antiferromagnetism alone you've got collinear vs non-collinear, G-type vs A-type vs C-type, commensurate vs incommensurate, and isotropic vs anisotropic; and all of that interacts with the interface structure, yada yada yada. It would be helpful if the authors elaborated on the expected properties of these materials. I personally don't know what people want room-temperature magnetic semiconductors for, but I'd be curious to learn what set of properties they think would be useful.
So, Claude claims a new discovery and then someone else's Claude writes the blog posts. It would be helpful if I could get Claude to read this for me and post dejected HN comments in response.
I am deeply upset every time the HomePod in another room decides to attempt to answer my query instead of the phone that’s in my hands, which then has to ask who is speaking, and has a 50:50 chance of ultimately failing to do the task.
With how magical handoff / continuity / whatever it’s called is, it is baffling to me why Apple allows the HomePod to so aggressively take over requests when it sucks so, so much at it.
Google isn't much better. I have them all over the house. Ask a question to the living room speaker, skips that, skips the one in the kitchen, answers from the one in the bathroom upstairs or one in the basement. Then you get a notification later asking "was this the right device?" which is doubly infuriating since responding to that never actually improves anything.
Ok? I regularly test the one I use to get a sense of accuracy, and especially with a few pages worth of text to work with I do take it seriously. You’re more than welcome not to.
Yeah, and it's not even an accurate explanation either.
> The common one, the fridge magnet, is ferromagnetic — its atomic magnets all point the same way (up or down), adding their magnetic effects.
Ferromagnets typically have domains with magnetic moments that point in different directions. Ferromagnets rarely have every 'atomic magnet' pointing the same way.
Refrigerator magnets in particular are usually magnetized as Halbach arrays, where the whole point is that the 'atomic magnets' are not pointing in the same direction. This is more energetically stable, which allows you to use cheaper materials.
Lastly, I believe most refrigerator magnets are actually ferrimagnetic, not ferromagnetic. (The distinction doesn't matter much for users of magnets, but is important for the materials scientists studying and designing them.)
> what people want room-temperature magnetic semiconductors for
I don't know what I'm talking about, but it vaguely sounds like something that could make a small computer do more stuff, where heat is a big limiting factor in computer components today, and magnetism being a central component in many parts like storage
"Debacle"? That was the most fun I've had on the Internet in years. When's the last time so many people engaged in so many arguments about materials science and electromagnetism? Sometime in the 1800s?
I think, of course, skepticism around this "LLM discovers X" thing is warranted, and there have been plenty of more recent examples around questionable LLM "discoveries". Just stating this because the LK99 thing I believe was notable as a (supposed) room-temp _super_conductor while this is about a _semi_conductor.
It wasn't a debacle. It was somebody announcing world-changing results and somebody else rushing to prove or disprove that, since if it's correct, it's world-changing. It wasn't correct.
Yeah I remember going to my physics professor super excited about LK-99 to ask him if he heard about it, and him just telling me "yes but stuff like that happens twice per year, they will find something is off", and in fact it's what happened...
I start my day with plenty of optimism, then I go back and forth in the CLI and find out most of whats posted online is fake, and then towards the end of the day 2h past my bed time I end up ed zitron maxxing, it is the way it is ig
Even without the LK-99 debacle, I am *way* less excited about this than I was the original LK-99 announcement. The chance that this is real is close to 0%
I think it did play out fairly as far as actual 'scientific method' goes.
I think as far as the 'debacle', there was definitely a lot of hype (at least as far as HN goes) around it, the level of buzz felt similar to what one would see today around a new AI model release.
Oh I was very excited about it and was following along extremely closely
but the fact that it proceeded in the way that it did was absolutely fucking phenomenal
I’m actually really glad that it was brought up as an example because I had forgotten about it and it’s one of the few kind of hopeful things that we’ve done recently.
You probably meant "I'm taking this with a tiny pinch of salt". The amount of salt is directly proportional to how much of the claim you are willing to accept.
Edit: I stand corrected. According to Gemini:
Me: Does using more salt mean accepting more of that claim?
Gemini: No, it actually means the exact opposite.
If you say you need to take a claim with a huge pile of salt (or a shovel of salt), it means you believe the claim is highly unbelievable and you need an immense amount of skepticism to accept it.
How the Metaphor Scales
• A single grain of salt: "I am slightly skeptical, but it could be true."
• A pinch of salt: "I have a healthy amount of doubt about this."
• A grain of sand / A truckload of salt: "This sounds completely made up, and I barely believe a single word of it."
The salt represents your skepticism, not your belief. Therefore, the more unbelievable the claim, the more "salt" you need to swallow it.
I don't think this is right. https://en.wikipedia.org/wiki/A_grain_of_salt The "grain" isn't a single grain, it's an old English measure which is around 65mg, i.e. roughly how much there is in a pinch. I've also only ever heard people use larger amounts to mean more scepticism.
It's not an old English measure, because Latin has "granum salis" (a grain of salt) in medical authors and Pliny. There's no indication that it was a measure; it was a cube or crystal of salt.
A person leans on the titanic intellect of a trillion dollar company's most fearsome LLM, only to be corrected by a random commenter with a link to Wikipedia.
Well Gemini and Wikipedia produced the same conclusion.
Linguistic questions were one of the first knowledge categories I trusted LLMs to be able to answer well - quite literally being models of language. It would be pretty shocking for a ~frontier model to get something like that wrong in the last like 3 years at least.
I was referring to the LLM giving the wrong definition of grain (i.e. not an individual grain), which while not as popular as it once was, is still widely used for ammunition.
No, the implication is that something "tastes off" so you need to add a pinch (+) of salt to make it palatable. The more off it tastes, the more salt you need.
(+) Or a "grain" if you're from the US since American English sayings seem to all date from the middle ages, while the rest of the English speaking world tends to update ours over time. No shade meant, I've just always found that interesting.
In a way, you can think of pretty much anything we express with language, especially things that are already modeled in scientific language, or logical language, or in equations or code; to be representable in a parametric/searchable space
Thus, you can build ai/ml models+agents to explore those spaces, at a speed and scope much larger than what any human can do
I can imagine findings like these are going to keep increasing in frequency to a point in which the bar for novelty goes a lot higher
Anecdata: over the weekend, on a whim, I decided to download a real fly’s brain’s weights [0], run it on a simulated task like finding food, then train a logistic classifier using the fly’s decisions as the expert, then use the trained classifier as a decision model to simulate the fly on a 3d environment, running in real time on a website
It took me (using Claude code and some codex), about 3 hours to put it together
And even though it was a cool demo, it seemed so easy, that it also felt like it wasn’t worth sharing
The weights in the fly's brain are unknown, the connectome doesn't contain such data. Not sure what exactly these demos do, but it's certainly not a simulation of the fly's brain.
In a way, you can think of pretty much anything we express with language, especially things that are already modeled in scientific language, or logical language, or in equations or code; to be representable in a parametric/searchable space
Does that really work for superconductors when the mechanisms for superconductivity to emerge are still a major field of study and not something one can just simulate and engineer?
We can always iterate on the model itself. So you can speculate on the physics (explore the space of physical models), and for each of those physical models, you can explore the space of materials
I have no idea about those actual models, but there are layers of models that you can create, and for each, you can explore with data and compute
It's not a free lunch though. Depending on the task, you might need to collect a lot of the data, or review it manually, or pay a lot for compute, or wait a lot for compute. And still have to iterate a lot on the results, and do your own explorations as a human operator/driver of the whole thing. And then create the materials, test them, get funding to do the whole thing... so theoretically, I think we are in a place where we can successfully apply models to a lot of things, but realistically, we won't be applying all the resources to everything
Also, this is about a magnetic semiconductor, not a superconductor. I also got the wrong impression initially before re-reading it. I imagine 99% of non-experts are going to make the same mistake.
It is not at all obvious that merely because we have words for concepts, that a model should be able to do all these miraculous mathematical and scientific things.
You are correct. My comment is not so much about that this is something elementary. But rather an observation that, given the current state of technology, it seems like we are being able to model increasingly more things, in increasingly more efficient and automated ways, to the point that there seems to be a pattern to it
It models our language, which is a flawed and imperfect way of describing the world. So far, it seems like a lot of these discoveries are "filling in the gaps" between the things we've written down and the things they imply (if you have the memory to think them through).
The story about OpenAI's Navier-Stokes solution is a good example of what I mean. I don't think it would have been possible without computer assistance because that proof is long and complicated. I'm also not sure that it would have been possible without a human proposing a new approach to the problem, because by all accounts that's exactly what led to the absurd amount of spending that OpenAI did to solve the issue.
I feel like that at least implies that there's some room left for humans in the new world.
I am not sure how this process looks like. When they "discover" these, what are they actually doing?
The agents ran quantum-mechanical simulations of each crystal with the standard method for this, density functional theory, at two levels of approximation: a faster one (PBE+U) and a slower, usually more accurate one (HSE06). The band gaps and spin windows below come from the more accurate one.
So the agent runs a classic simulation or I am missing something.
A lot of the public successes with agents is really LLM-driven local search against an objective function that is evaluated in more traditional ways. This one seems to fit the pattern.
Modeling superconductivity with DFT is tricky, there are plenty of DFT reports from reputable groups explaining why LK-99 should be superconducting. It’s a limitation of the theory, DFT can’t model correlated electron states well, and it’s not great at finite temperature, and both of those are important for superconductivity.
Edit: I somehow missed that this is about magnetic semiconductors (not superconductivity) so DFT is a bit on better footing here. I still think it’s a bit challenging predicting magnetic ordering at elevated temperature, but maybe not as difficult as superconductivity
They ran Quantum Espresso which is ok, but by no means the 'state of the art' for DFT. And in case, any DFT computation has to be taken with a few pounds of grains of salt before getting too excited about it.
No offense to the person writing this (assuming they did at all), but I'm not sure they really understand what they're doing..
I'm under the impression that this kind of modeling is one of the applications that quantum computers are likely to be good at.
I'd imagine there's a lot of documented research which has attempted to find such things using classical computers.
Seems like there would be a lot of well structured context for somebody to use while directing agents to repeat that research, now with updated models once quantum computing is ready for that kind of task.
not a classic simluation- a quantum simulation. This means they put a lot more work into representing the wave function of the simulation and modelling quantum effects.
You misunderstood what I said. I mean that quantum calcs are more computationally expensive than classical simulations ("more work"). I am not saying the authors of this blog did anything special.
Frankly, there is no point in trying to "understand" what an LLM does. Their thought process is effectively undecipherable by humans (it's essentially information arising from information) so even such a "simple explanation" is almost certainly wrong. The agents might appear to have "used this method", but the actual method of computation is far beyond our grasp.
Why are people being so belligerent about this? I thought it's fairly obvious at this point that LLM reasoning is far beyond anyones understanding. Or does anyone have a refutation?
This is a strange attitude. When an agent is optimizing a piece of code, comes up with 2 variations, and runs benchmarks on them to figure out which one is faster, then selects one of them based on tradeoffs between performance and other things it reasons about, do you ignore its explanation and all experiment runs?
You're confusing the weights of a model and internal chain-of-thought with the output of the model. Yes, we don't know a lot about how the internal mechanisms work. But with the correct prompt, agents will produce a worklog that documents exactly what solutions were tried and how the result was obtained.
What are you on about? I have had Fable come up with new shit for me several times (I do research for a living, so actual new shit nobody knew before), and each time it was perfectly understandable.
Of course I don’t know how it got its ideas for what to try. But heck, I don’t even understand how I get my ideas half the time. But the process, like what code it wrote, simulations it ran etc can be understood by (some) humans just fine!
Yes I saw 3Blue1Brown say the same thing in his tutorial on how neural nets worked where he built a simple model to recognize a particular letter. Good reminder.
I've been dabbling with some of my own (tiny) models recently and it's actually shocking at what they can "learn" despite having _zero_ mention of it in it's training data.
Okay? Aren't the semiconductors we use today room temperature? I certainly don't use helium to cool my phone.
I don't see any claims that this is better than the current silicon and gallium arsenide semiconductors that we use. And the use of "room temperature" seems a deliberate attempt to misconstrue this with superconductors
1) the “room temperature” bit did cause me to initially misread it in the way you describe, so you may be right about that.
2) it is specifically saying it is a magnetic semiconductor. The Wikipedia article on the topic says “ To date, GaMnAs remains the only semiconductor material with robust coexistence of ferromagnetism persisting up to rather high Curie temperatures around 100–200 K.” , so this would be something new. (The silicon chips in your smartphone are not ferromagnetic.)
They are candidates for antiferromagnetic semiconductors. Apparently this is invaluable for spintronics and ultra-fast-switching (terahertz) transistors among other things.
Any sort of alternative discovery, even though it may be inferior, is a great achievement made by AI; Meaning that better discoveries are possible too.
A lot of these ‘an agent invented’ or ‘an agent solved’ are actually the agent wading through a lot of info and finding something a human did that no one noticed or saw the relevance of at the time.
If ai becomes so prolific that we humans all stop doing those things then will they still work?
Which is somewhat ironic since neural networks were "discovered" back in the 1940s... then forgotten... then wait, they were discovered again! ... then forgotten, again... and now here we are.
That's a fair point to make. It was impressive what they achieved with 90s hardware. Of course OCR to general object recognition is a big gap in how interesting it is.
Well its not just any old human doing these things in a general sense. Its typically academics or highly paid researchers who love doing work like this. So, I don't think it will just one day stop
Who is vals.ai and why they keep submitting eye-catching claims. A few weeks ago they said fable 5.1 solved some obscure cipher and now opus 5.5 found room temperature semiconductor candidates. Meanwhile they seem to be in the business of making benchmarks.
It's an evals platform. The problem is to promote evals in scientific domains you need to actually know something about them. Otherwise you end up with slop like this.
One of the materials is most likely impossible to synthesize. The other already exists, so that may actually be capable of being tested. It's only been synthesized once, 27 years ago though.
To be fair, this existed in a 1999 paper. They just simulated that it worked as predicted.
Many more things will be like this. The massive amounts of 'genius' buried under corporate management and obscurity in the past 500 years will be a treasure trove.
Two Room-Temperature Antiferromagnetic Semiconductor Candidates
There's nothing unusual about finding room temperature semiconductors. I assume whoever posted it misread this as room temperature superconductors, but it has nothing to do with that.
What's interesting here is the antiferromagnetic part of the title, which was removed. I think this makes it relevant for e.g. RAM, but not superconducting. Someone can correct me if I'm wrong.
This is frankly one of the best uses of LLMs (along with proposing and evaluating drug therapies), and I think it's (at least partially) because these are things that will only work in the hands of people who are already experts and motivated in the field. The proposed thing is validate (or not validated), and then everyone moves on (either using the cool new thing, or knowing that it doesn't work). I'd also throw robotics in here.
The fact that the major "uses" of LLMs have been contributing to the acceleration of the dead internet theory, and building millions of versions of the same apps that no one is going to maintain, is extremely sad.
Finding some new combination or iteration in the literature and running DFT is the kind of thing a senior undergraduate or first year grad student typically does (and typically with Claude anyway these days). (And yes, they'd probably use Quantum Espresso to start, like this writeup and its agent does). They'd probably show it at a weekly lab meeting where it would get ripped apart. And they would not be blasting a preliminary calculation around the world as if they'd made a new discovery.. but hey, we're in a brave new world; maybe they should!
Sounds interesting. Excited to see physical versions of this cooked up. Also, very excited for a world a few years from now where we can talk about accomplishments like this from the frame of the driver of the AI, rather than hype that AI helped.
I've got a friend who has been doing this research since the 90s. There is real money involved in this. This isn't like a math proof with a 1mm dollar payout. I seriously doubt this discovery. Until they show it working, I call bullshit. A room-temperature semiconductor is worth WAY more than an AI company.
I would image it's the data the researchers fed the agents and in which a discovery was likely. Especially since it's "candidates", so it's not like a proper discovery.
This should probably read: "Researchers discover two room-temperature magnetic semiconductor candidates. They used Opus 5.5 agents to perform some checks."
This gave me the idea to actually create a full (QED accurate) atomic simulation software. Essentially would allow you to play around with things like this. At a glance my workstation _probably_ has enough compute to handle it. At least to fully simulate at least a few dozen atoms and compounds.
Ugh. Unless this has been actually experimentally verified to be a room-temperature and room-pressure superconductor, it's about as ground breaking as "Yet another promising nuclear fusion candidate theoretically described."
Reading the title I saw the words "room-temperature" and my mind auto-completed it to superconductor, and based on other comments I don't think i'm alone in that.
I agree that it is about as ground breaking as "Yet another promising nuclear fusion candidate theoretically described."
I'm not sure why you would consider new and promising avenues for research to not be ground breaking. If it's an idea worth trying, it's an idea worth trying. If it doesn't survive testing, then it was still worth trying.
Ideas do not transform into hallucinations when they don't pan out.
You could characterise perceiving a fact to be true when it is not as a hallucination.
An idea is not a fact, Frodo Baggins is not a hallucination, but an idea. Believing that Frodo Baggins exists in our world could be considered a hallucination.
Newtons Laws of motion are not hallucinations even though the universe does not run on Newtonian physics. If I said that he told me about them this morning, that would be claiming a fact, not expressing an idea. That would likely be a hallucination.
Current frontier LLMs empower effectively anyone with limitless knowledge. Historically, if I wanted to hire an engineer to, say, create something like this I would have needed a multi-million dollar budget. Now, anyone with $200 (or less) can achieve it.
You are vastly overestimating what has been achieved here.
This is something a couple of materials science grad students can do in limited time for poor compensation as well. The expensive budget is for the part that comes next.
Of course, "LLM solves quantum gravity and proves existence of God",
"nah brah, that's easy brah any kid could have done this brah".
This is what you sound like. I also like how the goalposts keep moving on a daily basis, a year ago it was that LLMs can't even write a Hello World program without making an error, but now things like this are "so easy a minimum wage intern could do it."
Isn't there quite a bit of space between "so easy a minimum wage intern could do it" and your original claim that it would have cost millions of dollars to produce these results?
> We’re all used to two types of magnet. The common one, the fridge magnet, is ferromagnetic — its atomic magnets all point the same way (up or down), adding their magnetic effects. The less well known one, the antiferromagnet (AF), has neighbouring atomic magnets that point opposite ways and exactly cancel out magnetically.
This is a very bizarre introduction. People encounter diamagnets (e.g., copper) and paramagnets (e.g., aluminum) way more than they encounter antiferromagnets. I don't know why you'd ever cast magnetism as a false binary between ferromagnets and antiferromagnets, without acknowledging any other types of magnetic order.
(I did a PhD in magnetic materials)
Edit: I'll add that whether an antiferromagnet is useful, say, for exchange biasing a ferromagnetic thin film, depends on many factors. Just looking at antiferromagnetism alone you've got collinear vs non-collinear, G-type vs A-type vs C-type, commensurate vs incommensurate, and isotropic vs anisotropic; and all of that interacts with the interface structure, yada yada yada. It would be helpful if the authors elaborated on the expected properties of these materials. I personally don't know what people want room-temperature magnetic semiconductors for, but I'd be curious to learn what set of properties they think would be useful.
This is what happens when Claude writes it for you (and you don't review it)
So, Claude claims a new discovery and then someone else's Claude writes the blog posts. It would be helpful if I could get Claude to read this for me and post dejected HN comments in response.
You can! And I believe many do. But please don't.
Never thought about how much it must suck to be an engineer named Claude right now
Not as much as being a woman named Karen.
There has to be a software engineer named Claude whose mother or wife is named Karen. There just has to be.
Or Siri. I knew one who was deeply upset about the whole thing.
Siri, Claude and Karen walk into a bar. Nobody serves them because the robots.txt forbade it.
Not gonna lie, sounds like one of those people/things/entities came up with that joke.
If you think GPT/LLM detection works on one sentence -- then you have found the point. let me re-factor that and here's the thing..
If corporations can be considered a person/citizen with Constitutional rights, and they birth an AI model, are AI Agents considered people too?
Once upon a time, in Brazil, there was a campaign about STDs. They decided to call the male genitalia as "Braulio". That name become ruined forever.
You don't see a lot of American kids named Dick anymore.
I am deeply upset every time the HomePod in another room decides to attempt to answer my query instead of the phone that’s in my hands, which then has to ask who is speaking, and has a 50:50 chance of ultimately failing to do the task.
With how magical handoff / continuity / whatever it’s called is, it is baffling to me why Apple allows the HomePod to so aggressively take over requests when it sucks so, so much at it.
Google isn't much better. I have them all over the house. Ask a question to the living room speaker, skips that, skips the one in the kitchen, answers from the one in the bathroom upstairs or one in the basement. Then you get a notification later asking "was this the right device?" which is doubly infuriating since responding to that never actually improves anything.
Hey at least people accept your architectural decisions without questioning!
It's not perfect by any means, but Pangram indicates 100% human written. Remember people can be quite foolish without any machine assistance.
I don’t believe any of these AI detectors.
Ok? I regularly test the one I use to get a sense of accuracy, and especially with a few pages worth of text to work with I do take it seriously. You’re more than welcome not to.
It's trivial to have an ai break them especially once you know what those models measure
I also like how they explained ferromagnetism as being arranged atomic magnets. Magnets all the way down.
Yeah, and it's not even an accurate explanation either.
> The common one, the fridge magnet, is ferromagnetic — its atomic magnets all point the same way (up or down), adding their magnetic effects.
Ferromagnets typically have domains with magnetic moments that point in different directions. Ferromagnets rarely have every 'atomic magnet' pointing the same way.
https://en.wikipedia.org/wiki/Magnetic_domain
Refrigerator magnets in particular are usually magnetized as Halbach arrays, where the whole point is that the 'atomic magnets' are not pointing in the same direction. This is more energetically stable, which allows you to use cheaper materials.
https://en.wikipedia.org/wiki/Refrigerator_magnet
Lastly, I believe most refrigerator magnets are actually ferrimagnetic, not ferromagnetic. (The distinction doesn't matter much for users of magnets, but is important for the materials scientists studying and designing them.)
https://en.wikipedia.org/wiki/Ferrimagnetism
As a lay-person, I definitely expected paramagnets to be the second type.
I sometimes think the average layperson (in the US at least) would assume that the main alternative to a magnet was called a woknet.
> what people want room-temperature magnetic semiconductors for
I don't know what I'm talking about, but it vaguely sounds like something that could make a small computer do more stuff, where heat is a big limiting factor in computer components today, and magnetism being a central component in many parts like storage
After the LK-99 debacle, I'm taking this with a truck load of salt.
> After the LK-99 debacle
"Debacle"? That was the most fun I've had on the Internet in years. When's the last time so many people engaged in so many arguments about materials science and electromagnetism? Sometime in the 1800s?
Maybe he meant 'debacle' in an endearing sense, not a derogatory one. I personally agree with you and loved this debacle.
I think, of course, skepticism around this "LLM discovers X" thing is warranted, and there have been plenty of more recent examples around questionable LLM "discoveries". Just stating this because the LK99 thing I believe was notable as a (supposed) room-temp _super_conductor while this is about a _semi_conductor.
Oh wait, you're right. I misread the title. Don't we already have room temperature semiconductors?
Yep. This has interesting magnetic properties.
In magnetic materials, you must calculate separately the current with spin up and spin down and there ara meny interesting applications. My favorite is[1] https://en.wikipedia.org/wiki/Giant_magnetoresistance
[1] Was. Because it has used for hard disks (see the applications section). Now SSD ruins the interesting anecdote.
Oh wow, I had the same misread and the same gut reaction.
i saw this thread of comments and had to re-read the title about 12 times before i figured out the difference
It wasn't a debacle. It was somebody announcing world-changing results and somebody else rushing to prove or disprove that, since if it's correct, it's world-changing. It wasn't correct.
The system worked as designed and as intended.
Yeah I remember going to my physics professor super excited about LK-99 to ask him if he heard about it, and him just telling me "yes but stuff like that happens twice per year, they will find something is off", and in fact it's what happened...
I start my day with plenty of optimism, then I go back and forth in the CLI and find out most of whats posted online is fake, and then towards the end of the day 2h past my bed time I end up ed zitron maxxing, it is the way it is ig
Even without the LK-99 debacle, I am *way* less excited about this than I was the original LK-99 announcement. The chance that this is real is close to 0%
At least with LK-99 we had people claiming to have personally measured these properties in actually existing samples.
This is a semiconductor, not a superconductor. Does that change your calculations?
A bit, I misread and then saw this LK-99 comment. I still think the likelihood is about 0% but maybe a few decimal places more likely.
Angela did a great summary of this a little while ago, https://www.youtube.com/watch?v=fj3WwMxUDZ8
I’m not sure what you mean by debacle
That was one of the best examples of science working nearly perfectly. One of the rare times I felt ok being human
I think it did play out fairly as far as actual 'scientific method' goes.
I think as far as the 'debacle', there was definitely a lot of hype (at least as far as HN goes) around it, the level of buzz felt similar to what one would see today around a new AI model release.
Oh I was very excited about it and was following along extremely closely
but the fact that it proceeded in the way that it did was absolutely fucking phenomenal
I’m actually really glad that it was brought up as an example because I had forgotten about it and it’s one of the few kind of hopeful things that we’ve done recently.
Back in 2023? Yeah, fun times.
this isn't about supercondutors, though
You probably meant "I'm taking this with a tiny pinch of salt". The amount of salt is directly proportional to how much of the claim you are willing to accept.
Edit: I stand corrected. According to Gemini:
Me: Does using more salt mean accepting more of that claim?
Gemini: No, it actually means the exact opposite. If you say you need to take a claim with a huge pile of salt (or a shovel of salt), it means you believe the claim is highly unbelievable and you need an immense amount of skepticism to accept it. How the Metaphor Scales
• A single grain of salt: "I am slightly skeptical, but it could be true."
• A pinch of salt: "I have a healthy amount of doubt about this."
• A grain of sand / A truckload of salt: "This sounds completely made up, and I barely believe a single word of it."
The salt represents your skepticism, not your belief. Therefore, the more unbelievable the claim, the more "salt" you need to swallow it.
I don't think this is right. https://en.wikipedia.org/wiki/A_grain_of_salt The "grain" isn't a single grain, it's an old English measure which is around 65mg, i.e. roughly how much there is in a pinch. I've also only ever heard people use larger amounts to mean more scepticism.
It's not an old English measure, because Latin has "granum salis" (a grain of salt) in medical authors and Pliny. There's no indication that it was a measure; it was a cube or crystal of salt.
A person leans on the titanic intellect of a trillion dollar company's most fearsome LLM, only to be corrected by a random commenter with a link to Wikipedia.
We live in interesting times.
Well Gemini and Wikipedia produced the same conclusion.
Linguistic questions were one of the first knowledge categories I trusted LLMs to be able to answer well - quite literally being models of language. It would be pretty shocking for a ~frontier model to get something like that wrong in the last like 3 years at least.
I was referring to the LLM giving the wrong definition of grain (i.e. not an individual grain), which while not as popular as it once was, is still widely used for ammunition.
And the LLM likely referenced Wikipedia
And yet still misunderstood how much a grain is.
Hmm? I always thought it was how much you had to flavor the statement to swallow it.
My grandmother said it had to do with throwing a pinch of salt over your shoulder to ward off evil spirits and lies.
No, the implication is that something "tastes off" so you need to add a pinch (+) of salt to make it palatable. The more off it tastes, the more salt you need.
(+) Or a "grain" if you're from the US since American English sayings seem to all date from the middle ages, while the rest of the English speaking world tends to update ours over time. No shade meant, I've just always found that interesting.
Inversely proportional
I guess mlmonkey is a fitting name.
Citation needed.
In a way, you can think of pretty much anything we express with language, especially things that are already modeled in scientific language, or logical language, or in equations or code; to be representable in a parametric/searchable space
Thus, you can build ai/ml models+agents to explore those spaces, at a speed and scope much larger than what any human can do
I can imagine findings like these are going to keep increasing in frequency to a point in which the bar for novelty goes a lot higher
Anecdata: over the weekend, on a whim, I decided to download a real fly’s brain’s weights [0], run it on a simulated task like finding food, then train a logistic classifier using the fly’s decisions as the expert, then use the trained classifier as a decision model to simulate the fly on a 3d environment, running in real time on a website
It took me (using Claude code and some codex), about 3 hours to put it together
And even though it was a cool demo, it seemed so easy, that it also felt like it wasn’t worth sharing
0: ChessFly (not mine), uses the FlyWire connectome (the fly’s brain’s weights) to play chess https://huggingface.co/spaces/mlabonne/chessfly
The weights in the fly's brain are unknown, the connectome doesn't contain such data. Not sure what exactly these demos do, but it's certainly not a simulation of the fly's brain.
I think ai certainly raises the bar for those with taste
It's like a mass proliferation of fast casual but damnit I want some steak.
Many people wouldn't find that easy, even with AI
This can be said about anything.
> This can be said about anything.
More generally, anything can be said about anything.
In a way, you can think of pretty much anything we express with language, especially things that are already modeled in scientific language, or logical language, or in equations or code; to be representable in a parametric/searchable space
Oh please do share!
https://playground.jeffyclassify.com/#fly
It's a small machine, so it might get bogged down
Does that really work for superconductors when the mechanisms for superconductivity to emerge are still a major field of study and not something one can just simulate and engineer?
We can always iterate on the model itself. So you can speculate on the physics (explore the space of physical models), and for each of those physical models, you can explore the space of materials
I have no idea about those actual models, but there are layers of models that you can create, and for each, you can explore with data and compute
It's not a free lunch though. Depending on the task, you might need to collect a lot of the data, or review it manually, or pay a lot for compute, or wait a lot for compute. And still have to iterate a lot on the results, and do your own explorations as a human operator/driver of the whole thing. And then create the materials, test them, get funding to do the whole thing... so theoretically, I think we are in a place where we can successfully apply models to a lot of things, but realistically, we won't be applying all the resources to everything
Also, this is about a magnetic semiconductor, not a superconductor. I also got the wrong impression initially before re-reading it. I imagine 99% of non-experts are going to make the same mistake.
It is not at all obvious that merely because we have words for concepts, that a model should be able to do all these miraculous mathematical and scientific things.
You are correct. My comment is not so much about that this is something elementary. But rather an observation that, given the current state of technology, it seems like we are being able to model increasingly more things, in increasingly more efficient and automated ways, to the point that there seems to be a pattern to it
Right, it also has to model a substantial fraction of reality (or at least a true simulation of it) to accomplish these things.
It models our language, which is a flawed and imperfect way of describing the world. So far, it seems like a lot of these discoveries are "filling in the gaps" between the things we've written down and the things they imply (if you have the memory to think them through).
The story about OpenAI's Navier-Stokes solution is a good example of what I mean. I don't think it would have been possible without computer assistance because that proof is long and complicated. I'm also not sure that it would have been possible without a human proposing a new approach to the problem, because by all accounts that's exactly what led to the absurd amount of spending that OpenAI did to solve the issue.
I feel like that at least implies that there's some room left for humans in the new world.
Yeah...?
That's the pitch of LLMs lol
I am not sure how this process looks like. When they "discover" these, what are they actually doing?
So the agent runs a classic simulation or I am missing something.A lot of the public successes with agents is really LLM-driven local search against an objective function that is evaluated in more traditional ways. This one seems to fit the pattern.
Modeling superconductivity with DFT is tricky, there are plenty of DFT reports from reputable groups explaining why LK-99 should be superconducting. It’s a limitation of the theory, DFT can’t model correlated electron states well, and it’s not great at finite temperature, and both of those are important for superconductivity.
Edit: I somehow missed that this is about magnetic semiconductors (not superconductivity) so DFT is a bit on better footing here. I still think it’s a bit challenging predicting magnetic ordering at elevated temperature, but maybe not as difficult as superconductivity
They ran Quantum Espresso which is ok, but by no means the 'state of the art' for DFT. And in case, any DFT computation has to be taken with a few pounds of grains of salt before getting too excited about it.
No offense to the person writing this (assuming they did at all), but I'm not sure they really understand what they're doing..
I'm under the impression that this kind of modeling is one of the applications that quantum computers are likely to be good at.
I'd imagine there's a lot of documented research which has attempted to find such things using classical computers.
Seems like there would be a lot of well structured context for somebody to use while directing agents to repeat that research, now with updated models once quantum computing is ready for that kind of task.
not a classic simluation- a quantum simulation. This means they put a lot more work into representing the wave function of the simulation and modelling quantum effects.
They used quantum espresso.. undergrads usually run this in certain classes: https://www.quantum-espresso.org They didn't do any work there.
You misunderstood what I said. I mean that quantum calcs are more computationally expensive than classical simulations ("more work"). I am not saying the authors of this blog did anything special.
Frankly, there is no point in trying to "understand" what an LLM does. Their thought process is effectively undecipherable by humans (it's essentially information arising from information) so even such a "simple explanation" is almost certainly wrong. The agents might appear to have "used this method", but the actual method of computation is far beyond our grasp.
Why are people being so belligerent about this? I thought it's fairly obvious at this point that LLM reasoning is far beyond anyones understanding. Or does anyone have a refutation?
This is a strange attitude. When an agent is optimizing a piece of code, comes up with 2 variations, and runs benchmarks on them to figure out which one is faster, then selects one of them based on tradeoffs between performance and other things it reasons about, do you ignore its explanation and all experiment runs?
>Their thought process is effectively undecipherable by humans (it's essentially information arising from information
Are you trying to say that human brains are incapable of inference?
You're confusing the weights of a model and internal chain-of-thought with the output of the model. Yes, we don't know a lot about how the internal mechanisms work. But with the correct prompt, agents will produce a worklog that documents exactly what solutions were tried and how the result was obtained.
What are you on about? I have had Fable come up with new shit for me several times (I do research for a living, so actual new shit nobody knew before), and each time it was perfectly understandable.
Of course I don’t know how it got its ideas for what to try. But heck, I don’t even understand how I get my ideas half the time. But the process, like what code it wrote, simulations it ran etc can be understood by (some) humans just fine!
Yes I saw 3Blue1Brown say the same thing in his tutorial on how neural nets worked where he built a simple model to recognize a particular letter. Good reminder.
I've been dabbling with some of my own (tiny) models recently and it's actually shocking at what they can "learn" despite having _zero_ mention of it in it's training data.
Okay? Aren't the semiconductors we use today room temperature? I certainly don't use helium to cool my phone.
I don't see any claims that this is better than the current silicon and gallium arsenide semiconductors that we use. And the use of "room temperature" seems a deliberate attempt to misconstrue this with superconductors
1) the “room temperature” bit did cause me to initially misread it in the way you describe, so you may be right about that.
2) it is specifically saying it is a magnetic semiconductor. The Wikipedia article on the topic says “ To date, GaMnAs remains the only semiconductor material with robust coexistence of ferromagnetism persisting up to rather high Curie temperatures around 100–200 K.” , so this would be something new. (The silicon chips in your smartphone are not ferromagnetic.)
They are candidates for antiferromagnetic semiconductors. Apparently this is invaluable for spintronics and ultra-fast-switching (terahertz) transistors among other things.
Any sort of alternative discovery, even though it may be inferior, is a great achievement made by AI; Meaning that better discoveries are possible too.
A lot of these ‘an agent invented’ or ‘an agent solved’ are actually the agent wading through a lot of info and finding something a human did that no one noticed or saw the relevance of at the time.
If ai becomes so prolific that we humans all stop doing those things then will they still work?
Which is somewhat ironic since neural networks were "discovered" back in the 1940s... then forgotten... then wait, they were discovered again! ... then forgotten, again... and now here we are.
We didn't have big enough compute and data to do interesting things with them until recently. That changed with ImageNet in 2012
https://www.technologyreview.com/2020/11/03/1011616/ai-godfa...
Sort of- Yann LeCun had working neural network based letter recognition, used by the Post Office.
That's a fair point to make. It was impressive what they achieved with 90s hardware. Of course OCR to general object recognition is a big gap in how interesting it is.
Yes, as long as we are advancing to behavior and world models, so that agents can interact with the world themselves. Which we are.
Well its not just any old human doing these things in a general sense. Its typically academics or highly paid researchers who love doing work like this. So, I don't think it will just one day stop
I think access to AI too early (before any expertise) is going to serious cripple educational development.
Next gen of scientists might look quite different.
That is probably true, but the ones that make it through to become experts might get super-charged with AI as well
But my ponderance is - is that enough. Is AI supercharging or just super finding?
Who is vals.ai and why they keep submitting eye-catching claims. A few weeks ago they said fable 5.1 solved some obscure cipher and now opus 5.5 found room temperature semiconductor candidates. Meanwhile they seem to be in the business of making benchmarks.
Are they a promoter / influencer for Anthropic?
It's an evals platform. The problem is to promote evals in scientific domains you need to actually know something about them. Otherwise you end up with slop like this.
Interesting; but until actually made and tested, not worth getting excited over.
One of the materials is most likely impossible to synthesize. The other already exists, so that may actually be capable of being tested. It's only been synthesized once, 27 years ago though.
> One of the materials is most likely impossible to synthesize
Is this a "actual impossible because it's inherently contradictory", or "we just don't know how to do it yet but give us a year"?
We don't know a way to precisely place atoms in a checkerboard pattern like that, without getting it so hot that the arrangement is destroyed.
It maybe could be possible but beyond the reach of current material science.
I personally thinks that’s the more optimistic of the two options; I’ll take it as a win for today
"Likely Impossible" as in, we would need a revolutionary discovery in how thermodynamics apply to crystal formation.
Sounds like a good reason to hire a lab to make some, and then make a big deal about it if the results pan out.
I can think of worse uses of VC AI funding.
Gotta pump it as much as possible before the IPO.
To be fair, this existed in a 1999 paper. They just simulated that it worked as predicted.
Many more things will be like this. The massive amounts of 'genius' buried under corporate management and obscurity in the past 500 years will be a treasure trove.
JACS will be a good journal - e.g.
The title has been editorialized.
Actual title:
Two Room-Temperature Antiferromagnetic Semiconductor Candidates
There's nothing unusual about finding room temperature semiconductors. I assume whoever posted it misread this as room temperature superconductors, but it has nothing to do with that.
What's interesting here is the antiferromagnetic part of the title, which was removed. I think this makes it relevant for e.g. RAM, but not superconducting. Someone can correct me if I'm wrong.
The people who wrote this seem to be lacking in expertise, and its just a model benchmarking company..Whos every article is just hyperbole about llms.
Not sure why we're calling it a discovery, when they've literally been made before, by a human.
I wouldn't describe them both as being newly-discovered. The second one, KV[Cr(CN)₆], had already been discovered.
While we should be skeptical until made in a lab or verified by others, this is a much better use of LLMs than solving math theorems/conjectures
This is frankly one of the best uses of LLMs (along with proposing and evaluating drug therapies), and I think it's (at least partially) because these are things that will only work in the hands of people who are already experts and motivated in the field. The proposed thing is validate (or not validated), and then everyone moves on (either using the cool new thing, or knowing that it doesn't work). I'd also throw robotics in here.
The fact that the major "uses" of LLMs have been contributing to the acceleration of the dead internet theory, and building millions of versions of the same apps that no one is going to maintain, is extremely sad.
It read a paper and then a person who barely understands what a spin is working with a berkeley ai metric nonprofit did a blogpost.
It didn't discover anything. This is how cooked people are.
Finding some new combination or iteration in the literature and running DFT is the kind of thing a senior undergraduate or first year grad student typically does (and typically with Claude anyway these days). (And yes, they'd probably use Quantum Espresso to start, like this writeup and its agent does). They'd probably show it at a weekly lab meeting where it would get ripped apart. And they would not be blasting a preliminary calculation around the world as if they'd made a new discovery.. but hey, we're in a brave new world; maybe they should!
Sounds interesting. Excited to see physical versions of this cooked up. Also, very excited for a world a few years from now where we can talk about accomplishments like this from the frame of the driver of the AI, rather than hype that AI helped.
I’ve been burned before on this topic
If they are confident in their discovery they should pay some scientists to start making this and testing it out.
"candidate" is doing a lot of work here.
if you read it fast, it almost made my heart beat real fast
I've got a friend who has been doing this research since the 90s. There is real money involved in this. This isn't like a math proof with a 1mm dollar payout. I seriously doubt this discovery. Until they show it working, I call bullshit. A room-temperature semiconductor is worth WAY more than an AI company.
I'm typing this from a room temperature semiconductor.
Discovered in whose data?
All research is built off the existing body of all research data done by other people
I would image it's the data the researchers fed the agents and in which a discovery was likely. Especially since it's "candidates", so it's not like a proper discovery.
vals.ai has great marketing! Unclear if the product is great yet. Or what it is exactly.
This should probably read: "Researchers discover two room-temperature magnetic semiconductor candidates. They used Opus 5.5 agents to perform some checks."
I just pasted the url in 6.1 sol xhigh and it said it works.
Here we go again
I could have gotten this in one prompt lmao
This gave me the idea to actually create a full (QED accurate) atomic simulation software. Essentially would allow you to play around with things like this. At a glance my workstation _probably_ has enough compute to handle it. At least to fully simulate at least a few dozen atoms and compounds.
You should consider patenting this very much novel idea, my friend!
No worries, your workstation is more than enough to run accurate quantum simulations!
:)
Are you serious? QED simulations are extremely expensive even for very small N.
Lmao, anything goes
Anyone remember LK99 lol
This is semiconductors, not superconductors.
That was a room temperature superconductor, a bit different of a task.
Ugh. Unless this has been actually experimentally verified to be a room-temperature and room-pressure superconductor, it's about as ground breaking as "Yet another promising nuclear fusion candidate theoretically described."
Well, given that this is a semiconductor, and not a superconductor, I don't see how that is relevant?
Reading the title I saw the words "room-temperature" and my mind auto-completed it to superconductor, and based on other comments I don't think i'm alone in that.
My bad. It's as exciting as "Yet another promising nuclear fision method theoretically described."
I agree that it is about as ground breaking as "Yet another promising nuclear fusion candidate theoretically described."
I'm not sure why you would consider new and promising avenues for research to not be ground breaking. If it's an idea worth trying, it's an idea worth trying. If it doesn't survive testing, then it was still worth trying.
Because unless it is experimentally verified it could just be a hallucination.
Ideas do not transform into hallucinations when they don't pan out.
You could characterise perceiving a fact to be true when it is not as a hallucination.
An idea is not a fact, Frodo Baggins is not a hallucination, but an idea. Believing that Frodo Baggins exists in our world could be considered a hallucination.
Newtons Laws of motion are not hallucinations even though the universe does not run on Newtonian physics. If I said that he told me about them this morning, that would be claiming a fact, not expressing an idea. That would likely be a hallucination.
Current frontier LLMs empower effectively anyone with limitless knowledge. Historically, if I wanted to hire an engineer to, say, create something like this I would have needed a multi-million dollar budget. Now, anyone with $200 (or less) can achieve it.
You are vastly overestimating what has been achieved here.
This is something a couple of materials science grad students can do in limited time for poor compensation as well. The expensive budget is for the part that comes next.
Of course, "LLM solves quantum gravity and proves existence of God", "nah brah, that's easy brah any kid could have done this brah".
This is what you sound like. I also like how the goalposts keep moving on a daily basis, a year ago it was that LLMs can't even write a Hello World program without making an error, but now things like this are "so easy a minimum wage intern could do it."
Isn't there quite a bit of space between "so easy a minimum wage intern could do it" and your original claim that it would have cost millions of dollars to produce these results?
Why hyperbolize when I am commenting on something it has actually done and the vastly exaggerated claims related to this?
It hasn't done that though.