> can generate fully [...] parametric 3D geometry.
This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
> SGS-1 outputs are accurate and can be edited easily in traditional CAD software.
I tested this on their own demo file to give it its best chance at working correctly and this claim they've made is just a complete lie. I've included the input and output for comparison below next to a correct part I modelled myself[1][2] and a list of errors. These aren't just incorrect dimensions but broken features that make these very hard to edit.
I don't know why they'd lie about this and them provide a demo the shows they're lying with their own input files, and even text on their own page which makes a claim that can not be true based solely on the information further down that page. Is it to get news headlines? Do they want to sell this to people that don't know any better? Is this simply just another case of CS people thinking they've solved a problem without having any domain knowledge to know their claims are nonsense?
- Every dimension is wrong aside from the one that I corrected to get the same scale (there doesn't appear to be any correct relative to each-other which is why I just picked one at random)
- One hole doesn't go all the way through
- The closest hole isn't round (it's two holes with slightly different diameters that overlap with a sum larger than either hole)
- The fillets are not fillets
- The top hole is offset
- The front chamfer goes down past the base
- The not-fillets don't have the same radius
- The two top holes are offset from each other in Z
- The front chamfer is joined to the circle in different ways on each side (to be fair the drawing is nonsensical here, I just went for a tangent with the circle on my part)
> This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
Yes, this is also confusing me to no end. How can they make such a claim? They even explicitly state that they generate a B-rep (boundary representation) output only, then in their roller example they say "as the output is parametric, dimensions can easily be adjusted." Erm, no? I'd rather model it again with the proper feature history tree and constraints instead of fiddling with a step file.
I think the point they are making us that the intermediate representation the model works with is parametric and then converted to step for use with other tooling, I could be wrong, but I understand the argument both ways of their solution enables editing of that parametric version before conversion out.
You seem to know what you're talking about. I am completely ignorant of this field, but I have been hearing about https://zoo.dev/design-studio (nee. "kitty cad") for a while because I follow one of the lead devs and it seems like it offers similar features.
I would be very interested to get a comparison from someone who understands the terrain.
Pure text to CAD doesn't seem particularly useful because of how hard it would be to express all constraints in text. Perhaps it's is useful for some kind of mock-up work but that's not really my area.
I agree, text-to-mesh makes much more sense for 3D artist than for CAD. If I'd wanted to have all my parts in text, I'd just use OpenSCAD, writing this down in prose sounds horrible.
And lo, OpenSCAD is great, but is basically unused in the professional world... mainly because textual representation of models amounting to anything more complex than basic 3d shapes slapped together is difficult to achieve. You just can't do so many things in OpenSCAD that you need once you start doing professional designn
Though it's possible that generating the STEP first is easier to do, and that the plan could be backporting the feature tree using another method / model would then enable editing.
Yes, it would seem post hoc feature tree requires the constraints that come from context in your head, but I could imagine that for most cases a "drafter's intuition" in AI may be sufficient, and you could build an interface to allow that to be mostly given up front and then through iterate post generation.
I could imagine the stepwise approach may allow AI training to be more constrained / efficient that trying to do the whole thing in one go.
This is also why SQL is cursed for LLMs. For queries that are actually valuable to the business we tend to have more constraints than these models can tolerate.
By the time you get done explaining the meaning of your schema, you might have run out of context. Not that it would matter either way. I've never seen the attention mechanism lock onto more than ~10 hard constraints at a time.
Maybe you need to approach SQL the way code generation must be approached: don’t develop the whole statement or script at once, instead put together a plan and execute it step-by-step.
Not everything must be done via LLMs themselves. You could use one or more tools to help generate parts of the query.
I agree that STEP files are not parametric. But for cases where thats all you've got, Altair Inspire is pretty good at letting you use them in a CAD system:
Yes, but is it even saving you any time, then? For complicated parts, maybe, but the example above is not complicated and the AI is already doing a pretty terrible job. Someone familiar with CAD is able to quickly do this in 15min or so, and then you have all the history and constraints to adapt the design simply by just changing parameters. I'm pretty sure I'd spent much more time fiddling with a rough approximation in the form of a step file.
I think there is a market for AI that would clean up the goo imports of 3D scanners. Imagine how beneficial that would be.
Also to generate clean 3D meshes from points cloud, while identifying the various objects via the colours/lighting. That would be also really interesting. It could as well describe the world, and the object's meta data.
As for something like this, it removes the fun of CAD design more than solve a problem, I think we best focus AI for repetitive boring tasks, rather than design. This may wow investors, and may save professional minutes, but it does not really solve the bigger problems.
<Insert meme about AI doing arts while we still do the dishes />
Nobody in this space cares about anything except wowing the investors. They would willingly sap every ounce of joy out of every single knowledge worker’s professional lives and leave us being either AI process overseers or scrubbing toilets if some MBA could envision using that technology to lay people off. From where I’m standing, it looks like it’s just going to kill the demand for labor in a bunch of fields, tanking previously reliable salaries, and transfer the savings directly to shareholders.
> Given an image or a 3D mesh, SGS-1 can generate CAD B-Rep parts in STEP format. Unlike all other existing generative models, SGS-1 outputs are accurate and can be edited easily in traditional CAD software
This is a game changer, all the models before that output meshes were a toy at best. Super excited to see where they can take this.
I wander if the next step is for a step -> proprietary format (SolidWork, NX etc) model that can infer constraints.
There are so many hobbyist 3D printing things I’d like to do around my abode by taking some existing piece and tweaking it. Creating a model for a one off part is pretty tedious though.
I think the bar is even lower than that: generating sane STEP geometry from STL files generated by other CAD software is already a huge win. Autodesk Fusion pretends to be able to do that, but it only works for easy demos.
Neat to see the parent article. In the early months of ChatGPT4, I had it produce an open markup standard to support LLM-mediated mechatronic design. Basically I felt that human-readable markup language was needed for an LLN to train on many examples (or for an imagined highly capable LLM to absorb the logic of the markup language de novo), so that it could be used to rapidly iterate subsequent mechatronic designs posed by users. Mostly as a demonstration-of-concept so others could build on it or be inspired to roll their own.
Oh man! The sketch into CAD is going to be huge for the restoration market! Holy crap!
There’s tons of old drawings but lacking measurements or something. The engineer knows how tall it is or what the overall dimensions are so they can easily use that to create a box and tell AI, make this part that fits this thing. This is going to change everything.
3D printing, restorative, imagineering, part manufacturing, everywhere where there is CAD…
As an engineer I just wanted to pipe in and say that this AI removes the part of design that isn’t actually the difficult part.
The difficult part is the manufacturing, also coming up with the plausible load paths and deciding on the geometry of the parts according to the actual loads.
As an engineer, I can confirm that this AI (if it works well) would compress the prototyping stage significantly, resulting in a better product at reduced cost.
> also coming up with the plausible load paths and deciding on the geometry of the parts according to the actual loads
Remove the boilerplate and focus on the value adding parts is the philosophy that actually happens in software development ai usage, so it might be useful elsewhere as well.
Hey! I'm a cofounder and the CTO of this company. Want to lead with saying its an absolute privilege to be on the front page of this site and have all of you try this model and give us your feedback. Your time and attention is valuable and is absolutely not taken for granted.
Our model is SGS-1, and it will continue to improve in future versions. Want to address a few points made by others here.
> can generate fully [...] parametric 3D geometry.
>> This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
This is a simple misunderstanding/semantic issue. We aren't trying to misrepresent anything, we (and some others in the research community) interpret parametric as "being composed of primitives with parameters". We have an internal representation we don't expose to users, and we convert that to a B-Rep STEP file which we do expose.
>> Every dimension is wrong aside from the one that I corrected to get the same scale (there doesn't appear to be any correct relative to each-other which is why I just picked one at random)
Visually this output looks close. There are some gaps, but looking at your screenshot, features like the main hole going all the way through are underdetermined. It's very hard for a model to know because even if the hole did not go through the input would look the same. All of this can be fixed by having richer input conditions, and we are actively working on this for SGS-2
>Yes, this is also confusing me to no end. How can they make such a claim? They even explicitly state that they generate a B-rep (boundary representation) output only, then in their roller example they say "as the output is parametric, dimensions can easily be adjusted." Erm, no? I'd rather model it again with the proper feature history tree and constraints instead of fiddling with a step file.
SGS-2 will include a feature tree representation, so this should be more easily editable than this (which should already be easily editable in many cases as well with direct modeling). Several engineers already work with STEP files in their work for to the best of my knowledge.
Thanks once again for all the feedback! We are incorporating all this into our next model.
I think the demo is cool, but the single most important question is how good it is at converting written constraints into the design.
Designing something that has the right features is easy, the hard part is creating a design that is manufacturable, fits inside the allocated space, has the desired mechanical properties (e.g. rigidity) at the desired cost (uses less material, is easy to manufacture).
As an example, parts for 3D printing have various design constraints, as you want to avoid support material and want to print the part in a certain orientation. Being able to verbally tell an AI model to incorporate these constraints would be very beneficial.
I tried one of the samples and it wasn't watertight, with spurious little holes in the corners. Still mind-boggling though, and that can be healed easily enough.
Depending on pricing, this could be a boon for 3D printing. The really hard part for hobbyists creating novel models has been the CAD. If they can price this appropriately I can see it selling really well.
> can generate fully [...] parametric 3D geometry.
This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
> SGS-1 outputs are accurate and can be edited easily in traditional CAD software.
I tested this on their own demo file to give it its best chance at working correctly and this claim they've made is just a complete lie. I've included the input and output for comparison below next to a correct part I modelled myself[1][2] and a list of errors. These aren't just incorrect dimensions but broken features that make these very hard to edit.
I don't know why they'd lie about this and them provide a demo the shows they're lying with their own input files, and even text on their own page which makes a claim that can not be true based solely on the information further down that page. Is it to get news headlines? Do they want to sell this to people that don't know any better? Is this simply just another case of CS people thinking they've solved a problem without having any domain knowledge to know their claims are nonsense?
- Every dimension is wrong aside from the one that I corrected to get the same scale (there doesn't appear to be any correct relative to each-other which is why I just picked one at random)
- One hole doesn't go all the way through
- The closest hole isn't round (it's two holes with slightly different diameters that overlap with a sum larger than either hole)
- The fillets are not fillets
- The top hole is offset
- The front chamfer goes down past the base
- The not-fillets don't have the same radius
- The two top holes are offset from each other in Z
- The front chamfer is joined to the circle in different ways on each side (to be fair the drawing is nonsensical here, I just went for a tangent with the circle on my part)
- Much more that I've probably missed
[1]: https://files.catbox.moe/mzb9bb.png
[2]: https://files.catbox.moe/5xkna1.png
> This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
Yes, this is also confusing me to no end. How can they make such a claim? They even explicitly state that they generate a B-rep (boundary representation) output only, then in their roller example they say "as the output is parametric, dimensions can easily be adjusted." Erm, no? I'd rather model it again with the proper feature history tree and constraints instead of fiddling with a step file.
I think the point they are making us that the intermediate representation the model works with is parametric and then converted to step for use with other tooling, I could be wrong, but I understand the argument both ways of their solution enables editing of that parametric version before conversion out.
You seem to know what you're talking about. I am completely ignorant of this field, but I have been hearing about https://zoo.dev/design-studio (nee. "kitty cad") for a while because I follow one of the lead devs and it seems like it offers similar features.
I would be very interested to get a comparison from someone who understands the terrain.
Pure text to CAD doesn't seem particularly useful because of how hard it would be to express all constraints in text. Perhaps it's is useful for some kind of mock-up work but that's not really my area.
I agree, text-to-mesh makes much more sense for 3D artist than for CAD. If I'd wanted to have all my parts in text, I'd just use OpenSCAD, writing this down in prose sounds horrible.
And lo, OpenSCAD is great, but is basically unused in the professional world... mainly because textual representation of models amounting to anything more complex than basic 3d shapes slapped together is difficult to achieve. You just can't do so many things in OpenSCAD that you need once you start doing professional designn
Though it's possible that generating the STEP first is easier to do, and that the plan could be backporting the feature tree using another method / model would then enable editing.
Yes, it would seem post hoc feature tree requires the constraints that come from context in your head, but I could imagine that for most cases a "drafter's intuition" in AI may be sufficient, and you could build an interface to allow that to be mostly given up front and then through iterate post generation.
I could imagine the stepwise approach may allow AI training to be more constrained / efficient that trying to do the whole thing in one go.
This is also why SQL is cursed for LLMs. For queries that are actually valuable to the business we tend to have more constraints than these models can tolerate.
By the time you get done explaining the meaning of your schema, you might have run out of context. Not that it would matter either way. I've never seen the attention mechanism lock onto more than ~10 hard constraints at a time.
Maybe you need to approach SQL the way code generation must be approached: don’t develop the whole statement or script at once, instead put together a plan and execute it step-by-step.
Not everything must be done via LLMs themselves. You could use one or more tools to help generate parts of the query.
You might be interested in this:
https://www.pedronasc.com/articles/lessons-building-ai-data-...
I agree that STEP files are not parametric. But for cases where thats all you've got, Altair Inspire is pretty good at letting you use them in a CAD system:
https://altair.com/inspire
It identifies features as such even from step.
Yes, but is it even saving you any time, then? For complicated parts, maybe, but the example above is not complicated and the AI is already doing a pretty terrible job. Someone familiar with CAD is able to quickly do this in 15min or so, and then you have all the history and constraints to adapt the design simply by just changing parameters. I'm pretty sure I'd spent much more time fiddling with a rough approximation in the form of a step file.
Even simpler tools like Solid Edge in synchronous mode will do a decent job of editing STEP files, as long as they're not just full of polygons.
Yes, it is a bunch of lies. I wonder what who they pretend to deceive? May be investors?
Remember Adept?
For parametric what the mean is that it generates fusion360 solids that fit into a parametric workflow (unlike say a mesh)
I think there is a market for AI that would clean up the goo imports of 3D scanners. Imagine how beneficial that would be.
Also to generate clean 3D meshes from points cloud, while identifying the various objects via the colours/lighting. That would be also really interesting. It could as well describe the world, and the object's meta data.
As for something like this, it removes the fun of CAD design more than solve a problem, I think we best focus AI for repetitive boring tasks, rather than design. This may wow investors, and may save professional minutes, but it does not really solve the bigger problems.
<Insert meme about AI doing arts while we still do the dishes />
Nobody in this space cares about anything except wowing the investors. They would willingly sap every ounce of joy out of every single knowledge worker’s professional lives and leave us being either AI process overseers or scrubbing toilets if some MBA could envision using that technology to lay people off. From where I’m standing, it looks like it’s just going to kill the demand for labor in a bunch of fields, tanking previously reliable salaries, and transfer the savings directly to shareholders.
> Given an image or a 3D mesh, SGS-1 can generate CAD B-Rep parts in STEP format. Unlike all other existing generative models, SGS-1 outputs are accurate and can be edited easily in traditional CAD software
This is a game changer, all the models before that output meshes were a toy at best. Super excited to see where they can take this.
I wander if the next step is for a step -> proprietary format (SolidWork, NX etc) model that can infer constraints.
Thanks for this! We are actively considering this in our next model. What did you have in mind specifically?
I agree, even if it just does a decent job of creating sane STEP geometry out of 3D scan meshes it would be a huge win.
I’d pay a subscription for that.
There are so many hobbyist 3D printing things I’d like to do around my abode by taking some existing piece and tweaking it. Creating a model for a one off part is pretty tedious though.
I think the bar is even lower than that: generating sane STEP geometry from STL files generated by other CAD software is already a huge win. Autodesk Fusion pretends to be able to do that, but it only works for easy demos.
Neat to see the parent article. In the early months of ChatGPT4, I had it produce an open markup standard to support LLM-mediated mechatronic design. Basically I felt that human-readable markup language was needed for an LLN to train on many examples (or for an imagined highly capable LLM to absorb the logic of the markup language de novo), so that it could be used to rapidly iterate subsequent mechatronic designs posed by users. Mostly as a demonstration-of-concept so others could build on it or be inspired to roll their own.
https://github.com/ricksher/ASimpleMechatronicMarkupLanguage
In any case, hopefully it anticipated some future company’s would-be IP thereby ensuring Freedom-to-Operate for future open source hardware tinkerers.
Oh man! The sketch into CAD is going to be huge for the restoration market! Holy crap!
There’s tons of old drawings but lacking measurements or something. The engineer knows how tall it is or what the overall dimensions are so they can easily use that to create a box and tell AI, make this part that fits this thing. This is going to change everything.
3D printing, restorative, imagineering, part manufacturing, everywhere where there is CAD…
As an engineer I just wanted to pipe in and say that this AI removes the part of design that isn’t actually the difficult part.
The difficult part is the manufacturing, also coming up with the plausible load paths and deciding on the geometry of the parts according to the actual loads.
As an engineer, I can confirm that this AI (if it works well) would compress the prototyping stage significantly, resulting in a better product at reduced cost.
> also coming up with the plausible load paths and deciding on the geometry of the parts according to the actual loads
It would help with that as well.
> It would help with that as well.
Beyond having a cad file where there wasn’t one… how?
Remove the boilerplate and focus on the value adding parts is the philosophy that actually happens in software development ai usage, so it might be useful elsewhere as well.
This is being AI’d as well: https://limitlesscnc.ai/
Hey! I'm a cofounder and the CTO of this company. Want to lead with saying its an absolute privilege to be on the front page of this site and have all of you try this model and give us your feedback. Your time and attention is valuable and is absolutely not taken for granted. Our model is SGS-1, and it will continue to improve in future versions. Want to address a few points made by others here.
> can generate fully [...] parametric 3D geometry. >> This is obviously a lie without even testing it. STEP files do not have any sort of support for parametric features.
This is a simple misunderstanding/semantic issue. We aren't trying to misrepresent anything, we (and some others in the research community) interpret parametric as "being composed of primitives with parameters". We have an internal representation we don't expose to users, and we convert that to a B-Rep STEP file which we do expose.
>> Every dimension is wrong aside from the one that I corrected to get the same scale (there doesn't appear to be any correct relative to each-other which is why I just picked one at random)
Visually this output looks close. There are some gaps, but looking at your screenshot, features like the main hole going all the way through are underdetermined. It's very hard for a model to know because even if the hole did not go through the input would look the same. All of this can be fixed by having richer input conditions, and we are actively working on this for SGS-2
>Yes, this is also confusing me to no end. How can they make such a claim? They even explicitly state that they generate a B-rep (boundary representation) output only, then in their roller example they say "as the output is parametric, dimensions can easily be adjusted." Erm, no? I'd rather model it again with the proper feature history tree and constraints instead of fiddling with a step file.
SGS-2 will include a feature tree representation, so this should be more easily editable than this (which should already be easily editable in many cases as well with direct modeling). Several engineers already work with STEP files in their work for to the best of my knowledge.
Thanks once again for all the feedback! We are incorporating all this into our next model.
I think the demo is cool, but the single most important question is how good it is at converting written constraints into the design.
Designing something that has the right features is easy, the hard part is creating a design that is manufacturable, fits inside the allocated space, has the desired mechanical properties (e.g. rigidity) at the desired cost (uses less material, is easy to manufacture).
As an example, parts for 3D printing have various design constraints, as you want to avoid support material and want to print the part in a certain orientation. Being able to verbally tell an AI model to incorporate these constraints would be very beneficial.
I wonder where they'd get the training data for something like that.
If this really works, in conjunction with a 3D printer and a robotic arm, the implications will be huge…
this doesn't make sense from a theoretical pov at least to me. like is it also defining tolerances etc?
No? Do you mean fits? If you have to go in later and define dimensions and tolerances by hand, that's still way less than modelling from scratch.
I tried one of the samples and it wasn't watertight, with spurious little holes in the corners. Still mind-boggling though, and that can be healed easily enough.
Depending on pricing, this could be a boon for 3D printing. The really hard part for hobbyists creating novel models has been the CAD. If they can price this appropriately I can see it selling really well.
This would be incredible if it shipped with bambustudio or orca slicer. This is the first AI release in months that I've been excited for.
Glad to see this is utter BS. Moving along.