Bringing PyTorch Monarch to AMD GPUs

Posted by gmays 2 days ago

Counter80Comment6OpenOriginal

Comments

Comment by mountainriver 2 days ago

Love monarch, amazing primitives and feels so much lighter than Ray.

Another awesome add on their part

Comment by bicepjai 2 days ago

So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?

Comment by esseph 2 days ago

Who was training LLMs on residential AMD GPUs?

Comment by MrDrMcCoy 2 days ago

I am. Most models that can be run locally have extraordinarily out of date training data for certain frameworks that predate breaking changes and important features, so their docs and API schemas need to be put into LoRAs.

Comment by amelius 2 days ago

can't or can?

Comment by fefe23 2 days ago

benchmqarks?

Comment by reindeer2 1 day ago

[flagged]