NVIDIA is absolutely dominating the AI conversation right and for good measure - their GPUs perform out-of-the-box and are a top choice for professionals and businesses that want to dabble […]

…Both Intel and AMD optimized their software stacks to get massive speedups in generative AI which has seen AMD’s RTX 7900 XTX get higher performance per dollar than an NVIDIA RTX 4080 in generative AI (specifically Stable Diffusion with A111/Xformers). Considering Stable Diffusion accounts for the vast majority of non-SaaS, localized generative AI right now - this is a major milestone and finally offers some competition to NVIDIA.

  • Mechanize@feddit.itEnglish
    5·
    1 year ago

    And then here I am, still unable to run StableDiffusion on my 6650xt because pytorch apparently hates it.

    TBF llama.cpp runs like a wonder on ROCm.

    All aside the improvements in the AI ecosystem by AMD are appreciated and overall tangible. Let’s hope they’ll keep it up.