DGX Spark

NVIDIA did - they call it the DGX Spark. I have one. 128 GB of LPDDR5X memory to the Grace Blackwell chip. $3999 retail. Apple could smash this thing to bits with an M6 with a bajillion neural cores and the same RAM. They could price it at $1999 and take the whole market. They’re already doing it wi

Post on over to r/localllama or check out the wiki there for setups. DGX sparks are not an inference powerhouse for the $$$$ you’d spend. It’s not an enterprise grade system for 1500 users either. It’s for local, personal prototyping on the same environment as you’d deploy when you deploy to a large

I own a M4 Max MacBook Pro 128GB RAM with a 4TB SSD. I recently bought a DGX Spark. Then returned it a few weeks later. I thought I was buying a smaller, slower Blackwell AI datacenter for my home lab when I bought a Spark. I was wrong. It’s a poorly-supported ARM knockoff of the sm120 ecosystem cal

If you’re going for PURE text generation, there simply is nothing that beats the m3 ultra mac studio. Ask ANYONE who says that the gb10 is better to show it and do a direct comparison. The nvidia people like to say that the mac people are just exaggerating the numbers on paper - thats not true at al

Honestly it's fairly niche. It's meant for local LLM development/testing when working with large datasets (that's why it comes with 200Gb/s networking). But it's actually pretty damn bad at actually running LLMs (as in, you can load a large model but it's really slow), you want a beefier workstation

At that price why buy it over the DGX Spark or one of the partner systems? You don't get access to the Nvidia software stack and no ConnectX-7 for clustering. The only benefit is the RYZEN AI Halo box can run Windows and seeing it's x86_64 it has uses outside of AI; but at $4k there are plenty of be

DGX is not for anything other than AI, and big models at that. It's a 5070ti speed wise. The 5070ti has 896GB/s memory bandwidth while the DGX Spark and the Minisforum S1 Max have 256GB/s memory bandwidth so it's literally 3.5x slower. You don't buy it for that. You buy it to run 200b parameter mode

Not as long as it doesn't run CUDA is it competition for the DGX Spark. by this definition of competition nvidia is a monopoly MacOS is going to be intrinsically valuable all it is is a hindrance

I was torn between a DGX Spark and Strix Halo and almost purchased the same GMKTec Max after Nvidia raised the prices of the Spark. In the end I ended up getting the ASUS GX10 and so glad I did. It might be the fastest for inference and there is still not full support for NVFP4 but having full acces

There are no problems running LLMs on Strix that I can think of. It's easy. Not so much on Spark. https://www.reddit.com/r/LocalLLaMA/comments/1r569eb/psa_nvidia_dgx_spark_has_terrible_cuda_software/ I will concede the point on training though. You can train on Strix, but the training ecosystem is still d