DGX Spark

You need an NVIDIA DGX Spark running local models. The one time purchasing cost is less than your estimated monthly subscription cost, and the device should be good for at least 3 years.

Best a Mac mini can do is 64GB. They can only use a Pro M SOC. To get a 128GB M4 Max SOC you need at least a Mac Studio (or a MacBook Pro). At that point it is hard to say no to the Nvidia DGX Spark @ $5k. That said wait until March 4th to see what new goodies Apple drops. I read rumors there could

Have you looked at the NVIDIA DGX Spark? 128GB VRAM, GB10 GPU complete system for around $4000 and zero supply issues. I have one and its great.

STOP! Don’t do anything until you’ve looked at the DGX Spark PCs that NVIDIA is bringing out and others are going to build. Easily within budget and will blow everything out of the water! Due out well before December.

Unfortunately, that's about as far as my knowledge goes. I've only been using it for a few weeks, and I was late to the "AI party" in general. I was stubbornly resistant up until about a year ago, then mainly used GitHub Copilot for coding. I've started experimenting with RAG and automations, but I

You could probably run GLM-4.5-Air or IceBlink v3 (106b parameters) locally at 3-bit quantization, maybe 4 XXS. Without any particular optimization, I'm running an unsloth Q4 of that model; it consumes 70 GB including graphics RAM for OS stuff and other apps. The problem is your performance would be

I've already got an M3 Ultra. I'm going to try this out to get M5 Ultra pp speeds: https://blog.exolabs.net/nvidia-dgx-spark/ Going to start with just one for Minimax 2.7 prefill, but if it works really well I'd consider a second. I somehow expect buying 2 GB10 systems is still going to be cheaper t

Strix Halo at one point had a decent price advantage making it an attractive option; that is no longer the case. Get the DGX Spark, if you can get by with 1TB of storage the Asus Ascent GX10 is an attractive option and can save you $1k over the DGX Spark along with having better cooling. The 1TB SSD

Nvidia makes that dgx spark, looks nice but pricey. That can run a lot

I own 2x Spark and run Minimax M2.7 or Deepseek 4 flash for coding agents. Performance isn't as dire as people can say. For one developer, it's very usable. You'll get around 30 tps output from these models, Minimax being way faster right now at prefill (3k-4K tps). $10K is unfortunately not enough