Ask HN: Workstation/rig config for local LLM finetuning/training and inference?

I need help purchasing/putting together a rig that's powerful enough for training LLMs from scratch, finetuning models, and inferencing them.

Many people on this sub showcase their impressive GPU clusters, often usnig 3090/4090. But I need more than that—essentially the higher the VRAM, the better.

Here's some options that have been announced, please tell me your recommendation even if it's not one of these:

- Nvidia DGX Station

- Dell Pro Max with GB300 (Lenovo and HP offer similar products)

The above are not available yet, but it's okay, I'll need this rig by August.

Some people suggest AMD's MI300x or MI210. MI300x comes only in x8 boxes, otherwise it's an attractive offer!

Budget ≤ $30,000

Cursor + Vim plugin never worked for me, so I switched back to Nvim and never looked back. Nvim already has: avante, codeCompanion, copilot, and many other tools + MCP + aider if you're into that.

"It's evolving, but backwards."

MCP Blues - Automating Survey Answering Using MCP and an AI Client [video]

> B. If you're getting only one scan a year you're fine and within yearly limits of radiation dosage considered acceptable.

But doesn't it make a difference if that "acceptable yearly limit" is spread out throughout the year as opposed to a few minutes of CT scan session?