Best way to use R9700 vs RTX3060 or RTX3090 for Qwen
Thoughts on how I might best use my hardware? MiniPC (Bubblina) with eGPU oculink R9700 (32GB AMD) 64GB DDR5 - Qwen3.8-27B Paiton-KV4-vision 262K context, 8-concurrent Desktop (BM1…
Thoughts on how I might best use my hardware?MiniPC (Bubblina) with eGPU oculink R9700 (32GB AMD) 64GB DDR5 - Qwen3.8-27B Paiton-KV4-vision 262K context, 8-concurrent Desktop (BM1) Ryzen 5700G currently with RTX3060 12GB, and a GTX1660 6GB, 64GB DDR4 - Strata IQ2_XS - runs surprisingly fast, with the gpu-unlock, but I wouldnt trust it with agentic tasks, and is AFAIK concurrency limited.
The GTX1660 is used exclusively for TTS work.Main server (Trogdor): Ryzen 3950x, 3x RTX3090, 128GB DDR4 (Unraid, big storage machine and services) - media production factory (comfyui/media/video/audio) I currently use the miniPC to orchestrate activity on Trogdor, via hermes.
"Make me an image of X, make me a video of Y" the task being divvied out to the GPU's on Trogdor.I'm wondering about using one of the more idle 3090's as the Strata GPU, taking it from 12GB to 24GB, and putting the 3060 in Trogdor for smaller offload tasks.
I'm just wondering about model options and what I can get best results from.Agentic/Hermes work benefits from speed and tool calls.Strata QFN works very well for document/narrative/story/chat, but I'd love access to it's more reliable/smarter variants for coding tasks.
Other options on the table would be moving the R9700 off the oculink eGPU to a slot in BM1 (PCIe 3.0 x16), but thats a DDR4 system, so might be needless.A 3090 could go on the eGPU, or even the 3060 for offload tasks.
Or: 3090 on PCIe 3.0 x16, 3060 on PCIe 3.0 4x (chipset) on BM1 for Strata 2nd card offload?Could go down the bifurcation route of the main slot too?I'm largely just talking out loud with this to try and brainstorm it, but suggestions welcome :) (With the exception of the R9700, everything above was collected over 2 years mostly used before the Bad Times) submitted by /u/k8-bit [link] [comments]