love the idea of a offline, locally running cluster but to be honest even thou i could run the whole deepseek model this seems quite slow for the amount of hardware you have. that being said, absolute monster proxmox setup could be had with this – www.youtube.com/watch