Guide

https://monovm.com/blog/how-to-build-a-server/

CPU

It is recommended to get the CPU with the most cores that the budget allows.
AMD threadripper is a typically used server CPU.

https://www.cpubenchmark.net/high_end_cpus.html

AMD Epyc is another typical server CPU.
https://en.wikipedia.org/wiki/Epyc

Epyc_codenames

AMD Epyc Prices at Newegg
https://www.newegg.com/p/pl?N=100008494%20601307875&PageSize=96
epyc_prices_01

Typical Server CPU's

When clicking on a CPU on
https://www.cpubenchmark.net/high_end_cpus.html

if it is a server CPU,
the page will contain a comparison with Top 10 Common Server CPUs:
Epyc7551_benchmark

Motherboard

https://overplugged.org/best-motherboard-for-multiple-dual-gpus/#

https://www.supermicro.com/en/products/motherboards/server-boards

Specific Motherboards

Supermicro H11SSL-i

Single AMD EPY 7001/7002 Series Processor
PCI-Express 3. 0
https://www.supermicro.com/en/products/motherboard/H11SSL-i
Ebay listing
H11SSL

Supermicro H12SSL-i

Single AMD EPYC 7003/7002 Series Processor
PCI-E 4.0
https://www.supermicro.com/en/products/motherboard/h12ssl-i
https://www.ebay.com/itm/175369624997?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=stzkc2gdRam&sssrc=2047675&ssuid=&widget_ver=artemis&media=COPY
H12SSL

Memory

https://memory.net/product-category/supermicro/motherboard/h11ssl-i/
What Supermicro Motherboard H11SSL-i DIMM type is supported?
LRDIMM and RDIMM

https://memory.net/product-category/supermicro/motherboard/h12ssl-i/
What Supermicro Motherboard H12SSL-I DIMM type is supported?
RDIMM

GPU

https://www.youtube.com/watch?v=F1ythHjdWI0

hw_select_01

Nvidia 40 and 30 family comparison
https://www.nvidia.com/en-us/geforce/graphics-cards/compare/
hw_select_02 hw_select_03

https://www.techpowerup.com/gpu-specs/

GPU Prices
https://www.tomshardware.com/news/lowest-gpu-prices

AI/ML/DL GPU Buying Guide 2024: Get the Most AI Power for Your Budget
Youtube channel by "TheDataDaddi"
https://youtu.be/YiX9p8A7LqE?si=Hni41vCqaXtUX0tt

Spreadsheet at
https://docs.google.com/spreadsheets/d/1mD4DrRcq3-y9r86O_P2fD7_0m2f0q9Ql/edit#gid=542277665

Fans for passive cooling GPU

https://youtu.be/WfKQP2sARGY?si=TZp8wia5VKbPr3B7

Server Rack

https://www.amazon.com/StarTech-Network-Rolling-Computer-Equipment/dp/B00P1RJ9LS
https://youtu.be/b-x5CsBDbzg?si=ljOKkGwZ316QeeXC
https://www.amazon.com/Raising-Electronics-Server-Adjustable-Black-15U/dp/B09JDHC8K1

Server Case

Should allow liquid cooling
https://www.amazon.com/dp/B0CCK6KVPD
https://www.avadirect.com/blog/how-to-choose-the-correct-rackmount-case-for-your-rackmount-workstation-or-server/

Rack Slides

https://www.youtube.com/watch?v=S08LJnnh39A
https://www.sliger.com/products/rackmount/4u/cx4170a/

Buy Complete System

Vendors

Microcenter
https://www.microcenter.com/site/products/workstation-computers.aspx

Lenovo
https://www.lenovo.com/us/en/workstations/

PC Server and Parts
https://pcserverandparts.com/

https://www.avadirect.com/rackmount-workstations-computer

Specific Systems

https://store.supermicro.com/us_en/liquid-cooled-tower-5u-rackmount-ai-gpu-workstation-sys-751ge-tnrt.html
https://www.microcenter.com/product/648679/supermicro-high-performance-gold-xeon-workstation
https://www.lenovo.com/us/en/p/workstations/thinkstation-p-series/thinkstation-px-workstation/len102s0013
https://pcserverandparts.com/build-your-own-custom-lenovo-thinkstation-p920-workstation/

Self Build

https://pcpartpicker.com/user/atmelino/saved/#view=KYZJkL

Current GPU favorites

Nvidia GeForce RTX 3060 12GB $289.99
Nvidia GeForce RTX 4060 Ti 16GB $439.99
https://www.amazon.com/ZOTAC-Graphics-IceStorm-Advanced-ZT-D40620F-10M/dp/B0CMJQZQC6/ref=sr_1_5

NVLINK

Is my NVLINK working?

nvidia-smi topo -m GPU0 GPU1 CPU Affinity NUMA Affinity GPU NUMA ID GPU0 X NV4 0-127 0 N/A GPU1 NV4 X 0-127 0 N/A

nvidia-smi nvlink -s GPU 0: NVIDIA GeForce RTX 3090 (UUID: GPU-f6e3a2a1-9bc5-a557-1991-132f3247a986) Link 0: 14.062 GB/s Link 1: 14.062 GB/s Link 2: 14.062 GB/s Link 3: 14.062 GB/s GPU 1: NVIDIA GeForce RTX 3090 (UUID: GPU-f7ed9067-79b5-7816-86b0-55cf5141323e) Link 0: 14.062 GB/s Link 1: 14.062 GB/s Link 2: 14.062 GB/s Link 3: 14.062 GB/s

AI Hardware