Warning: Some posts on this platform may contain adult material intended for mature audiences only. Viewer discretion is advised. By clicking ‘Continue’, you confirm that you are 18 years or older and consent to viewing explicit content.
Hot damn that’s a lot! They ain’t messing around with that requirement.
My current server has 32 MB of VRAM. Yes, MB not GB. Once I finish the hardware migration it’s going to 8GB but that’s not even a drop in the bucket compared to that requirement.
VRAM would be 810Gb/403Gb/203Gb for FP16/FP8/INT4 for interferrence, according to their website.
Hot damn that’s a lot! They ain’t messing around with that requirement.
My current server has 32 MB of VRAM. Yes, MB not GB. Once I finish the hardware migration it’s going to 8GB but that’s not even a drop in the bucket compared to that requirement.