GPU Setup
This guide tracks a stable local GPU setup process for AI experimentation.
Driver and Runtime
- Install the latest stable GPU driver.
- Confirm CUDA toolkit and runtime compatibility with your framework.
- Verify support with:
nvidia-smi
Python Package Alignment
- Pin PyTorch build for your CUDA version.
- Pin critical libraries (
transformers,accelerate,bitsandbytes) per project. - Save versions in a project
requirements.txt.
Validation Script
Run a quick tensor operation on GPU before any training session.