What it does
A Cursor rules file for a Python pipeline that downloads models from Hugging Face, quantizes them and uploads them to a compatible repository. It describes a Linux-only project for NVIDIA CUDA and AMD ROCm GPUs, with a focus on simplicity, clear error messages and up-to-date documentation.
Use cases
- 01Quantize a downloaded Hugging Face model
- 02Handle incompatible models with clear error messages
- 03Keep README and usage instructions up to date