What it does
The command line tool and Python SDK for managing GPU cloud resources on Vast.ai. You can search for available machines, create and stop instances and show what is running. It also includes a serverless client for endpoint inference.
Use cases
- 01Search GPU offers by model and count
- 02Create an instance from a Docker image
- 03Stop or destroy instances you no longer need