Inference Logoinference.sh

gpu comparison

find the right gpu.

self-host your models on 25 gpu types across 19+ cloud providers. real-time pricing, sorted by performance.

gpuvramfp16 tflopsfrom
NVIDIA B200192gb450
$5.30/hr~$3816/mo
NVIDIA B300288gb450
$7.40/hr~$5328/mo
NVIDIA H10080gb267.6
$1.66/hr~$1195/mo
NVIDIA GH20096gb267.6
$2.29/hr~$1649/mo
NVIDIA H200141gb267.6
$2.45/hr~$1764/mo
NVIDIA GeForce RTX 509032gb209.5
$0.65/hr~$468/mo
NVIDIA RTX PRO 600096gb125
$1.25/hr~$900/mo
NVIDIA L40S48gb91.6
$0.74/hr~$533/mo
NVIDIA RTX 6000 Ada48gb91.1
$0.97/hr~$698/mo
NVIDIA L4048gb90.5
$0.99/hr~$713/mo
NVIDIA GeForce RTX 409024gb82.58
$0.60/hr~$432/mo
NVIDIA A100 80GB80gb77.97
$1.24/hr~$893/mo
NVIDIA A100 40GB40gb77.97
$1.36/hr~$979/mo
NVIDIA RTX A600048gb38.7
$0.49/hr~$353/mo
NVIDIA RTX 600024gb38.7
$0.69/hr~$497/mo
NVIDIA A4048gb37.4
$1.10/hr~$792/mo
NVIDIA A1024gb31.2
$1.29/hr~$929/mo
NVIDIA L424gb30.3
$0.95/hr~$684/mo
NVIDIA V100 16GB16gb28.26
$0.39/hr~$281/mo
NVIDIA V100 32GB32gb28.26
$2.34/hr~$1685/mo
NVIDIA RTX A500024gb27.8
$0.44/hr~$317/mo
NVIDIA RTX 4000 Ada20gb26.7
$0.79/hr~$569/mo
NVIDIA RTX A400016gb19.2
$0.15/hr~$108/mo
NVIDIA A3024gb10.3
$0.35/hr~$252/mo
NVIDIA A1616gb4.5
$0.51/hr~$367/mo

prices are live from 19 cloud providers. updated hourly.

self-host your models.

spin up a gpu, deploy your model, own the stack. pay by the hour.

we use cookies

we use cookies to ensure you get the best experience on our website. for more information on how we use cookies, please see our cookie policy.

by clicking "accept", you agree to our use of cookies.
learn more.