1XA100 PCIESECURE
$0.39/HOUR$0.39/GPU
CPU64X AMD THREADRIPPER 7970X
Memory2,048 GB
VRAM80 GB
Hard disk2,048 GB
# of ports373
Network↑ 6.17 Gbps ↓ 8.46 Gbps
Uptime4 DAYS 5 HRS 53 MINS
Reliability97%
LocationDublin, Ireland
High-performance GPU pods
Per-second billing from the live ask. Pick a machine, start the job, and stop it when you are done. The hour figure is that ask, shown for the whole machine and per GPU.
GPUs for Oobabooga Text Gen UI & API
Show all GPUsShowing machines with at least 16 GB VRAM per GPU and 32 GB free disk.
- A100 PCIE
- A40
- B300
- H100 NVL
- H200 NVL
- L4
- L40S
- RTX 3090 Ti
- RTX 4000Ada
- RTX 4500Ada
- RTX 5080
- RTX A4000
- RTX PRO 4500
- RTX PRO 6000 Max-Q
- Tesla P100
- Titan RTX
25 servers
Show in USD
7XB300SPOT
$75.74/HOUR$10.82/GPU
CPU24X AMD RYZEN 9 5900X 16-CORE
Memory512 GB
VRAM2,016 GB
Hard disk2,048 GB
# of ports233
Network↑ 6.75 Gbps ↓ 4.78 Gbps
Uptime6 DAYS 0 HRS 53 MINS
Reliability97%
LocationSingapore, Singapore
8XA100 PCIESPOT
$3.04/HOUR$0.38/GPU
CPU32X AMD RYZEN 9 7950X
Memory512 GB
VRAM640 GB
Hard disk1,024 GB
# of ports107
Network↑ 1.95 Gbps ↓ 9.06 Gbps
Uptime7 DAYS 13 HRS 27 MINS
Reliability89%
LocationSingapore, Singapore
1XRTX 4500AdaSPOT
$0.23/HOUR$0.23/GPU
CPU128X AMD EPYC 9554
Memory512 GB
VRAM24 GB
Hard disk512 GB
# of ports341
Network↑ 1.10 Gbps ↓ 327 Mb/s
Uptime9 DAYS 1 HRS 21 MINS
Reliability87%
LocationToronto, Canada
8XRTX PRO 6000 Max-QSECURE
$8.64/HOUR$1.08/GPU
CPU24X AMD RYZEN 9 5900X 16-CORE
Memory2,048 GB
VRAM768 GB
Hard disk1,024 GB
# of ports187
Network↑ 4.91 Gbps ↓ 4.93 Gbps
Uptime12 DAYS 9 HRS 27 MINS
Reliability81%
LocationParis, France
2XRTX PRO 4500SPOT
$0.66/HOUR$0.33/GPU
CPU64X INTEL(R) XEON(R) GOLD 6338
Memory64 GB
VRAM48 GB
Hard disk512 GB
# of ports206
Network↑ 8.17 Gbps ↓ 9.84 Gbps
Uptime18 HRS 26 MINS
Reliability80%
LocationDallas, United States
2XH100 NVLSECURE
$2.86/HOUR$1.43/GPU
CPU128X AMD EPYC 9554
Memory256 GB
VRAM160 GB
Hard disk512 GB
# of ports46
Network↑ 4.05 Gbps ↓ 11.57 Gbps
Uptime7 DAYS 15 HRS 6 MINS
Reliability80%
LocationAshburn, United States
2XTesla P100SPOT
$0.06/HOUR$0.03/GPU
CPU112X INTEL(R) XEON(R) PLATINUM 8480
Memory1,024 GB
VRAM32 GB
Hard disk7,680 GB
# of ports300
Network↑ 4.66 Gbps ↓ 2.65 Gbps
Uptime5 DAYS 6 HRS 40 MINS
Reliability76%
LocationParis, France
1XRTX A4000SECURE
$0.07/HOUR$0.07/GPU
CPU32X INTEL(R) CORE(TM) i9-14900K
Memory2,048 GB
VRAM16 GB
Hard disk512 GB
# of ports61
Network↑ 3.70 Gbps ↓ 10.40 Gbps
Uptime1 DAYS 3 HRS 21 MINS
Reliability75%
LocationLisbon, Portugal
4XRTX 4500AdaSPOT
$1.04/HOUR$0.26/GPU
CPU32X INTEL(R) CORE(TM) i9-14900K
Memory512 GB
VRAM96 GB
Hard disk7,680 GB
# of ports95
Network↑ 2.29 Gbps ↓ 851 Mb/s
Uptime3 DAYS 15 HRS 15 MINS
Reliability73%
LocationSingapore, Singapore
2XRTX 4000AdaSECURE
$0.28/HOUR$0.14/GPU
CPU128X AMD EPYC 9554
Memory256 GB
VRAM40 GB
Hard disk4,096 GB
# of ports364
Network↑ 6.16 Gbps ↓ 210 Mb/s
Uptime8 DAYS 9 HRS 44 MINS
Reliability72%
LocationSingapore, Singapore
1XTitan RTXSPOT
$0.13/HOUR$0.13/GPU
CPU32X INTEL(R) CORE(TM) i9-14900K
Memory128 GB
VRAM24 GB
Hard disk512 GB
# of ports261
Network↑ 661 Mb/s ↓ 647 Mb/s
Uptime13 DAYS 14 HRS 41 MINS
Reliability65%
LocationSingapore, Singapore
3XA40SPOT
$1.38/HOUR$0.46/GPU
CPU112X INTEL(R) XEON(R) PLATINUM 8480
Memory96 GB
VRAM144 GB
Hard disk2,048 GB
# of ports218
Network↑ 2.78 Gbps ↓ 912 Mb/s
Uptime12 DAYS 7 HRS 18 MINS
Reliability64%
LocationFrankfurt, Germany
8XRTX A4000SPOT
$0.56/HOUR$0.07/GPU
CPU112X INTEL(R) XEON(R) PLATINUM 8480
Memory512 GB
VRAM128 GB
Hard disk1,024 GB
# of ports227
Network↑ 627 Mb/s ↓ 4.39 Gbps
Uptime9 DAYS 10 HRS 7 MINS
Reliability63%
LocationFrankfurt, Germany
2XL4SECURE
$0.34/HOUR$0.17/GPU
CPU112X INTEL(R) XEON(R) PLATINUM 8480
Memory256 GB
VRAM48 GB
Hard disk4,096 GB
# of ports214
Network↑ 2.77 Gbps ↓ 911 Mb/s
Uptime9 DAYS 12 HRS 34 MINS
Reliability62%
LocationStockholm, Sweden
2XH200 NVLSECURE
$5.62/HOUR$2.81/GPU
CPU24X AMD RYZEN 9 5900X 16-CORE
Memory256 GB
VRAM282 GB
Hard disk512 GB
# of ports76
Network↑ 7.68 Gbps ↓ 1.15 Gbps
Uptime8 DAYS 1 HRS 36 MINS
Reliability62%
LocationAmsterdam, Netherlands
4XRTX 4000AdaSECURE
$0.44/HOUR$0.11/GPU
CPU64X INTEL(R) XEON(R) GOLD 6338
Memory2,048 GB
VRAM80 GB
Hard disk1,024 GB
# of ports127
Network↑ 1.97 Gbps ↓ 12.06 Gbps
Uptime4 DAYS 19 HRS 7 MINS
Reliability61%
LocationParis, France
4XH100 NVLSPOT
$7.32/HOUR$1.83/GPU
CPU64X INTEL(R) XEON(R) GOLD 6338
Memory128 GB
VRAM320 GB
Hard disk7,680 GB
# of ports375
Network↑ 5.82 Gbps ↓ 7.67 Gbps
Uptime8 DAYS 3 HRS 55 MINS
Reliability61%
LocationDallas, United States
2XRTX 5080SECURE
$0.36/HOUR$0.18/GPU
CPU128X AMD EPYC 9554
Memory256 GB
VRAM32 GB
Hard disk4,096 GB
# of ports124
Network↑ 5.56 Gbps ↓ 5.01 Gbps
Uptime4 DAYS 12 HRS 24 MINS
Reliability58%
LocationLondon, United Kingdom
3XL4SPOT
$0.54/HOUR$0.18/GPU
CPU32X INTEL(R) CORE(TM) i9-14900K
Memory96 GB
VRAM72 GB
Hard disk2,048 GB
# of ports218
Network↑ 4.94 Gbps ↓ 7.93 Gbps
Uptime12 DAYS 9 HRS 58 MINS
Reliability58%
LocationStockholm, Sweden
7XRTX 3090 TiSECURE
$1.12/HOUR$0.16/GPU
CPU32X INTEL(R) CORE(TM) i9-14900K
Memory2,048 GB
VRAM168 GB
Hard disk7,680 GB
# of ports145
Network↑ 6.30 Gbps ↓ 2.10 Gbps
Uptime2 DAYS 6 HRS 5 MINS
Reliability57%
LocationToronto, Canada
2XRTX PRO 6000 Max-QSPOT
$2.26/HOUR$1.13/GPU
CPU64X AMD THREADRIPPER 7970X
Memory1,024 GB
VRAM192 GB
Hard disk512 GB
# of ports156
Network↑ 5.24 Gbps ↓ 2.34 Gbps
Uptime19 HRS 36 MINS
Reliability52%
LocationDallas, United States
2XB300SPOT
$19.46/HOUR$9.73/GPU
CPU64X AMD THREADRIPPER 7970X
Memory1,024 GB
VRAM576 GB
Hard disk512 GB
# of ports276
Network↑ 1.76 Gbps ↓ 9.41 Gbps
Uptime3 DAYS 22 HRS 56 MINS
Reliability48%
LocationParis, France
4XRTX 3090 TiSPOT
$0.60/HOUR$0.15/GPU
CPU32X AMD RYZEN 9 7950X
Memory128 GB
VRAM96 GB
Hard disk1,024 GB
# of ports87
Network↑ 5.53 Gbps ↓ 8.38 Gbps
Uptime6 DAYS 13 HRS 47 MINS
Reliability45%
LocationToronto, Canada
8XTesla P100SPOT
$0.24/HOUR$0.03/GPU
CPU64X INTEL(R) XEON(R) GOLD 6338
Memory256 GB
VRAM128 GB
Hard disk512 GB
# of ports176
Network↑ 3.82 Gbps ↓ 1.79 Gbps
Uptime11 DAYS 15 HRS 16 MINS
Reliability44%
LocationToronto, Canada