Directory

Local inference hardware

This directory tracks 10 GPUs, accelerators and SoCs used for local model inference, with VRAM, memory bandwidth, power draw and list price. Specifications are curated by hand from vendor datasheets and carry the date a person last checked them; fabrication details are read from Wikipedia. Every figure shows which of the two it is.
Machines
10
VRAM catalogued
792
With a listed price
5/10
Last sync
3h agosucceeded
RTX A6000VRAM, GB48editorial · 1mo agoInstinct MI300XVRAM, GB192editorial · 1mo agoRadeon RX 7900 XTXVRAM, GB24editorial · 1mo agoApple M4 ProVRAM, GB64editorial · 1mo agoApple M2 UltraVRAM, GB192editorial · 1mo agoApple M3 MaxVRAM, GB128editorial · 1mo agoH100 PCIeVRAM, GB80editorial · 1mo agoGeForce RTX 3090VRAM, GB24editorial · 1mo agoGeForce RTX 4080 SuperVRAM, GB16editorial · 1mo agoGeForce RTX 4090VRAM, GB24editorial · 1mo ago

No hiring column here. The job-board classifier extracts framework names, so the join can only speak about frameworks — for these entities we have not measured demand, rather than measured it to be zero.

5 GPUs, accelerators and SoCs, sorted by vram. Each row shows the last time the ranked figure was observed.
Select to compareMachineVRAM, GBGB/sTDP, WMSRPClassChecked
H100 PCIeNVIDIA802,039350not listeddatacenterAging1mo ago
RTX A6000NVIDIA487683004,650workstationAging1mo ago
GeForce RTX 3090NVIDIA249363501,499gpuAging1mo ago
GeForce RTX 4090NVIDIA241,0084501,599gpuAging1mo ago
GeForce RTX 4080 SuperNVIDIA16736320999gpuAging1mo ago

3 of 3 machines selected

Source: Wikipedia infobox. Every value carries the moment it was observed; figures that failed validation are withheld rather than shown. SLA: current within 720h, ageing to 2160h, stale beyond 4320h.

indexable · canonical /data/hardware?vendor=nvidia

Also tracked

Other datasets

Same engine, same provenance rules — every figure carries the source that reported it and when.

Smoke dataset

A fixture dataset that exercises the ingestion, validation and freshness machinery.

4 tracked

Agent engineering frameworks

Open-source frameworks for building, orchestrating and evaluating LLM agents, tracked across GitHub, npm and PyPI.

18 tracked

Language and embedding models

Language, embedding and speech models tracked across Hugging Face Hub download activity and OpenRouter context windows and pricing.

18 tracked