Sectile Research Laboratories is rebuilding the AI stack from the representation up. We release consumer-focused versions of the systems we run on to the open-source and local-hosting community.
The GInfer Models collection holds our model packages for GInfer and GChat. Each package's card names its base model and license.
| Format | What it is | GPUs |
|---|---|---|
| INT | 4-bit groupwise integer | Ampere, Ada, Blackwell |
| NVFP4 | 4-bit NVIDIA FP4 | Blackwell (RTX 50 series, RTX PRO) |
| SMOL | 2-bit, mixed with 4-bit where a model needs it | Ampere, Ada, Blackwell |
The packages run only in GInfer and GChat.