Skip to main content

rhapsodeRun it Build on it API

Overview
Native API
OpenAI shim
Models

Models
Shared
Device

Device

Attributes (3)

Attribute	Type	Required	Description
`type`	`'cuda' \| 'rocm' \| 'mps' \| 'cpu'`	Yes
`name`	`string`	Yes
`vramBytes`	`number`	No

Run it

Quick start
Running one
Engines
OpenAI clients
Help

Build on it

Adding an engine
The protocol
API reference
The worker SDK
Conformance
Contributing

Project

Source
Issues
Changelog
Security
Code of conduct

rhapsode is MIT licensed. Each engine carries its own licence, for its code and for its weights.