Ecosystem / Evaluate & compare
In development

Evaluate & compare

AERIF Model Lab

A workbench for comparing models, providers, and their trade-offs.

The workspace

Built around a clear job.

An evaluation workstation foundation for model candidates, benchmark runs, comparisons, and reviewable promotion records. Evaluation recommendations are separate from lifecycle and execution authority. A recommendation does not establish that a model is installed, reachable, loaded or healthy.

Implemented

Model registry

Organize model candidates and explicit provider metadata.

Limited

Evaluation workspace

Explore comparisons with clearly labeled simulated data.

Limited

Reviewable promotion

Export recommendation records without taking over runtime routing.

Local

Limited

Browser evaluation workbench verified; native desktop shell and packaging remain unverified.

API / endpoint

Planned

Structural adapters exist; live provider evaluation is not enabled or validated.

Future Cloud

Planned

AERIF Cloud is a separate future proprietary/private hosted service. No service is available today.

Local Light

Implemented

Simulated workflows run without a loaded model.

Local Quality

Planned

Real local model evaluation is future work.

Custom

Limited

Model/provider records and comparison workflows; no live arbitrary model execution.

API

Planned

Live API evaluation remains future work.

AERIF Cloud

Planned

AERIF Cloud is a separate future proprietary/private hosted service. No service is available today.

Provider boundaries

Deterministic fake providerImplemented

All current benchmark metrics are simulated.

Live local / API modelsPlanned

No live inference claim.

Platform evidence

A portable design is not a tested release.

Windows

In development

Windows desktop shell and packaging remain unverified.

x64

Linux

Planned

A future platform direction; no verified release.

macOS

Planned

A future platform direction; Apple Silicon support is not verified.

Web

Experimental

Simulated frontend workflow; not a production model service.

Hardware requirements and public downloads are listed only when independently verified. No universal RAM, VRAM or GPU guarantee is implied.

Public availability

No public download or source link has been independently verified for this entry. Current screenshots and development checks are not distribution evidence.

Compare availability