#129

Add a filter for models available on AI Gateway's free tier

Openalejandroiglesiasopened 8d ago

Summary

Add an option to ai models to list only models eligible for AI Gateway's free tier, for example --free-tier.

Motivation

I recently installed AI CLI and am using AI Gateway's free tier. While trying models, some requests fail, and I end up trying different models until I find one that works with the free tier. I could not find a CLI filter to discover eligible models before making a generation request.

The current ai models command supports filtering by --type and --creator, but neither answers this question. Discovering free-tier eligibility directly in the CLI would make getting started smoother and reduce trial and error.

Proposed Solution

Provide a filter such as:

ai models --free-tier
ai models --type text --free-tier
ai models --type image --free-tier --json

The flag name is just a suggestion. Ideally, it would compose with the existing type/creator filters and work in both human-readable and JSON output. Showing eligibility in individual model details would also be helpful.

Here, “free tier” means eligibility for AI Gateway's free credits, not simply models with zero listed input/output prices. The AI Gateway model catalog already presents a “Free AI Gateway Credit” attribute; surfacing the corresponding eligibility in the CLI would be useful. If that metadata is not exposed through the Gateway API yet, documenting that limitation or coordinating upstream support would help.

Acceptance Criteria

  • Users can filter the model list by free-tier eligibility without issuing generation requests.
  • The filter composes with existing filters and supports --json.
  • Help/docs explain that eligibility does not guarantee remaining credits, quota, or request availability.

Alternatives Considered

Checking the web catalog manually or trying models one by one. Both interrupt the terminal workflow, and trial and error only reveals availability after a failed request.

Activity

0

No activity yet.