LoginSign Up
← Back to all sparks
B

Baseten

AI-ASSISTANTS
Velocity5.0

AI model deployment and inference platform for running ML models in production.

www.baseten.co ↗

Baseten ends the free launch of elephant-1 and mammoth-1 and adds per-replica metrics.

ai-inferencemodel-apisobservabilityapi-securitypricing
◆Current state
Baseten's newest entries are commercial and operational. The elephant-1 and mammoth-1 classification models, launched free on October 21, moved to paid usage on Model APIs from October 27, and workspaces can now compare CPU, GPU and memory per replica to find outliers that aggregate graphs hide. The week before was mostly security: API keys unused for 30 days are revoked automatically, auth errors switch from 403 to 401 on October 28, and users were told to upgrade CLIs after the eMudhra CA compromise.
◆Where it's heading
Baseten keeps adding models to Model APIs on a free-then-paid launch pattern, while building out observability for dedicated deployments: GPU temperature and utilization a week ago, per-replica breakdowns now. The security tightening of late October appears to have settled into defaults.
◆Prediction
Expect further Model API additions following the same free launch window before paid usage, and more per-replica or per-worker debugging tools for dedicated deployments.

◆Recent moves

  1. 21h ago

    elephant-1 and mammoth-1 pricing

    The two classification models added on October 21 leave their free launch window and become paid from October 27. It confirms the free-then-paid pattern Baseten uses for new Model APIs; the entry gives no price detail.

    View source ↗
  2. 22h ago

    Per-replica metrics

    Metrics can now be split per replica to compare CPU, GPU and memory and spot outliers hidden by averages. It extends last week's GPU temperature and utilization metrics into finer-grained debugging for dedicated deployments.

    View source ↗
  3. 4d ago

    Revocation of unused API keys on 10/24

    From October 24, keys unused for 30 days are revoked automatically. It replaces the 90-day November plan announced a day earlier with a stricter, immediate one, so teams with idle production keys need to check them now.

    View source ↗
  4. 5d ago

    Auth errors switch from 403 to 401 on October 28

    From October 28, missing or invalid credentials return 401 instead of 403. It is a small but breaking change for clients that branch on the status code.

    View source ↗
  5. 5d ago

    Auto-revocation of unused API keys announced (90 days)

    The first announcement of automatic key revocation, set at 90 days from November 5. It was superseded a day later by the 30-day policy.

    View source ↗
  6. 6d ago

    Upgrade Baseten and Truss CLIs after eMudhra CA compromise

    Users are asked to upgrade the Baseten and Truss CLIs after the eMudhra/emSign certificate authority reported compromised signing keys; Baseten says its own systems are unaffected. A patch notice, not a feature.

    View source ↗