Baseten's Mammoth-1 and Elephant-1 now available on AI Gateway for free

Baseten’s Mammoth-1 and Elephant-1 decision models are now accessible at no cost via AI Gateway for a limited time through October 27. These models enable developers to classify text, route requests, and score content based on predefined criteria, supporting structured decision-making workflows. The free access period provides an opportunity to evaluate their performance without immediate financial commitment.

Mammoth-1, a 27-billion-parameter model, and Elephant-1, a 9-billion-parameter model, are both designed for decision-making tasks. Mammoth-1 ranks first on the Jev Decision Index, while Elephant-1 shares the top position on the Artificial Analysis Decision Index. Both models support a 16,000-token context window and return structured outputs such as choices, probabilities, and scores.

Users can submit multiple questions about the same input in a single request, including choice-based selections, boolean checks, or scored evaluations. The application can set probability thresholds to automate actions or flag results for review, providing flexibility in handling decision logic. Documentation outlines supported question types and additional usage guidelines for implementation.

AI Gateway serves as a unified interface for accessing these models, tracking usage and costs alongside other model requests. Decision calls are logged and counted within budget constraints, ensuring transparency in resource consumption. Developers can explore all available decision models through the AI Gateway interface.