VentureBeat October 8, 2024
Anthropic, a leading artificial intelligence company, launched its new Message Batches API on Tuesday, allowing businesses to process large volumes of data at half the cost of standard API calls.
This new offering handles up to 10,000 queries asynchronously within a 24-hour window, marking a significant step towards making advanced AI models more accessible and cost-effective for enterprises dealing with big data.
The AI economy of scale: Batch processing brings down costs
The Batch API offers a 50% discount on both input and output tokens compared to real-time processing, positioning Anthropic to compete more aggressively with other AI providers like OpenAI, which introduced a similar batch processing feature earlier this year.
This move represents a significant shift in the AI...
Today's Sponsors
Today's Sponsor