Announcing Azure OpenAI Global Batch General availability: At scale processing with 50% less cost!

We are pleased to announce the following: general availability of Azure OpenAI Global Batch productDesigned to efficiently handle large-scale and high-volume processing tasks. Process groups of asynchronous requests with separate quotas and 24-hour processing times at a cost 50% lower than global standards.

Here’s what one of our customers says:

“Ontada is uniquely positioned to serve providers, patients and life science partners with data-driven insights.. Leverage Azure OpenAI batch APIs to efficiently process tens of millions of unstructured documents, improving your ability to extract valuable clinical information.. Tasks that used to take months to complete can now be completed in just a week. This will significantly improve evidence-based medical practice and accelerate life science product R&D.. “By collaborating with Microsoft to advance AI-based oncology research, we aim to revolutionize personalized cancer treatments and drug development.”

Sagran Moodley, Chief Innovation and Technology Officer, Ontada

Why use Azure OpenAI global placement?

• Reduce costs by 50%, The ability to introduce new workloads or run existing workloads more frequently increases overall business value.
• Efficiently handle large workloads Real-time processing is not possible, which significantly reduces processing time.
• Minimize engineering overhead for task management High resource quotas allow you to: Easily queue and process gigabytes of data.. fairly high quota For placement.

New feature: Dynamic Quotas – No more quota exceeded errors!

Enabling dynamic quotas for your deployment allows you to opportunistically utilize more quotas when additional capacity becomes available.

Supported models

The models that currently support global deployment are:

Please see us for the latest information on regions and models. model page.

Key use cases

Azure OpenAI Batch API opens new possibilities across a variety of industries and applications.

1. Large-scale data processing: Quickly analyze extensive data sets in parallel to deliver faster decisions and insights.
2. Content Creation: Automate the creation of large amounts of text, such as product descriptions and articles.
3. Document review and summary: Save valuable time and resources by streamlining the review and summarization of long documents.
4. Customer Support Automation: Enhances customer support and ensures faster and more efficient responses by handling numerous inquiries simultaneously.
5. Data extraction and analysis: Gain valuable insights by extracting and analyzing information from massive amounts of unstructured data.
6. Natural language processing (NLP) tasks: Easily perform sentiment analysis, translation, and other NLP tasks on large data sets.
7. Marketing and Personalization: Increase engagement and customer satisfaction by creating personalized content and recommendations at scale.

Getting started

Ready to try the Azure OpenAI Batch API? Give it a try. here.

Learn more

Use images for batch input

Allocate and request increase in default batch token quota

Supported regions