BerriAI/reliableGPT: Ensuring 100% Uptime with OpenAI

BerriAI/reliableGPT

BerriAI/reliableGPT guarantees 100% uptime from OpenAI, handling various errors. It offers retry mechanisms, context window handling, and caching for a seamless experience.
BerriAI/reliableGPT: Ensuring 100% Uptime with OpenAI

h2 BerriAI/reliableGPT: Enhancing OpenAI Uptime and Error Handling

BerriAI/reliableGPT is a powerful tool designed to ensure 100% uptime and reliability from OpenAI. It effectively handles a variety of errors including Rate Limit, Timeout, API, and Keys Errors.

Core Features:

  • Retry Mechanism: When a request to an LLM app fails, reliableGPT retries with alternate models such as GPT-4, GPT3.5, GPT3.5 16k, and text-davinci-003.
  • Context Window Handling: Automatically retries requests with models with larger context windows for Context Window Errors.
  • Cached Response: Provides caching (hosted - not in-memory) as a backup in case model fallback and retries fail. This is useful for request timeout and task queue depth issues.
  • Fallback Strategy: Allows users to specify a fallback strategy for handling failed requests. For example, users can define fallback_strategy=['gpt-3.5-turbo', 'gpt-4', 'gpt-3.5-turbo-16k', 'text-davinci-003'], and reliableGPT will retry with the specified models in the given order until it receives a valid response.
  • Backup Tokens and Keys: Enables users to pass backup keys and tokens to handle Invalid API Key errors and key rotations.

Basic Usage:

  • Installation: To get started, simply run pip install reliableGPT.
  • Integration: The core package is easy to integrate. For example, when integrating with OpenAI, Azure OpenAI, Langchain, or LlamaIndex, you can use the following code: from reliablegpt import reliableGPT; openai.ChatCompletion.create = reliableGPT(openai.ChatCompletion.create, user_email='[email protected]').

In conclusion, BerriAI/reliableGPT is a comprehensive solution for ensuring the smooth operation of LLM applications and minimizing the impact of errors. It offers a range of features and usage scenarios that make it an invaluable tool for developers and businesses relying on OpenAI.

Featured AI Tools

GenAI App Engine

GenAI App Engine

The GenAI App Engine enables custom-tailoring LLMs, streamlining development and deployment for enterprises.

SunriseAI

SunriseAI

SunriseAI is an AI co-pilot that boosts customer success and delivers insights.

Halcyon

Halcyon

Halcyon is an AI-powered decision-making tool that provides fast, accurate information.

DeepOpinion

DeepOpinion

DeepOpinion is an AI-powered enterprise automation platform that helps users streamline business operations.

CharacterX

CharacterX

CharacterX is an AI-powered infrastructure that enables enterprises to launch AI applications

AIxBlock

AIxBlock

AIxBlock is an AI-powered platform that enables building, deploying, and monetizing AI models with privacy and cost savings.

Feedbase

Feedbase

Feedbase is an AI-powered dashboard that provides insights from customer feedback and is easy to integrate.

Cassidy

Cassidy

Cassidy is an AI-powered platform that automates various tasks and integrates with multiple tools to enhance productivity.

Common Room

Common Room

Common Room is an AI-powered customer intelligence platform that boosts revenue and captures buying signals.

Dynatrace

Dynatrace

Dynatrace is an AI-powered platform that helps users simplify cloud complexity and innovate securely.

Laika AI

Laika AI

Laika AI is an AI-powered web3 ecosystem that offers diverse features and insights.

Censius AI Observability Platform

Censius AI Observability Platform

Censius is an AI-powered observability platform that helps users monitor and optimize AI models.

Kissflow

Kissflow

Kissflow is an AI-powered low-code platform that empowers users to develop applications easily.

Skipped

Skipped

Skipped enables brands and retailers to sell without limits, even when products are out-of-stock.

Cast.app

Cast.app

Cast.app is an AI-powered solution that boosts revenue and scales customer accounts with ease.

Coginiti AI

Coginiti AI

Coginiti AI is an AI-powered analytics advisor that boosts SQL development and data analysis.

Repustate

Repustate is an AI-powered sentiment analysis platform that offers unmatched insights with ease.

AIDASH

AIDASH

AIDASH is an AI-powered platform for critical infrastructure safeguarding that offers powerful solutions.

Logz.io

Logz.io

Logz.io is an AI-powered observability platform that enhances various aspects of business operations.

Oversight

Oversight

Oversight is an AI-powered platform that enhances team efficiency and manages enterprise spend risk.