(cache)Portkey | Control Panel for Production AI

Production Reliability at a price that works for you

Supported on All Plans:

Observability

Universal API & Key Management

Prompt Management

Routing

Developer

Free Forever

Perfect for prototyping and testing or evaluating enterprise POCs. Not suitable for production workloads.

Start for Free

10k recorded logs per month

Exceeding this limit doesn’t affect your requests; only logs beyond the limit are not recorded.

Retention

3 days for Logs, 30 days for metrics

AI Gateway

Universal API, Fallbacks, Loadbalancing, Retries & more

Observability

Logs, Traces, Feedback, Custom Metadata, Filters

Prompt Management

3 Prompt Templates, Playground, API Endpoints, Versioning, Variables

Simple Caching

Deterministic Guardrails

Community Support

POPULAR

Production

$49/month

Great for teams ready to deploy LLM apps in production. Not recommended for organizations requiring custom security controls or data residency guarantees

Upgrade Now

100k recorded logs per month

+$9 overages per additional 100k requests

Retention

30 days for logs, 90 days for metrics

AI Gateway

Universal API, Fallbacks, Load Balancing, Retries & more

Observability

Logs, Traces, Feedback, Metadata, Filters, Alerts

Guardrails

LLM & Partner Guardrails

Prompt Management

Unlimited Templates, Playground, API Endpoints, Versioning, Variables

Security

Role-Based Access Control, Service Account API Keys

Production Support

Simple & Semantic Caching

Enterprise

Custom Pricing

Built for organizations with complex compliance needs and high-volume production workloads. Get full Portkey feature set with enterprise support and multiple deployment configurations

Talk to Us

Recorded Logs

10 Mn Plus Recorded logs per month

Custom Retention Periods

Custom retention periods for Logs & Metrics

Guardrails

Custom Guardrail Hooks, Advanced Evaluation Templates

Governance

Role-Based Access Control, SSO, Granular Budget & Rate Limits

Enterprise Essentials

Private Cloud Deployment, Data Export to Data Lakes, VPC Hosting, Advanced Compliance (SOC2 Type 2, GDPR, HIPAA), Custom BAAs, Data Isolation

Support

Dedicated Onboarding & Priority Support

Also available in:

Want to know more? Schedule a call ->

With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company
With 30 million policies a month, managing over 25 GenAI use cases became a pain. Portkey helped with prompt management, tracking costs per use case, and ensuring our keys were used correctly. It gave us the visibility we needed into our AI operations.
Prateek Jogani
CTO, Qoala
Portkey is a no-brainer for anyone using AI in their GitHub workflows. It has saved us thousands of dollars by caching tests that don't require reruns, all while maintaining a robust testing and merge platform. This prevents merging PRs that could degrade production performance. Portkey is the best caching solution for our needs.
Kiran Prasad
Senior ML Engineer, Ario
We are using Portkey in staging and production, and it works really well for us. With reporting and observability being so bad on OpenAI and Azure, Portkey helps get visibility into how and where we are using AI models as we start using it at scale within our company and products.
Swapan R
CTO, Haptik
Portkey stood out among AI Gateways we evaluated for several reasons: excellent, dedicated support even during the proof of concept phase, easy-to-use APIs that reduce time spent adapting code for different models, and detailed observability features that give deep insights into traces, errors, and caching
AI Leader
Fortune 500 Pharma Company

Open Source

ⓘ

Host it Yourself

Deploy Locally

Universal API

Retries & Timeouts

Routing

Guardrails

Automatic Fallbacks

Basic Dashboard

Load Balancing

Community Support

Detailed Plan Comparision

Requests per Month

Overage

AI Gateway

Universal API

Automatic Fallbacks

Loadbalancing

Automatic Retries

Request Timeouts

Automatic user attribution

Config Management

Virtual Keys & Key Management

Simple Caching

Semantic Caching

Support for AWS, GCP, Azure Private LLM Deployments

Observability

Logs

Privacy Mode

Traces

Feedback

Custom Metadata

Filters

Alerts

Retention Period

Prompt Managements

Prompt Templates

Playground

API Deployment

Versioning

Variable Management

Guardrails

Eval Templates

Antonomous Fine-Tune

Continuous Improvement

Security & Compilance

Role Based Access Control

Team Management

SSO with Okta Auth

SOC2, ISO27001, GDPR, HIPAA Compliance Certificates

PII Anonymizer

BAA Signing for Compliances

VPC Managed Hosting

Private Tenancy

Configurable Retention Periods

Configurable exports to datalakes

Org Management

Enterprise-Grade Reliability,

backed by robust SLAs

Check Status Now

Security & Compliance

Enterprise-ready with industry-standard certifications and protocols.

Frequently Asked Questions

Some questions we get asked the most

What is Portkey?

What key features does Portkey offer?

How does Portkey work?

How many providers do you support?

How quickly do you support new LLM models/versions?

Do you support SSO and team management?

Can we set different limits for different teams/environments?

Can we prevent storage of sensitive data?

Is my data secure?

How are API keys managed?

Will Portkey add latency?

Does Portkey scale?

Does Portkey impose timeouts on requests?

Do you support SSO?

How can I get help?

What happens if I exceed my plan’s request limits?

Can we self-host Portkey?

Portkey is a comprehensive platform designed to streamline and enhance AI integration for developers and organizations

Portkey, Inc

2261 Market Street #5205,

San Francisco, CA

HIPAA

COMPLIANT

GDPR

Book a demo

11.6k