# Portkey Docs > Comprehensive documentation for Portkey's AI Gateway, Guardrails, Observability, Prompts, and Governance features. ## Docs - [How to Contribute](https://portkey-docs-chore-v2-10-0.mintlify.app/README.md) - [Get cache hit latency data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-latency-data.md) - [Get cache hit rate data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-rate-data.md) - [Get cost data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cost-data.md) - [Get error rate data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-error-rate-data.md) - [Get errors data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-errors-data.md) - [Get feedback data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-data.md) - [Get feedback per ai models data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-per-ai-models-data.md) - [Get feedback score distribution data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-score-distribution-data.md) - [Get latency data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-latency-data.md) - [Get requests data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-data.md) - [Get requests per user data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-per-user-data.md) - [Get rescued requests data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-rescued-requests-data.md) - [Get status code data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-status-code-data.md) - [Get tokens data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-tokens-data.md) - [Get unique status code data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-unique-status-code-data.md) - [Get users data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-users-data.md) - [Get weighted feedback data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-weighted-feedback-data.md) - [Get Metadata Grouped Data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-metadata-grouped-data.md) - [Get Model Grouped Data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-model-grouped-data.md) - [Get User Grouped Data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-user-grouped-data.md) - [Get User Grouped Data](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/analytics/summary/get-all-cache-data.md) - [Create API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/create-api-key.md): Creates a new API… - [Delete an API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/delete-an-api-key.md) - [List API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/list-api-keys.md) - [Retrieve an API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/retrieve-an-api-key.md) - [Rotate API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/rotate-api-key.md): Rotates an existin… - [Update API Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/api-keys/update-api-key.md): Updates an existin… - [List Audit Logs](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/audit-logs/list-audit-logs.md) - [Create Config](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/create-config.md) - [Delete Config](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/delete-config.md) - [List Config Versions](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/list-config-versions.md) - [List Configs](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/list-configs.md) - [Retrieve Config](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/retrieve-config.md) - [Update Config](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/configs/update-config.md) - [Create Guardrail](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/guardrails/create-guardrail.md): Creates a new guar… - [Delete Guardrail](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/guardrails/delete-guardrail.md): Deletes an existin… - [List Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/guardrails/list-guardrails.md): Retrieves a pagina… - [Retrieve Guardrail](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/guardrails/retrieve-guardrail.md): Retrieves details… - [Update Guardrail](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/guardrails/update-guardrail.md): Updates an existin… - [Create Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/create-integration.md) - [Delete Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/delete-integration.md) - [List Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/list-integrations.md) - [Delete Custom Model](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/models/delete-custom-model.md): Removes multiple c… - [List Model Access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/models/list-model-access.md): Retrieves all mode… - [Update Model Access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/models/update-model-access.md): Updates model acce… - [Retrieve Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/retrieve-integration.md) - [Update Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/update-integration.md) - [List Workspace Access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/workspaces/list-workspace-access.md): Retrieves workspac… - [Update Workspace Access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/integrations/workspaces/update-workspace-access.md): Updates workspace… - [List MCP Integration Capabilities](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/capabilities/list-mcp-integration-capabilities.md) - [Update MCP Integration Capabilities](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/capabilities/update-mcp-integration-capabilities.md) - [Create MCP Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/create-mcp-integration.md): Create a new MCP I… - [Delete MCP Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/delete-mcp-integration.md) - [List MCP Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/list-mcp-integrations.md): List MCP Integrati… - [Retrieve MCP Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/retrieve-mcp-integration.md) - [Retrieve MCP Integration Metadata](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/retrieve-mcp-integration-metadata.md) - [Update MCP Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/update-mcp-integration.md) - [List MCP Integration Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/workspaces/list-mcp-integration-workspaces.md) - [Update MCP Integration Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-integrations/workspaces/update-mcp-integration-workspaces.md) - [Bulk update MCP Server capability overrides](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/capabilities/bulk-update-mcp-server-capabilities.md) - [List MCP Server capabilities](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/capabilities/list-mcp-server-capabilities.md) - [Delete MCP Server Connection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/connections/delete-mcp-server-connection.md) - [List MCP Server Connections](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/connections/list-mcp-server-connections.md) - [Create MCP Server](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/create-mcp-server.md): Create a new MCP S… - [Delete MCP Server](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/delete-mcp-server.md) - [List MCP Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/list-mcp-servers.md): List MCP Servers f… - [Retrieve MCP Server](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/retrieve-mcp-server.md) - [Test MCP Server connection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/test-mcp-server.md): Test connectivity… - [Update MCP Server](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/update-mcp-server.md) - [Bulk update MCP Server user access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/user-access/bulk-update-mcp-server-user-access.md) - [List MCP Server user access](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/mcp-servers/user-access/list-mcp-server-user-access.md) - [Create Rate Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/rate-limits/create-rate-limits-policy.md): Create a new rate… - [Delete Rate Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/rate-limits/delete-rate-limits-policy.md): Delete a rate limi… - [List Rate Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/rate-limits/list-rate-limits-policy.md): List all rate limi… - [Retrieve Rate Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/rate-limits/retrieve-rate-limits-policy.md): Get a single rate… - [Update Rate Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/rate-limits/update-rate-limits-policy.md): Update an existing… - [Create Usage Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/create-usage-limits-policy.md): Create a new usage… - [Delete Usage Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/delete-usage-limits-policy.md): Archive (soft dele… - [List Usage Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/list-usage-limits-policy.md): List all usage lim… - [List Usage Limits Policy Entities](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/list-usage-limits-policy-entities.md): List entities trac… - [Reset Usage Limits Policy Entity](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/reset-usage-limits-policy-entity.md): Reset the current… - [Retrieve Usage Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/retrieve-usage-limits-policy.md): Get a single usage… - [Update Usage Limits Policy](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/policies/usage-limits/update-usage-limits-policy.md): Update an existing… - [Create Prompt Collection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/collections/create-collection.md): Creates a new coll… - [Delete Prompt Collection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/collections/delete-collection.md): Deletes a collecti… - [List Prompt Collections](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/collections/list-collections.md): Lists all collecti… - [Retrieve Prompt Collection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/collections/retrieve-collection.md): Retrieves details… - [Update Prompt Collection](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/collections/update-collection.md): Updates a collecti… - [Create Prompt](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/create-prompt.md) - [Delete Prompt](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/delete-prompt.md) - [Create Label](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/labels/create-label.md): Creates a new labe… - [Delete Label](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/labels/delete-label.md): Deletes a label - [List Labels](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/labels/list-labels.md): Returns a list of… - [Retrieve Label](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/labels/retrieve-label.md): Returns a specific… - [Update Label](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/labels/update-label.md): Updates an existin… - [List Prompt Versions](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/list-prompt-versions.md) - [List Prompts](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/list-prompts.md) - [Create Partial](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/create-partial.md) - [Delete Partial](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/delete-partial.md) - [List Partial Versions](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/list-partial-versions.md) - [List Partials](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/list-partials.md) - [Publish Partial](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/publish-partial.md) - [Retrieve Partial](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/retrieve-partial.md) - [Update Partial](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/partials/update-partial.md) - [Publish Prompt](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/publish-prompt.md) - [Retrieve Prompt](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/retrieve-prompt.md) - [Retrieve Prompt Version](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/retrieve-prompt-version.md) - [Update Prompt](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/update-prompt.md): Update a prompt's… - [Update Prompt Version](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/prompts/update-prompt-version.md): Updates metadata f… - [Create Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/providers/create-provider.md) - [Delete Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/providers/delete-provider.md) - [List Providers](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/providers/list-providers.md) - [Retrieve Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/providers/retrieve-provider.md) - [Update Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/providers/update-provider.md) - [Create SCIM Workspace Mapping](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/scim-workspace-mappings/create-scim-workspace-mapping.md): Create a mapping b… - [Delete SCIM Workspace Mapping](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/scim-workspace-mappings/delete-scim-workspace-mapping.md): Remove a SCIM grou… - [List SCIM Workspace Mappings](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/scim-workspace-mappings/list-scim-workspace-mappings.md): List all mappings… - [Create Secret Reference](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/secret-references/create-secret-reference.md) - [Delete Secret Reference](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/secret-references/delete-secret-reference.md) - [List Secret References](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/secret-references/list-secret-references.md) - [Retrieve Secret Reference](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/secret-references/retrieve-secret-reference.md) - [Update Secret Reference](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/secret-references/update-secret-reference.md) - [Delete a user invite](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/user-invites/delete-a-user-invite.md) - [Invite a User](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/user-invites/invite-a-user.md): Send an invite to… - [Resend a user invite](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/user-invites/resend-a-user-invite.md): Resend an invite t… - [Retrieve all user invite](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/user-invites/retrieve-all-user-invites.md) - [Retrieve an user invite](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/user-invites/retrieve-an-invite.md) - [Remove a user](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/users/remove-a-user.md) - [Retrieve a user](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/users/retrieve-a-user.md) - [Retrieve all users](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/users/retrieve-all-users.md) - [Update a user](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/users/update-a-user.md) - [Create Virtual Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/virtual-keys/create-virtual-key.md) - [Delete Virtual Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/virtual-keys/delete-virtual-key.md) - [List Virtual Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/virtual-keys/list-virtual-keys.md) - [Retrieve Virtual Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/virtual-keys/retrieve-virtual-key.md) - [Update Virtual Key](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/virtual-keys/update-virtual-key.md) - [Add a Workspace Member](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspace-members/add-a-workspace-member.md) - [Remove Workspace Member](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspace-members/remove-workspace-member.md) - [Retrieve a Workspace Member](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspace-members/retrieve-a-workspace-member.md) - [Retrieve all Workspace Member](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspace-members/retrieve-all-workspace-members.md) - [Update Workspace Member](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspace-members/update-workspace-member.md) - [Create Workspace](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspaces/create-workspace.md) - [Delete a Workspace](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspaces/delete-a-workspace.md) - [Retrieve a Workspace](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspaces/retrieve-a-workspace.md) - [Retrieve all Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspaces/retrieve-all-workspaces.md) - [Update Workspace](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/control-plane/workspaces/update-workspace.md) - [Create Feedback](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/feedback/create-feedback.md): This endpoint allo… - [Update Feedback](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/feedback/update-feedback.md): This endpoint allo… - [Insert a Log](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/insert-a-log.md): Submit one or more… - [Cancel a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/cancel-a-log-export.md) - [Create a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/create-a-log-export.md) - [Download a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/download-a-log-export.md) - [List a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/list-log-exports.md) - [Retrieve a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/retrieve-a-log-export.md) - [Start a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/start-a-log-export.md) - [Update a Log Export](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/data-plane/logs/log-exports-beta/update-a-log-export.md) - [Errors](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/error.md): Error codes return… - [Introduction](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/introduction.md): Manage your Portke… - [OpenAPI Specification](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/admin-api/open-api-specification.md) - [Agentic Usage](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/agentic-usage.md): Add Portkey SDK sk… - [Create Assistant](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/assistants/create-assistant.md) - [Delete Assistant](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/assistants/delete-assistant.md) - [List Assistant](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/assistants/list-assistants.md) - [Modify Assistant](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/assistants/modify-assistant.md) - [Retrieve Assistant](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/assistants/retrieve-assistant.md) - [Create Message](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/messages/create-message.md) - [Delete Message](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/messages/delete-message.md) - [List Message](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/messages/list-messages.md) - [Modify Message](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/messages/modify-message.md) - [Retrieve Message](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/messages/retrieve-message.md) - [List Run Steps](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/run-steps/list-run-steps.md) - [Retrieve Run Steps](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/run-steps/retrieve-run-steps.md) - [Cancel Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/cancel-run.md) - [Create Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/create-run.md) - [Create thread and Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/create-thread-and-run.md) - [list Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/list-runs.md) - [Modify Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/modify-run.md) - [Retrieve Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/retrieve-run.md) - [Submit Tool Outputs to Run](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/runs/submit-tool-outputs-to-run.md) - [Create Thread](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/threads/create-thread.md) - [Delete Thread](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/threads/delete-thread.md) - [Modify Thread](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/threads/modify-thread.md) - [Retrieve Thread](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/assistants-api/threads/retrieve-thread.md) - [Create Speech](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/audio/create-speech.md) - [Create Transcription](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/audio/create-transcription.md) - [Create Translation](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/audio/create-translation.md) - [Authentication](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/authentication.md) - [Cancel Batch](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/batch/cancel-batch.md) - [Create Batch](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/batch/create-batch.md) - [List Batch](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/batch/list-batch.md) - [Retrieve Batch](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/batch/retrieve-batch.md) - [Chat](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/chat.md) - [Completions](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/completions.md) - [Gateway Config Object](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/config-object.md) - [Embeddings](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/embeddings.md) - [Errors](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/error-codes.md) - [Delete File](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/files/delete-file.md) - [List Files](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/files/list-files.md) - [Retrieve File](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/files/retrieve-file.md) - [Retrieve File Content](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/files/retrieve-file-content.md) - [Upload File](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/files/upload-file.md) - [Cancel Fine-tuning](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/cancel-fine-tuning.md) - [Create Fine-tuning Job](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/create-fine-tuning-job.md): Finetune a provide… - [List Fine-tuning Checkpoints](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/list-fine-tuning-checkpoints.md) - [List Fine-tuning Events](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/list-fine-tuning-events.md) - [List Fine-tuning Jobs](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/list-fine-tuning-jobs.md) - [Retrieve Fine-tuning Job](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/fine-tuning/retrieve-fine-tuning-job.md) - [Gateway to Other APIs](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/gateway-for-other-apis.md): Access any custom… - [Headers](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/headers.md): Header requirement… - [Create Image](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/images/create-image.md) - [Create Image Edit](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/images/create-image-edit.md) - [Create Image Variation](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/images/create-image-variation.md) - [Introduction](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/introduction.md): This documentation… - [Models](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/models/models.md): Lists the currentl… - [Moderations](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/moderations.md) - [OpenAPI Specification](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/open-api-specification.md) - [Prompt Completions](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/prompts/prompt-completion.md): Execute your saved… - [Prompt Render](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/prompts/render.md): Renders a prompt t… - [Rerank](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/rerank.md): Reranks a list of… - [Response Schema](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/response-schema.md) - [Delete a Response](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/responses/delete-response.md) - [Create a Response](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/responses/responses.md) - [List Input Items](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/responses/retrieve-inputs.md) - [Get a Response](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/responses/retrieve-response.md) - [Supported Providers](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/inference-api/supported-providers.md) - [C# (.NET)](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/sdk/c-sharp.md): Integrate Portkey… - [Supported SDKs](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/sdk/list.md): Find the best way… - [Node.js](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/sdk/node.md): Official Portkey N… - [Python](https://portkey-docs-chore-v2-10-0.mintlify.app/api-reference/sdk/python.md): Official Portkey P… - [December](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2024/dec.md) - [November](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2024/nov.md) - [October](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2024/oct.md) - [April](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/apr.md) - [August](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/august.md) - [December](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/december.md) - [February](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/feb.md) - [January](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/jan.md) - [July](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/july.md) - [June](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/june.md) - [March](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/mar.md) - [May](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/may.md) - [November](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/november.md) - [October](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/october.md) - [September](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2025/september.md) - [April](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2026/april.md) - [February](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2026/february.md) - [January](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2026/january.md) - [March](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/2026/march.md) - [Backend](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/backend.md) - [Data Service](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/data-service.md) - [Enterprise Gateway](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/enterprise.md) - [Frontend](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/frontend.md) - [Helm Chart](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/helm-chart.md) - [Node.js](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/node-sdk-changelog.md) - [Latest Updates](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/product.md) - [Python](https://portkey-docs-chore-v2-10-0.mintlify.app/changelog/python-sdk-changelog.md) - [Portkey CLI](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/coding-agents/agent-cli.md): Wire Claude Code,… - [Skills Registry](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/coding-agents/skills.md): Create versioned,… - [Converting STDIO to Remote MCP Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/converting-stdio-to-streamable-http.md): Step-by-step guide… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started.md) - [101 on Portkey's Gateway Configs](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/101-on-portkey-s-gateway-configs.md): You are likely fam… - [A/B Test Prompts and Models](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/a-b-test-prompts-and-models.md): A/B testing with l… - [Function Calling](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/function-calling.md): Get the LLM to int… - [Getting Started with AI Gateway](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/getting-started-with-ai-gateway.md): Connect to 1,600+… - [Image Generation](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/image-generation.md) - [Llama 3 on Groq](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/llama-3-on-groq.md) - [Return Repeat Requests from Cache](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/return-repeat-requests-from-cache.md): If you have multip… - [Tackling Rate Limiting](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/tackling-rate-limiting.md): LLMs are **costly*… - [Trigger Automatic Retries on LLM Failures](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/getting-started/trigger-automatic-retries-on-llm-failures.md) - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations.md) - [Anyscale](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/anyscale.md): Portkey helps brin… - [Deepinfra](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/deepinfra.md) - [Groq](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/groq.md) - [Introduction to GPT-4o](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/introduction-to-gpt-4o.md) - [Langchain](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/langchain.md) - [Llama 3 on Portkey + Together AI](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/llama-3-on-portkey-+-together-ai.md): Try out the new Ll… - [Mistral](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/mistral.md): Portkey helps brin… - [Mixtral 8x22b](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/mixtral-8x22b.md) - [Sync Open WebUI Feedback → Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/openwebui-to-portkey.md): How to export thum… - [Segmind](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/segmind.md) - [Vercel AI](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/integrations/vercel-ai.md): Portkey is a contr… - [Prompts](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/prompts.md) - [Build a chatbot using Portkey's Prompt Templates](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/prompts/build-a-chatbot-using-portkeys-prompt-templates.md): Portkey's prompt t… - [Optimizing Prompts for Customer Support using Portkey | LLama Prompt Ops Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/prompts/llama-prompts.md) - [Building an LLM-as-a-Judge System for AI (Customer Support) Agent](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/prompts/llm-as-a-judge.md) - [Ultimate AI SDR](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/prompts/ultimate-ai-sdr.md): Building a sophist… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases.md) - [Build an article suggestion app with Supabase pgvector, and Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/build-an-article-suggestion-app-with-supabase-pgvector-and-portkey.md): Consider that you… - [Combining Routing Strategies: Conditional, Load Balancing & Fallbacks](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/combining-routing-strategies.md): Every Portkey rout… - [Comparing Top10 LMSYS Models with Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/comparing-top10-lmsys-models-with-portkey.md) - [Creating your own partner guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/creating-partner-guardrails.md): Build custom guard… - [Comparing DeepSeek Models Against OpenAI, Anthropic & More Using Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/deepseek-r1.md) - [Detecting Emotions with GPT-4o](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/emotions-with-gpt-4o.md) - [Enforcing JSON Schema with Anyscale & Together](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/enforcing-json-schema-with-anyscale-and-together.md): Get the LLM to adh… - [Enforcing Budget, Token & Rate Limits: Use Cases](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/enforcing-limits-and-budgets.md): A practical guide… - [Unified LLM API with Automatic Failover & Error Handling](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/enterprise-ready-unified-api.md): Build a single API… - [Fallback from SDXL to Dall-e-3](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/fallback-from-sdxl-to-dall-e-3.md): Generative AI mode… - [Testing Application Resilience with Fallbacks](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/fallbacks-test.md) - [Few-Shot Prompting](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/few-shot-prompting.md): LLMs are highly ca… - [How to use Portkey Guardrails for PII Protection](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/guardrail-pii-use-case.md): Portkey Guardrails… - [How to use OpenAI SDK with Portkey Prompt Templates](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/how-to-use-openai-sdk-with-portkey-prompt-templates.md): Portkeys Prompt Pl… - [Web Search for Any LLM in LibreChat](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/librechat-web-search.md) - [Request metadata use cases](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/metadata-use-cases.md): Attach business co… - [Multi-Tenant LLM Access with Enterprise Control for Customer-Facing Apps](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/multi-tenant-ai-feature.md) - [Portkey with OpenAI Computer Use](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/openai-computer-use.md): Leverage Portkey w… - [Using Private MCP Servers with Responses API](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/private-mcp-servers.md): Client-side tool h… - [How to Run Structured Output Evals at Scale](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/run-batch-evals.md) - [Run Portkey on Prompts from Langchain Hub](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/run-portkey-on-prompts-from-langchain-hub.md): Writing the right… - [Setting up resilient Load balancers with failure-mitigating Fallbacks](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/setting-up-resilient-load-balancers-with-failure-mitigating-fallbacks.md): Companies often fa… - [Setup OpenAI -> Azure OpenAI Fallback](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/setup-openai-greater-than-azure-openai-fallback.md): Portkey Fallbacks… - [Smart Fallback with Model-Optimized Prompts](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/smart-fallback-with-model-optimized-prompts.md): Portkey can help y… - [Tracking LLM Costs Per User with Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/use-cases/track-costs-using-metadata.md): Monitor and analyz… - [4. Advanced Strategies for Performance Improvement](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/advanced-strategies.md) - [5. Architectural Considerations](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/architectural-considerations.md) - [10. Conclusion and Key Takeaways](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/conclusion-and-key-takeaways.md): Summarizing the ke… - [7. Cost Effective Development Practices](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/cost-effective-development.md) - [Executive Summary](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/executive-summary.md): Overview of LLM co… - [3. FrugalGPT Techniques for Cost Optimization](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/frugalgpt-techniques.md) - [9. Future Trends in LLM Cost Optimization](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/future-trends.md) - [1. Introduction](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/introduction.md): An overview of the… - [2. Understanding LLM Cost Drivers](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/llm-cost-drivers.md): An overview of the… - [6. Operational Best Pracitces](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/operational-best-practices.md) - [8. User Education and Change Management](https://portkey-docs-chore-v2-10-0.mintlify.app/guides/whitepapers/optimizing-llm-costs/user-education.md) - [Error AB03: You do not have enough permissions](https://portkey-docs-chore-v2-10-0.mintlify.app/help-center/you-do-not-have-enough-permissions.md): Troubleshoot and r… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents.md): Portkey helps brin… - [AWS AgentCore](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/agentcore.md): Run Portkey-powere… - [Agno AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/agno-ai.md): Use Portkey with A… - [Autogen](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/autogen.md): Use Portkey with A… - [Bring Your own Agents](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/bring-your-own-agents.md): You can also use P… - [Claude Agent SDK](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/claude-agent-sdk.md): Use Portkey with C… - [Control Flow](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/control-flow.md): Use Portkey with C… - [CrewAI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/crewai.md): Use Portkey with C… - [Langchain Agents](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/langchain-agents.md) - [LangGraph](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/langgraph.md): Use Portkey with L… - [Langroid](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/langroid.md) - [LiveKit](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/livekit.md): Build production-r… - [Llama Agents by Llamaindex](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/llama-agents.md): Use Portkey with L… - [Mastra Agents](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/mastra-agents.md): Use Portkey with M… - [OpenAI Agents SDK (Python)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/openai-agents.md): Use Portkey with O… - [OpenAI Agents SDK (TypeScript)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/openai-agents-ts.md): Use Portkey with O… - [OpenAI Swarm](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/openai-swarm.md): The Portkey x Swar… - [Phidata](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/phidata.md): Use Portkey with P… - [Pydantic AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/pydantic-ai.md): Use Portkey with P… - [Strands Agents](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/agents/strands.md): Use Portkey with A… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/ai-apps.md) - [Microsoft Azure](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/cloud/azure.md): Discover how you c… - [Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/ecosystem.md) - [Acuvity](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/acuvity.md): Acuvity is model a… - [Akto](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/akto.md): Akto Agentic Secur… - [Aporia](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/aporia.md) - [Azure Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/azure-guardrails.md): Integrate Microsof… - [AWS Bedrock Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/bedrock-guardrails.md): Secure your AI app… - [Bring Your Own Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/bring-your-own-guardrails.md): Integrate your cus… - [Cato Networks](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/cato.md): Cato Networks AI s… - [CrowdStrike AIDR](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/crowdstrike-aidr.md): CrowdStrike AI Det… - [F5 Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/f5-guardrails.md): F5 Guardrails (pow… - [Javelin (Highflame)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/javelin.md): Javelin provides c… - [JWT Token Validator](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/jwt.md): Validate JWT token… - [Lakera](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/lakera.md): Lakera Guard scree… - [Lasso Security](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/lasso.md): Lasso Security is… - [Mistral](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/mistral.md): Mistral moderation… - [Model Rules](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/model-rules.md): Allow or block req… - [Palo Alto Networks Prisma AIRS](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/palo-alto-panw-prisma.md): Comprehensive AI s… - [Pangea](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/pangea.md): Pangea AI Guard he… - [Patronus AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/patronus-ai.md): Patronus excels in… - [Pillar](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/pillar.md) - [Prompt Security](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/prompt-security.md): Prompt Security de… - [Qualifire](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/qualifire.md): Qualifire provides… - [Replace Custom Regex Patterns](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/regex.md): Redact custom patt… - [Request Parameters Check](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/request-parameters-check.md): Allow or block too… - [Tavily](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/tavily.md): Tavily enriches LL… - [Zscaler AI Guard](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/guardrails/zscaler.md): Zscaler AI Guard i… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries.md) - [Android Studio](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/android-studio.md): Add observability,… - [Anthropic Computer Use](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/anthropic-computer-use.md) - [AnythingLLM](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/anythingllm.md): Add usage tracking… - [Autogen (DEPRECATED)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/autogen.md): AutoGen is a frame… - [Claude Code](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-code.md): Integrate Portkey… - [Claude Code with Anthropic](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-code-anthropic.md): Route Claude Code… - [Claude Code with Amazon Bedrock](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-code-bedrock.md): Route Claude Code… - [Claude Code with Google Vertex AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-code-vertex.md): Route Claude Code… - [Claude Cowork](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-cowork.md): Add observability,… - [Claude Desktop](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-desktop.md): Route Claude Deskt… - [Claude Desktop for Developers](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-desktop-developers.md): Connect Claude Des… - [Claude Desktop for Platform Admins](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/claude-desktop-platform-admins.md): Roll out Claude De… - [Cline](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/cline.md): Add enterprise-gra… - [OpenAI Codex](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/codex.md): Add usage tracking… - [Conductor](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/conductor.md): Add usage tracking… - [Cursor](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/cursor.md): Add observability,… - [DSPy](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/dspy.md): Integrate DSPy wit… - [GitHub Copilot](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/github-copilot.md): Add observability,… - [Goose](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/goose.md): Add usage tracking… - [Hermes Agent](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/hermes-agent.md): Route the Hermes a… - [Instructor](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/instructor.md): Add observability… - [Jan](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/janhq.md): Add usage tracking… - [Langchain (JS/TS)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/langchain-js.md): Add Portkey's ente… - [Langchain (Python)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/langchain-python.md): Add Portkey's ente… - [Langflow](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/langflow.md): Add enterprise-gra… - [LibreChat](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/librechat.md): Cost tracking, obs… - [LlamaIndex (Python)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/llama-index-python.md): Add Portkey's ente… - [Microsoft Semantic Kernel](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/microsoft-semantic-kernel.md) - [MindsDB](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/mindsdb.md): Integrate MindsDB… - [MongoDB](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/mongodb.md): Store Portkey logs… - [n8n](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/n8n.md): Add observability,… - [OpenAI Agent Builder (TypeScript)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openai-agent-builder.md): Add Portkey to vis… - [OpenAI Agent Builder (Python)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openai-agent-builder-python.md): Add Portkey to vis… - [Any OpenAI-Compatible Project](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openai-compatible.md): Add Portkey to any… - [OpenClaw](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openclaw.md): Route OpenClaw thr… - [OpenCode](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/opencode.md): centralised cost m… - [Open WebUI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openwebui.md): Enterprise-grade c… - [Image Generation with Open WebUI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/openwebui/image-generation-with-openwebui.md) - [Pi Agent](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/pi-agent.md): Route Pi coding ag… - [Promptfoo](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/promptfoo.md): Run Promptfoo eval… - [Retool](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/retool.md): Connect Portkey as… - [Roo Code](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/roo-code.md): Add enterprise-gra… - [Supabase](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/supabase.md): Generate embedding… - [ToolJet](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/tooljet.md): Add AI capabilitie… - [Vercel AI SDK](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/vercel.md): Use Portkey with V… - [Zed](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/libraries/zed.md): Learn how to integ… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms.md): Portkey connects w… - [AI21](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/ai21.md): Integrate AI21 mod… - [Anthropic](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic.md): Integrate Anthropi… - [Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/batches.md): Run asynchronous b… - [Computer use tool](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/computer-use.md) - [Count Tokens](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/count-tokens.md) - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/files.md): Upload and manage… - [Prompt Caching](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/prompt-caching.md) - [Remote MCP Support](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/remote-mcp.md) - [Structured Outputs](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anthropic/structured-outputs.md): Direct models to r… - [Anyscale](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/anyscale-llama2-mistral-zephyr.md): Use Anyscale's ser… - [AWS SageMaker](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/aws-sagemaker.md): Route to your AWS… - [Azure AI Foundry](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-foundry.md): Learn how to integ… - [Authentication](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/authentication.md): Authenticate Portk… - [Azure Government Cloud](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/azure-govcloud.md) - [Azure OpenAI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/azure-openai.md): Azure OpenAI is a… - [Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/batches.md): Perform batch infe… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/files.md): Upload files to Az… - [Fine-tune](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/azure-openai/fine-tuning.md): Fine-tune your mod… - [Amazon Bedrock Mantle](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock-mantle.md): OpenAI-compatible… - [AWS Bedrock](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/aws-bedrock.md) - [AWS GovCloud with Bedrock](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/aws-govcloud.md) - [Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/batches.md): Perform batch infe… - [AWS Bedrock Knowledge Bases](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/bedrock-knowledgebase.md): Create, manage, an… - [Embeddings](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/embeddings.md): Get embeddings fro… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/files.md): Upload files to S3… - [Fine-tune](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/fine-tuning.md): Fine-tune your mod… - [Prompt Caching on Bedrock](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/prompt-caching.md) - [Rerank](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/rerank.md): Rerank documents w… - [Structured Outputs](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/bedrock/structured-outputs.md): Direct models to r… - [Bring Your Own LLM](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/byollm.md): Integrate your pri… - [BytePlus ModelArk](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/byteplus.md): Integrate BytePlus… - [Cerebras](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/cerebras.md): Integrate Cerebras… - [Claude Platform (AWS) (Beta)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/claude-platform-aws.md): Access Claude full… - [Cohere](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/cohere.md): Integrate Cohere m… - [Dashscope](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/dashscope.md): Integrate Dashscop… - [Databricks](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/databricks.md): Integrate Databric… - [Deepbricks](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/deepbricks.md): Use Deepbricks' AI… - [Deepgram](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/deepgram.md): Use Deepgram's Spe… - [Deepinfra](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/deepinfra.md): Integrate Deepinfr… - [DeepSeek](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/deepseek.md): Integrate DeepSeek… - [fal.ai](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/fal-ai.md): Integrate fal.ai m… - [Featherless AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/featherless.md): Access 11,900+ ope… - [Fireworks](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/fireworks.md): Use Fireworks for… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/fireworks/files.md): Upload files to Fi… - [Fine-tune](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/fireworks/fine-tuning.md): Fine-tune your mod… - [Google Gemini](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/gemini.md) - [GitHub Models](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/github.md): Use GitHub Models… - [Groq](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/groq.md): Use Groq's ultra-f… - [Hugging Face](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/huggingface.md): Use Hugging Face I… - [Inference.net](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/inference.net.md): Use Inference.net'… - [Jina AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/jina-ai.md): Use Jina AI's embe… - [Lambda Labs](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/lambda.md): Use Lambda's GPU-p… - [Lemonfox-AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/lemon-fox.md): Integrate LemonFox… - [Lepton AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/lepton.md): Use Lepton AI's se… - [Lingyi (01.ai)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/lingyi-01.ai.md): Use Lingyi's Yi mo… - [LocalAI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/local-ai.md): Integrate LocalAI-… - [Mistral AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/mistral-ai.md): Integrate Mistral… - [Modal Labs](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/modal.md): Integrate Modal wi… - [Monster API](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/monster-api.md): Access generative… - [Moonshot](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/moonshot.md): Use Moonshot's AI… - [Ncompass](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/ncompass.md): Use Ncompass's AI… - [Nebius](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/nebius.md): Use Nebius AI's in… - [Nomic](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/nomic.md): Use Nomic's superi… - [Novita AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/novita-ai.md): Use Novita AI's in… - [Nscale (EU Sovereign)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/nscale.md): Use Nscale's EU-ba… - [Ollama](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/ollama.md): Integrate Ollama-h… - [OpenAI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai.md): Integrate OpenAI's… - [Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/batches.md): Perform batch infe… - [Embeddings](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/embeddings.md): Generate vector em… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/files.md): Upload files to Op… - [Fine-tune](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/fine-tuning.md): Fine-tune your mod… - [Prompt Caching](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/prompt-caching-openai.md) - [Remote MCP Support](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/remote-mcp.md) - [Structured Outputs](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openai/structured-outputs.md): Structured Outputs… - [OpenRouter](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/openrouter.md): Integrate OpenRout… - [Oracle Cloud Infrastructure](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/oracle.md) - [OVHcloud AI Endpoints](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/ovhcloud.md) - [Perplexity AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/perplexity-ai.md): Use Perplexity's o… - [Predibase](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/predibase.md): Use Predibase's op… - [Recraft AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/recraft-ai.md): Use Recraft AI's a… - [Reka AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/reka-ai.md): Integrate Reka AI… - [Replicate](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/replicate.md): Use Portkey as a p… - [SambaNova](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/sambanova.md): Use SambaNova's fa… - [Segmind](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/segmind.md): Use Segmind's Stab… - [SiliconFlow](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/siliconflow.md): Use SiliconFlow's… - [Snowflake Cortex](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/snowflake-cortex.md): Use Snowflake Cort… - [Stability AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/stability-ai.md): Use Stability AI's… - [Suggest a new integration!](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/suggest-a-new-integration.md) - [Together AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/together-ai.md): Integrate Together… - [Triton Inference Server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/triton.md): Integrate Triton-h… - [Upstage AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/upstage.md): Integrate Upstage… - [Google Vertex AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai.md) - [Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/batches.md): Perform batch infe… - [Controlled Generations](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/controlled-generations.md): Controlled Generat… - [Embeddings](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/embeddings.md): Get embeddings fro… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/files.md): Upload files to Go… - [Fine-tune](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/fine-tuning.md): Fine-tune your mod… - [Rerank](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/rerank.md): Rerank documents w… - [Text-to-Speech](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vertex-ai/text-to-speech.md): Generate speech fr… - [vLLM](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/vllm.md): Integrate vLLM-hos… - [Voyage AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/voyage-ai.md): Use Voyage AI's em… - [Workers AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/workers-ai.md): Use Cloudflare Wor… - [xAI (Grok)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/x-ai.md): Use xAI's Grok mod… - [Z.AI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/z-ai.md): Use Z.AI's GLM mod… - [ZhipuAI / ChatGLM / BigModel](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/llms/zhipu.md): Use ZhipuAI's GLM… - [Claude Desktop](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-clients/claude.md): Connect your MCP s… - [Claude Code](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-clients/claude-code.md): Connect your MCP s… - [Cursor](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-clients/cursor.md): Connect your MCP s… - [LibreChat](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-clients/librechat.md): Connect your MCP s… - [VS Code](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-clients/vs-code.md): Connect your MCP s… - [Atlassian Remote MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/atlassian-mcp-server.md): The Atlassian Remo… - [Cerebras Code MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/cerebras-code-mcp-server.md): The **Cerebras Cod… - [Datadog MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/datadog-mcp-server.md): The Datadog MCP se… - [Figma MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/figma-mcp-server.md): The Figma MCP serv… - [Firebase MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/firebase-mcp-server.md): The Firebase MCP s… - [Firecrawl MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/firecrawl-mcp-server.md): The Firecrawl MCP… - [GitHub MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/github-mcp-server.md): The GitHub MCP ser… - [Gitlab MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/gitlab-mcp-server.md): The GitLab MCP ser… - [Grafana MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/grafana-mcp-server.md): The Grafana MCP se… - [Kubernetes MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/kubernetes-mcp-server.md): The Kubernetes MCP… - [Linear MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/linear-mcp-server.md): The Linear MCP ser… - [Notion MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/notion-mcp-server.md): The Notion MCP ser… - [Open Library MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/open-library-mcp-server.md): The Open Library M… - [Playwright MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/playwright-mcp-server.md): The Playwright MCP… - [Postman MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/postman-mcp-server.md): The Postman MCP Se… - [Qdrant MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/qdrant-mcp-server.md): The Qdrant MCP ser… - [Slack MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/slack-mcp-server.md): Connect Slack's ho… - [Stripe MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/stripe-mcp-server.md): The Stripe MCP ser… - [Tavily MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/tavily-mcp-server.md): The Tavily MCP ser… - [Vectara MCP server](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/mcp-servers/vectara-mcp-server.md): The Vectara MCP se… - [Submit an Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/partner.md) - [Exa Online Search](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/plugins/exa.md): Transform offline… - [Tavily Online Search](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/plugins/tavily.md): Add live web conte… - [Arize Phoenix](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/arize.md): Extend Portkey’s p… - [FutureAGI](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/future-agi.md): Integrate FutureAG… - [HoneyHive](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/honeyhive.md): Integrate HoneyHiv… - [Langfuse](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/langfuse.md): Integrate Langfuse… - [Langsmith](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/langsmith.md): Integrate LangSmit… - [Pydantic Logfire](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/logfire.md): Modern Python obse… - [MLflow Tracing](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/ml-flow.md): Enhance LLM observ… - [OpenLIT](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/openlit.md): Simplify AI develo… - [OpenTelemetry Python SDK](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/opentelemetry-python-sdk.md): Direct OpenTelemet… - [Phoenix(Arize) Open-Telemetry](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/phoenix.md): AI observability a… - [Traceloop (OpenLLMetry)](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/tracing-providers/traceloop.md) - [Milvus](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/vector-databases/milvus.md) - [Qdrant](https://portkey-docs-chore-v2-10-0.mintlify.app/integrations/vector-databases/qdrant.md) - [Portkey Features](https://portkey-docs-chore-v2-10-0.mintlify.app/introduction/feature-overview.md): Explore the powerf… - [Make Your First Request](https://portkey-docs-chore-v2-10-0.mintlify.app/introduction/make-your-first-request.md): Integrate Portkey… - [What is Portkey?](https://portkey-docs-chore-v2-10-0.mintlify.app/introduction/what-is-portkey.md): Portkey AI is a co… - [Configure Analytics Access Permissions for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-analytics-access-permissions.md) - [Configure API Key Access Permissions for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-api-key-access-permissions.md) - [Configure Data Visibility Settings for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-data-visibility-settings.md) - [Configure Guardrail Access Permissions for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-guardrail-access-permissions.md) - [Configure Integration Access Permissions for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-integration-access-permissions.md) - [Configure Logs Access Permissions for Workspace](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-logs-access-permissions-in-workspace.md) - [Configure Model Access Permissioning for AI Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-model-access-permissioning-for-ai-integratinon.md) - [Configure Prompt Access Permissions for Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-prompt-access-permissions.md) - [Configure Provider Access Permissions](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-virtual-key-access-permissions.md) - [Configure Workspace Provisioning for Your AI Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configure-workspace-provisioning-for-your-ai-integrations.md) - [Configure Request Logging](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/configuring-request-logging.md): Control what data… - [Enforce Budget Limits and Rate Limits for Your API Keys](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-budget-and-rate-limit.md): Configure budget a… - [Enforce Budget Limits on Your AI Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-budget-limits-on-your-ai-provider.md) - [Enforcing Default Configs on API Keys](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-default-config.md): Learn how to attac… - [Enforcing Org Level Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-orgnization-level-guardrails.md) - [Enforce Rate Limits on Your AI Provider](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-rate-limits-on-your-ai-provider.md) - [Enforce Workspace Budget and Rate Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-workspace-budget-limts-and-rate-limits.md): Configure budget a… - [Enforcing Workspace Level Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforce-workspace-level-guardials.md) - [Enforcing Request Metadata](https://portkey-docs-chore-v2-10-0.mintlify.app/product/administration/enforcing-request-metadata.md) - [Agent Gateway](https://portkey-docs-chore-v2-10-0.mintlify.app/product/agent-gateway.md): Centralized authen… - [Advanced code snippets and examples](https://portkey-docs-chore-v2-10-0.mintlify.app/product/agent-gateway/advanced-code-snippets-and-examples.md): Advanced code snip… - [Quickstart](https://portkey-docs-chore-v2-10-0.mintlify.app/product/agent-gateway/quickstart.md): Get started with A… - [Agent Registry](https://portkey-docs-chore-v2-10-0.mintlify.app/product/agent-gateway/registry.md): Manage your agent… - [Agent Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/agent-gateway/servers.md): Host your agent se… - [AI Gateway](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway.md): The world's fastes… - [Automatic Retries](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/automatic-retries.md): Automatically retr… - [Unified Batch Inference](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/batches.md): Run large‑scale in… - [Cache (Simple & Semantic)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/cache-simple-and-semantic.md): Speed up requests… - [Canary Testing](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/canary-testing.md): You can use Portke… - [Chat Completions](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/chat-completions.md): Use OpenAI-compati… - [Circuit Breaker](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/circuit-breaker.md): Automatically stop… - [Conditional Routing](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/conditional-routing.md) - [Configs](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/configs.md): This feature is av… - [Custom hosts](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/custom-hosts.md): Route requests to… - [Fallbacks](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/fallbacks.md): Automatically swit… - [Files](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/files.md): Upload files to Po… - [Fine-tuning](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/fine-tuning.md): Run your fine-tuni… - [gRPC (Beta)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/grpc.md): Use gRPC as an alt… - [Load Balancing](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/load-balancing.md): Distribute traffic… - [Messages](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/messages-api.md): Use Anthropic's Me… - [Multimodal Capabilities](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities.md) - [Function Calling](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/function-calling.md): Portkey's AI Gatew… - [Image Generation](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/image-generation.md): Portkey's AI gatew… - [Speech-to-Text](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/speech-to-text.md): Use Portkey's AI g… - [Text-to-Speech](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/text-to-speech.md): Portkey's AI gatew… - [Thinking Mode](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/thinking-mode.md) - [Vision](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/multimodal-capabilities/vision.md): Portkey's AI gatew… - [Nitro Mode (Beta)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/nitro-mode.md): Forward the reques… - [Realtime API](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/realtime-api.md): Use OpenAI's Realt… - [Remote MCP](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/remote-mcp.md): Portkey's AI gatew… - [Request Timeouts](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/request-timeouts.md): Manage unpredictab… - [Open Responses](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/responses-api.md): Use the Responses… - [Strict OpenAI Compliance](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/strict-open-ai-compliance.md) - [Universal API](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/universal-api.md): One API for 200+ L… - [Virtual Keys](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/virtual-keys.md): Virtual Keys have… - [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role.md): How to create a ne… - [Budget Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/virtual-keys/budget-limits.md): Budget Limits lets… - [Rate Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/ai-gateway/virtual-keys/rate-limits.md): Set Rate Limts to… - [Coding Agents](https://portkey-docs-chore-v2-10-0.mintlify.app/product/coding-agent.md): The governance lay… - [Enterprise Offering](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering.md) - [Access Control Management](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/access-control-management.md): With customizable… - [Audit Logs](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/audit-logs.md): Track and monitor… - [Budget Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/budget-limits.md) - [Usage & Rate Limit Policies](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/budget-policies.md): Create fine-graine… - [Enterprise Components](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/components.md) - [KMS Integration](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/kms.md): Customers can brin… - [Logs Export](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/logs-export.md) - [Org Management](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management.md): A high-level intro… - [API Key Rotation](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/api-key-rotation.md): Periodically repla… - [API Keys (AuthN and AuthZ)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/api-keys-authn-and-authz.md): Discover how Admin… - [JWT Authentication](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/jwt.md): Configure JWT-base… - [Organizations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/organizations.md): Understand the rol… - [Azure Entra](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/scim/azure-ad.md): Setup Azure Entra… - [SCIM Group Management](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/scim/group-management.md): Map SCIM groups to… - [Okta](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/scim/okta.md): Set up Okta for SC… - [Overview](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/scim/scim.md): SCIM integration w… - [SSO](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/sso.md): SSO support for en… - [User Roles & Permissions](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/user-roles-and-permissions.md): Learn about Portke… - [Workspaces](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/org-management/workspaces.md): Explore Workspaces… - [Analytics Export](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/otel/analytics.md): Export Portkey ana… - [Complete Logs Export](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/otel/complete-logs.md): Export complete LL… - [OpenTelemetry(OTel) Export](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/otel/otel.md): Export Portkey dat… - [Secret References](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/secret-references.md): Reference secrets… - [Security @ Portkey](https://portkey-docs-chore-v2-10-0.mintlify.app/product/enterprise-offering/security-portkey.md): Portkey AI provide… - [Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails.md): Ship to production… - [Supported Endpoints & Capabilities](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/capabilities.md): Which endpoints, p… - [Creating Raw Guardrails (in JSON)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/creating-raw-guardrails-in-json.md): With the raw Guard… - [Guardrails for Embedding Requests](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/embedding-guardrails.md): Apply security and… - [Guardrails for Batches](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/guardrails-for-batches.md): Secure batch infer… - [List of Guardrail Checks](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/list-of-guardrail-checks.md) - [PII Redaction](https://portkey-docs-chore-v2-10-0.mintlify.app/product/guardrails/pii-redaction.md): Replace any sensit… - [MCP Gateway](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway.md): Centralized authen… - [Team Provisioning](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/access-control.md): Control which work… - [MCP Advanced Configuration](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/advanced-configuration.md): Control how the ga… - [Custom Auth](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/custom-auth.md): Configure custom a… - [Bring Your Own Auth](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/external-oauth.md): Use your own ident… - [Forwarding Headers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/forwarding-headers.md): Pass headers from… - [Identity Forwarding](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/identity-forwarding.md): Pass authenticated… - [JWT Validation](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/jwt.md): Validate JWTs from… - [OAuth](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/oauth.md): Portkey's built-in… - [OAuth Client Metadata](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authentication/oauth-client-metadata.md): Customize OAuth cl… - [Authorization](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/authorization.md): Control what users… - [Circuit Breakers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/circuit-breakers.md): Automatic failure… - [Add External MCP Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/external-mcp-servers.md): Connect third-part… - [Guardrails](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/guardrails.md): Apply policies to… - [Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/integrations.md): Connect MCP server… - [Add Internal MCP Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/internal-mcp-servers.md): Add your internal… - [MCP Registry](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/mcp-registry.md): Add, manage, and g… - [Observability](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/observability.md): Log, monitor, and… - [Quickstart](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/quickstart.md): Add DeepWiki to Po… - [Rate Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/rate-limits.md): Throttle requests… - [Tool Provisioning](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/tool-provisioning.md): Control which tool… - [Using MCP Servers](https://portkey-docs-chore-v2-10-0.mintlify.app/product/mcp-gateway/using-mcp-servers.md): Connect to MCP ser… - [Model Catalog](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog.md): A single pane to v… - [Budget Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/budget-limits.md) - [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/connect-bedrock-with-amazon-assumed-role.md): How to create an i… - [Adding Custom Models](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/custom-models.md): Learn how to add c… - [Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/integrations.md): Securely store and… - [Overriding Model Details](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/model-overrides.md): Learn how to set c… - [AI Model Provisioning](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/model-provisioning.md) - [Portkey Models](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/portkey-models.md): Open-source pricin… - [Adding Pricing Adjustments](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/pricing-adjustments.md): Learn how to apply… - [Rate Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/rate-limits.md) - [Workspace Provisioning](https://portkey-docs-chore-v2-10-0.mintlify.app/product/model-catalog/workspace-provisioning.md) - [Observability (OpenTelemetry)](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability.md): Gain real-time ins… - [Analytics](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/analytics.md) - [Auto-Instrumentation [BETA]](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/auto-instrumentation.md): Portkey's auto-ins… - [Budget Limits](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/budget-limits.md) - [Model Pricing and Cost Management](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/cost-management.md): Learn how Portkey… - [Feedback](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/feedback.md): Portkey's Feedback… - [Filters](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/filters.md) - [Logs](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/logs.md): The Logs section p… - [Logs Export](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/logs-export.md): Easily access your… - [Metadata](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/metadata.md): Add custom context… - [OpenTelemetry for LLM Observability](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/opentelemetry.md): Leverage OpenTelem… - [Supported OTel Libraries](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/opentelemetry/list-of-supported-otel-instrumenters.md): Portkey works with… - [Tracing](https://portkey-docs-chore-v2-10-0.mintlify.app/product/observability/traces.md): The **Tracing** ca… - [Open Source](https://portkey-docs-chore-v2-10-0.mintlify.app/product/open-source.md) - [Feature Comparison](https://portkey-docs-chore-v2-10-0.mintlify.app/product/product-feature-comparison.md): Comparing Portkey'… - [Prompt Engineering Studio](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio.md) - [Prompt API](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-api.md): Learn how to integ… - [Guides](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-guides.md): Learn how to get t… - [Integrations](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-integration.md) - [Prompt Library](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-library.md) - [Prompt Observability](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-observability.md) - [Prompt Partials](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-partial.md): With Prompt Partia… - [Prompt Playground](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-playground.md) - [Sharing Prompts and Partials](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-sharing.md): Share prompts and… - [Prompt Versioning & Labels](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/prompt-versioning.md) - [Tool Library](https://portkey-docs-chore-v2-10-0.mintlify.app/product/prompt-engineering-studio/tool-library.md) - [Model Pricing for Air-Gapped Deployments](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/airgapped/model-pricing.md): Configure model pr… - [Cache Behavior](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/cache-behavior.md): How the Gateway ca… - [FIPS-Compliant Images](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/fips-compliant-images.md): FIPS 140-3 complia… - [Enterprise Architecture](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/architecture.md): Comprehensive guid… - [ECS](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/aws/ecs.md): This enterprise-fo… - [EKS](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/aws/eks.md): This enterprise-fo… - [AWS Marketplace](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/aws/marketplace.md): This enterprise-fo… - [ACA](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/azure/aca.md): This enterprise-fo… - [AKS](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/azure/aks.md): This enterprise-fo… - [GCP](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/hybrid-deployments/gcp.md): This enterprise-fo… - [Prometheus Metrics](https://portkey-docs-chore-v2-10-0.mintlify.app/self-hosting/prometheus-metrics.md): Comprehensive moni… - [Common Errors & Resolutions](https://portkey-docs-chore-v2-10-0.mintlify.app/support/common-errors-and-resolutions.md): Since Portkey func… - [Contact Us](https://portkey-docs-chore-v2-10-0.mintlify.app/support/contact-us.md) - [Developer Forum](https://portkey-docs-chore-v2-10-0.mintlify.app/support/developer-forum.md): Are you navigating… - [December '23 Migration](https://portkey-docs-chore-v2-10-0.mintlify.app/support/portkeys-december-migration.md) - [Upgrade to Model Catalog](https://portkey-docs-chore-v2-10-0.mintlify.app/support/upgrade-to-model-catalog.md): Learn how to upgra… ## OpenAPI Specs - [openapi](https://raw.githubusercontent.com/Portkey-AI/openapi/refs/heads/master/openapi.yaml) - [portkey-models](https://portkey-docs-chore-v2-10-0.mintlify.app/openapi/portkey-models.json)