Skip to content

Rate limit

Jump to bottom
Tolga Kayhan edited this page May 11, 2023 · 1 revision

You can apply any rate-limiting library using HttpClientFactory. I suggest using Polly. I have shared some samples and documentation that you can follow.

https://learn.microsoft.com/en-us/dotnet/architecture/microservices/implement-resilient-applications/use-httpclientfactory-to-implement-resilient-http-requests https://learn.microsoft.com/en-us/aspnet/core/fundamentals/http-requests?view=aspnetcore-7.0#consumption-patterns

ServiceCollection.AddOpenAIService()
    .AddPolicyHandler(GetRetryPolicy())
    .AddPolicyHandler(GetCircuitBreakerPolicy());
serviceCollection.AddOpenAIService().AddTransientHttpErrorPolicy(policyBuilder =>
    policyBuilder.WaitAndRetryAsync(
        3, retryNumber => TimeSpan.FromMilliseconds(600)));

Clone this wiki locally