Share via

API usage user-level

Thummuri, Sahithi 0 Reputation points
2025-03-13T18:00:34.21+00:00

I have a resource in Azure AI Studio with LLMs deployed. I'm able to see overall usage through monitoring and insights but I want to have user-level data , how much each user is using. Any suggestions on how I can achieve this?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,826 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. hossein jalilian 10,340 Reputation points
    2025-03-13T20:20:59.37+00:00

    Thanks for posting your question in the Microsoft Q&A forum.

    To achieve user-level data for API usage in Azure OpenAI Service, you have a few options:

    • Implement custom telemetry in your application code to log user-specific API calls, use Application Insights to collect and analyze this data, allowing you to track usage per user
    • Configure Azure Monitor to collect detailed logs of API requests, use Log Analytics to query and analyze these logs, filtering by user identifiers
    • If you're using Azure API Management as a gateway for your Azure OpenAI Service, you can set up user-specific tracking and quotas, this allows for more granular control and monitoring of API usage per user, though it may incur additional costs
    • Implement a logging solution in your application that captures user identifiers along with API calls, store this data in a database or log analytics workspace for later analysis

    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.