A while back, I wrote a blog post about the AI Builder Consumption report that gives insight into which user is consuming credits in which environment, and the hassle of finding out which user is consuming the credits (the blog can be found here). With this feature, you can monitor your AI Builder activity and see which AI prompts and models are using how many credits in a real-time overview for a specific environment.
It is good to know what is included within this overview, which allows you to monitor your AI Builder activity like prompts and models that are used in:
- Power Automate
- Power Apps
- Copilot Studio
Where to find the Monitor activity?
In order to access the Monitor activity, please follow the next steps:
- Open the make.powerapps.com
- Navigate to Environments
- Select AI Hub from the left menu
- Choose Monitor activity
When the report is launched, at the top you can filter your data set based on Days, Only Models or Only prompts. It also allows you to download the data set to .csv if you wish
Microsoft has shared the following documentation when it comes to the columns (full Microsoft documentation can be found here).
| Column heading | Description |
|---|---|
| Processed time | The time when processing occurs. |
| Tool name | The AI model or prompt name. |
| Input | The text input of the AI model predict action for text processing models, or the value Image or Document for other models and prompts. |
| Output | The GPT prompt output (model response) in the selected output format. |
| Used in | The consumption source of the AI model or prompt. It can be Power Automate, Power Apps, Copilot Studio, or Quick Test for saved but not consumed prompts. |
| Consumption | The numeric consumption value for the related AI model or prompt run. |
When checking the details of an AI prompt or model you can find more information about the event, for example the whole input/output or which model it used.
All these evens, that are being used in this monitor, are stored in the AI Event table in your Dataverse.
To conclude, I believe this is a very handy tool to have to monitor your AI Builder activity. Where the AI Builder Consumption report has more focus on the overall tenant, the AI Builder Activity monitor does give more insights from an operational perspective for a certain environment.
