Declarative Agent got "Sorry, I can't chat about this. To Save the chat and start a fresh one, select New chat." even though the API call was successfully

[frankchen76]

Describe the bug
I used MS Teams Toolkits to create a project and call a REST API to get a ticket list. After I provisioning to the Copilot tenant, I got the "Sorry, I can't chat about this. To Save the chat and start a fresh one, select New chat." even though the API call was successfully via "Show Plugin developer info". can you share how we can troubleshooting the issue?

To Reproduce
Steps to reproduce the behavior:

1. Used MS Teams toolkit to start a Declarative Agent project
2. Added an API plugins by pointing to an API document
3. Went to MS Teams toolkit extension to provisioning the agent to Copilot tenant.
4. Executed prompt to trigger the API call.

Expected behavior
Once the API is called successfully, the result should be displayed correctly.

Screenshots
the error message:

the developer info showed API was called successfully

VS Code Extension Information (please complete the following information):

• OS: Windows 11
• Version: 5.10.0

[anchenyi]

hi @frankchen76 , thanks for reporting this. Could you share your .zip app package for further investigation?

[frankchen76]

Hi @anchenyi, sorry to get back late. there was power and internet outage happened in Seattle area due to a storm recently. I attached the package. the declarative agent is very simple and called a REST API to get tickets' info. The API is an Azure Function (I tried REST API and got the same result) and just return the below JSON contents （see below code, marked tenant-name and ngrok name）. It was fine if I just returned the first 3 items. If I tried to include the 4th item, I got the above error message. I found out that sometime the specific returned title or description can also cause this issue. The API included a POST method which allowed users to create a ticket. After users submitted a ticket, the retrieving process will get above error message. I know Copilot implemented Responsible AI(RAI), but it doesn't make sense to block those contents which didn't include any harmful information. Can you share any information how to debug and what the cause could be? Thanks

[
    {
        "id": "d4ff8a59-6e1d-4ba0-b4aa-a5d40a2e225d",
        "title": "Campus network failure",
        "description": "Review campus network situation and develop a plan",
        "priority": "Low",
        "assignee": "CoreyG@[tenant-name].OnMicrosoft.com",
        "creator": "frank@[tenant-name].OnMicrosoft.com",
        "creationDate": "2024-11-01T00:00:00Z",
        "status": "Open",
        "url": "https://test.ngrok.io/api/me/tickets/d4ff8a59-6e1d-4ba0-b4aa-a5d40a2e225d"
    },
    {
        "id": "ff52a41a-490c-4a87-841c-f20512236be0",
        "title": "Supply chain automation failure",
        "description": " Implement a centralized system to manage product design, track product costing, and define graphic BOM & routes. This will streamline the product lifecycle management and ensure compliance with company policies",
        "priority": "Normal",
        "assignee": "KaiC@[tenant-name].OnMicrosoft.com",
        "creator": "frank@[tenant-name].OnMicrosoft.com",
        "creationDate": "2024-11-02T00:00:00Z",
        "status": "Open",
        "url": "https://test.ngrok.io/api/me/tickets/ff52a41a-490c-4a87-841c-f20512236be0"
    },
    {
        "id": "fb0e25a8-2fe7-4a2b-8406-fa5f474d2f67",
        "title": "Purchase product flow failure",
        "description": "Implement a automation to manage product purchase and track product costing. This will streamline the product purchase process and ensure compliance with company policies",
        "priority": "Critical",
        "assignee": "KaiC@[tenant-name].OnMicrosoft.com",
        "creator": "frank@[tenant-name].OnMicrosoft.com",
        "creationDate": "2024-11-07T00:00:00Z",
        "status": "Open",
        "url": "https://test.ngrok.io/api/me/tickets/fb0e25a8-2fe7-4a2b-8406-fa5f474d2f67"
    },
    {
        "id": "876e4a09-b285-4d1d-9372-2a8c1f2ad424",
        "title": "Creating a Jira connector",
        "description": "Need help with creating a Jira connector on server xyz. I cannot find information from knowledge base",
        "priority": "Low",
        "assignee": "SoniaR@[tenant-name].OnMicrosoft.com",
        "creator": "frank@[tenant-name].OnMicrosoft.com",
        "creationDate": "2024-11-18T00:13:41.477Z",
        "status": "Open",
        "url": "https://test.ngrok.io/api/me/tickets/876e4a09-b285-4d1d-9372-2a8c1f2ad424"
    }
]

appPackage.local.zip

[anchenyi]

Hi @frankchen76, it’s okay to return more than 3 items in the plugin API. Based on the description, it seems more likely that the issue is due to the content itself, which might violate some policies. @MuyangAmigo could you help let the platform team check this issue first?

[frankchen76]

@anchenyi, thanks for your note. I felt about the same way. But when I reviewed those contents "title": "Creating a Jira connector","description": "Need help with creating a Jira connector on server xyz. I cannot find information from knowledge base", it seems there is no harmful language there. Are there any documents mentioned those policies? If we have such content returned from API, what would be the guidance to make sure it meets the Copilot's "Policies"? I am a MSFT, feel free to ping me via alias tachen from MS Teams if you need more information. Thanks

[MuyangAmigo]

Hey @frankchen76 I will reach in Teams.