Skip to main content
Question

Incorrect/Irrelevant referencing sources listed on IFS.ai Co-Pilot responses(?)

  • November 28, 2025
  • 4 replies
  • 63 views

desilvasachitha
Hero (Partner)
Forum|alt.badge.img+6

Hello Folks,

I am using IFS cloud 25R1(Application service update - 25.1.1 and Framework service update 25.1.4) and am testing the copilot functionality. 

However, i ran in to an issue during my testing. When copilot provides a response to some of my prompts/queries I've noticed that it is referencing to unrelated/irrelevant documents that are in our data lake which has no data on original question being asked. i.e. these documents have no content whatsoever that could support the co-pilot’s answer. 

Please check the following scenario. 

Step 1 - I entered a prompt in the Co-Pilot to check the actual purpose of having a ‘Maintenance Team’ defined within the system. It did come up with plausible answer which i though was obtained from IFS documentation. There were 2 reference points listed alongside the response. 
 


Step 2 - I checked the listed ‘References’ out of curiosity and both of them referred to uploaded ‘Machine Specifications’ sitting in our data lake. 

Upon clicking the reference links it took me to the respective ‘document revision’ which was a chiller specification and doesn’t hold any information on ‘Maintenance Teams’ let alone the purpose of having them in an organization. 
 


Step 3 - Just to be sure i did some content search using “ctrl + f” on some key words and found nothing that relates to ‘Maintenance Teams’. 

**Note that i checked both of the documents and results are the same - no inclusion of any content of teams. 
 


 


Step 4 - I did come research on the IFS documentation and found evidence that Copilot may have actually pulled the content from Documentation as i found word to word matches. 
 


I am confident that Co-pilot fetched the answers from the cloud documentation but am baffled as to why co-pilot listed these irrelevant referencing sources(since it is confusing and misleading)?

Has anyone else come across this scenario? Could this be a defect or random erratic behavior of Co-Pilot?

Thanks! 

4 replies

Kristina Johansson
Do Gooder (Employee)
Forum|alt.badge.img+4

Hi ​@desilvasachitha 

we have not seen this issue before, and the team would be keen to get more info to investigate it. I will reach out to you.

Best regards,

Kristina, product manager for IFS.ai Copilot 


desilvasachitha
Hero (Partner)
Forum|alt.badge.img+6
  • Author
  • Hero (Partner)
  • November 29, 2025

Hey ​@Kristina Johansson ,
Thanks very much for the quick turnaround!  I am more than happy to provide you more information on this and even am willing to jump in to a call for a screen sharing session if that’s easier.

please let me know how you’d like to tackle this.

Cheers!
Sachitha D


Mathias Dahl
Superhero (Employee)
Forum|alt.badge.img+32
  • Superhero (Employee)
  • December 1, 2025

Hi ​@desilvasachitha 

If you can recreate this problem, I encourage you to open the Dev Tools in Chrome (or Edge), and check the Network / Response tab. In there, you can see what data points the search hits refers to and it will show us more details of problem, giving us more clues.

Here is an example on how it can look:

Please, if you can recreate this, open Dev Tools as per above, then send the question/prompt from Copilot. If there's no sensitive content, can you then please share a screenshot, or copy the JSON text and paste it here?

Thanks!
 


desilvasachitha
Hero (Partner)
Forum|alt.badge.img+6
  • Author
  • Hero (Partner)
  • December 1, 2025

Answer 1of 3

Hello @Mathias Dahl,

Thanks for the response.

Please note that now I have some new observations on the same issue that kind of explain why this issue takes place. It almost seems like this incorrect referencing happens when a user queries for a question on a completely new IFS page for the very first time. However, from the second time when users ask the same question on the same page, Co-pilot fetches the correct references.

Please see the attached MS word document for detailed test steps as I couldn’t post the steps here as we have a character limit of 3000. 
 

On one hand I am glad that this issue doesn’t persist when the users ask the same question on the same page for the second time and onwards. However, it is still baffling why co-pilot fetches these incorrect references which are confusing to the users.

While this is not a major gap I am curious to know if this a defect or an erratic behavior that will go away on its own more, we use the co-pilot?  

Thanks!
Sachitha D