AI in SAP – what are the possibilities when it comes to testing?

Large Language Models (LLMs) and other modern AI tools are undeniably here to stay. And while they offer endless business possibilities, at Int4 we’re mostly interested in understanding how global enterprises could use them to streamline their SAP Testing. And this future looks quite promising.

When it comes to AI – we have to be a forward-thinking company. And that’s why you’re about to read about my personal outlook on the future of AI in SAP Testing. 

The future is agentic

The well known Large Language Models can be equipped with different tools. For example – as you probably know, ChatGPT can browse the Internet to find specific sources of information, relevant to the query.

When it comes to testing SAP, at Int4 we’re working on equipping a LLM of your choice with two basic tools:

• The ability to browse your SAP Test Cases
• The ability to browse the master data and configuration of your systems.

So instead of browsing through the internet, it could browse through your data and perform a bunch of different testing steps – solving complex, multi-step testing problems without user’s further involvement – which is called “agentic testing”. 

A simple example

Let’s say that a user is looking for test cases that contain material “XYZ”. After one single prompt, the chat could on its own:

1. Call the Material Index to find internal ID
2. Call the Test Case Index to fetch relevant test cases
3. Package them into an easy-to-scan table
4. Respond to the user

And just like that, the user could complete the task, while AI has already stitched two different searches together, filtered the noise and delivered exactly what was needed.

The possibilities for businesses are MAJESTIC

The simple example that you just read about is just a tip of the iceberg for enterprises. Because if the AI agent can crawl both test-case data and master data, it suddenly understands what you test and what you test with. Which creates a whole range of possibilities.

What are the potential use-cases for AI in SAP Testing?

Besides finding relevant test cases, the AI agents could also run them with just one click of a button. And that is a very real use-case – since it’s already available for some of the Int4 Suite Customers:

After running the test case, the agent could summarize the results and let the user know if the test was successful – and if not, why it failed. All that in simple, easy to understand language.

But playing with existing data is just a part of the equation. What if in the future, AI Agents could modify your existing test cases for your new use-cases in seconds? Imagine a scenario where you want to test a connection with brand-new supplier. And the AI could on its own select your most relevant existing test cases, adjust them to the new supplier and test your connection. 

And going one step further – what if AI could generate test cases from scratch – just based on what you’re trying to test?

What if we put all of those together?

Those isolated test cases could of course be put together – to create an ultimate SAP Testing agent. Where based on the change specification, it could found and run relevant test cases and summarize the results. Or – maybe it could even do it based on 80 simultaneous changes to your system – while using both existing and brand new test cases for this purpose…

And then – it could autonomically repeat these steps every hour, to make sure that your system is absolutely spotless. As you can see, the possibilities are great and at Int4 we’re determined to make these dreams a reality.

The future is coming… But it’s not here yet.

While these possibilities are incredibly exciting, we also recognize that crafting this AI-driven testing experience still requires more research, experimentation and refinement. At Int4 we’re deeply committed to pushing this frontier forward, but there are still some industry-wide challenges that we’re going to address on our way, including:

• LLM Limitations – as current models sometimes hallucinate, struggle with long reasoning chains and hit context-window ceilings
• Other technological limitations – since many popular solutions have hard time dealing with SAP-sized data volumes
• Data safety concerns – because enterprises worry about sensitive business data leaking into public clouds or being overwritten by an “overly-helpful” agent
• Data quality issues – as messy and undocumented data is a kryptonite even for the best AI agents.

These are not exactly roadblocks – but important milestones on the innovation journey. And I’m proud to say that we’ve made great progress in terms of reaching them:

The 3.11 release of Int4 Suite already comes with a plethora of AI features. And while this gem still might need some minor polishes – we’re already  driving real business results with the use of these capabilities – and we’re eager the drive the best possible experience.

What should businesses do to start getting ready?

So while we’re struggling with working through the limitations listed above – organizations need to start preparing for this agentic future. 

First of all, while keeping your master data clean, well-structured and well-indexed may seem like an obvious tip, that is still an important pain-point for many enterprises. And fixing this issue is non-negotiable if you want to take advantage of these possibilities.

Organizations should enable their employees to start using AI in different scenarios to build their skills and habits. And one of the things that is essential in that process is creating a safe AI environment, in which employees will be able to experiment without any GDPR or data-safety concerns. Many of the most innovative companies have already deployed their private LLMs in order to mitigate that risk.

SEE MORE: How SAP Customers Should Start Using AI?

Because if you are thinking about that future – you have to do the groundwork today. And when the agentic SAP testing finally arrives at full speed, your organisation will be standing on the platform, with its ticket in hand and ready to board.

Contact us!

Int4 is always looking for innovative companies that want to use best-in-class technology for their SAP Testing. If you want to learn more about the current, real possibilities of using AI for the purpose of testing your SAP Integration – make sure to schedule a demo call, to discuss what’s possible: