At System Verification, we recognize the rapid advancements in artificial intelligence and the growing need for strong testing practices. To stay ahead, we’ve made AI and machine learning key priorities in our 2024-2025 competence development strategy. One major initiative has been the ISTQB AI Tester certification, which equips our consultants with the skills to handle AI-driven systems.
Why AI Testing Matters
As AI systems become more common in daily operations, it’s crucial to understand both how to test AI and how AI can support testing. This certification helps bridge that gap, offering insights into risks, biases, and the evolving role of quality assurance in AI development.
Jonas Elmer from our Malmö office highlighted the importance of this knowledge:
"Everyone talks about AI nowadays, and we use AI tools in our daily work. This course makes us more comfortable navigating that environment. We can also help our customers set up the structure for AI-related processes."
The Learning Experience
Around 50 people at System Verification applied for the Udemy-accredited ISTQB AI Testing course, held by Dr. Stuart Reid. It began with a kickoff meeting in September, followed by six weekly sessions. These sessions combined the digital e-learning course with expert discussions, video lectures, and interactive meetings where participants could engage with System Verification’s in-house AI specialists. An internal Viva Engage channel encouraged continuous knowledge sharing. Since the course was an e-learning course, it was important for us to complement it with the previously mentioned offline support and collaboration sessions to maximize the education and provide the participants with the best possible prerequisites.
Pär Tojkander from Stockholm shared his experience:
"I wanted to take the course and certification to better understand AI and the testing challenges within that area. The training was well-made, interesting, and challenging. I only had basic knowledge about AI before taking the course, so there was a lot to learn! One key takeaway was that AI-based systems are not ‘magical’; they follow the same principles as any other software system in terms of design, development, testing, and maintenance."
The exam itself was both rigorous and demanding, requiring not just memorization but a deep understanding of AI testing principles. Ammar Harrat from our Bonn office shared his key strategies for success:
"Understanding the syllabus and how the chapters connect is crucial rather than just memorizing content. When answering questions, carefully read all options—some may seem similar, but only one is the best. Also, make sure your laptop and camera work properly before the exam to avoid technical issues. It can also help to create a folder for downloading and uploading the answer sheet to reduce last-minute stress."
Nataliia Salamatina from Frankfurt reflected on how studying for the certification expanded her knowledge:
"Studying for the ISTQB AI certification deepened my understanding of how AI models are trained. More importantly, it provided me with practical tools, such as the ROC curve, that can be applied beyond AI classification models to evaluate the quality of predictions in various areas of life."
Applying AI Testing Knowledge in Real Projects
The newly acquired knowledge doesn’t just benefit our consultants; it also enhances the value we provide to our clients. AI systems require rigorous testing to mitigate risks such as bias, unintended consequences, and performance inconsistencies.
Simon Graf from Hamburg shared how the course improved his ability to assess AI risks:
"The ISTQB AI course gave me the vocabulary to point out the risks of LLMs and how to mitigate them. I now have a much better understanding of the testing requirements depending on the role an AI system plays in a project."
Similarly, Mak Glavočević from Sarajevo emphasized the need for AI awareness:
"We are increasingly surrounded by AI-driven tools, which makes additional awareness and caution essential. Thanks to the ISTQB AI certification, I can now better identify potential issues and address them before they escalate."
Dalila Terzić from our Sarajevo office highlighted the professional benefits of earning the certification:
"I’m happy to have completed the ISTQB AI Testing course, especially since AI testing is becoming such a crucial area in the tech industry. This has deepened my expertise in AI testing and provided a solid foundation in understanding AI testing principles and methodologies. It has also helped me see how AI can support software testing and the key role that testers play in improving the quality of machine learning models."
The Bigger Picture: A Strategic Commitment to AI Testing
Our efforts in AI competence development go beyond individual certifications—they are part of a larger strategy. As Jonas Gyllenspetz, CGO at System Verification, explained:
"By learning about new and emerging technologies such as AI and machine learning and adapting to new ways of working, we are not only enhancing our own capabilities but also helping our customers improve their digital solutions. Prioritizing performance in the software development life cycle (SDLC) allows us to support faster and higher-quality product delivery."
Ingvar Nordström, Chairman of the Swedish Software Testing Board (SSTB), also recognized System Verification’s unique approach:
"System Verification’s initiative is impressive—not only because so many employees are participating but also because they are taking ownership of their AI competence development on a global level. This shows a real commitment to staying ahead in the field of AI testing."
What’s Next?
With the first group successfully completing the ISTQB AI Testing certification, we look forward to expanding our AI initiatives. Our goal is to ensure that System Verification remains at the forefront of AI-driven quality assurance, providing our clients with the expertise needed to develop high-quality AI-based systems.
Stay tuned for more insights as we continue to explore AI in software testing!
