ISTQB Certified Tester AI Testing Exam Practice Test

Answer: C
Explanation:AI-based systems can sometimes behave like black boxes, where the internal decision-makingprocess is unclear. Transparency refers to the ability to inspect and understand the training data,algorithms, and decision-making process of the AI system.Why is Option C Correct?Transparency ensures that testers and stakeholders can review how an AI system was trained.Access to training data is a key factor in transparency because it allows testers to analyze biases,completeness, and representativeness of the dataset.Transparency is an essential characteristic of explainable AI (XAI).Having access to training data means that testers can investigate how data influences AI behavior.Regulatory and ethical AI guidelines emphasize transparency.Many AI ethics frameworks, such as GDPR and Trustworthy AI guidelines, recommend transparencyto ensure fair and explainable AI decision-making.Why Other Options are Incorrect?(A) Autonomy â ŒAutonomy refers to an AI systems ability to make decisions independently without humanintervention. However, having access to training data does not relate to autonomy, which is moreabout self-learning and decision-making without human control.(B) Explorability â ŒExplorability refers to the ability to test AI systems interactively to understand their behavior, but itdoes not directly relate to accessing training data.(D) Accessibility â ŒAccessibility refers to the ease with which people can use the system, not the ability to inspect thetraining data.Reference from ISTQB Certified Tester AI Testing Study GuideTransparency is the ease with which the training data and algorithm used to generate a model can be understood."Transparency: This is considered to be the ease with which the algorithm and training data used to generate the model can be determined."Thus, option C is the correct answer, as transparency involves access to training data, allowing testers to understand AI decision-making processes. 

Answer: A
Explanation:Metamorphic Testing (MT) is a testing technique that verifies AI-based systems by generating followuptest cases based on existing test cases. These follow-up test cases adhere to a MetamorphicRelation (MR), ensuring that if the system is functioning correctly, changes in input should result inpredictable changes in output.Why Option A is Correct?Metamorphic testing works by transforming source test cases into follow-up test casesHere, the source test case involves testing the medium-speed vehicles travel time.The follow-up test cases are derived by extrapolating travel times for fast and slow vehicles usingpredictable relationships based on speed differences.MR states that modifying input should result in a predictable change in outputSince the speed of the vehicle is a known factor, it is possible to predict the new arrival times andverify whether they follow expected trends.This is a direct application of metamorphic testing principlesIn route optimization systems, metamorphic testing often applies transformations to speed, distance,or conditions to verify expected outcomes.Why Other Options are Incorrect?(B) Decomposing each route into traffic density and vehicle power â ŒWhile useful for statistical analysis, this approach does not generate follow-up test cases based on adefined metamorphic relation (MR).(C) Selecting dissimilar routes and transforming them into a fast or slow route â ŒThis does not follow metamorphic testing principles, which require predictable transformations.(D) Running fast vehicles on long routes and slow vehicles on short routes â ŒThis method does not maintain a controlled MR and introduces too many uncontrolled variables.Reference from ISTQB Certified Tester AI Testing Study GuideMetamorphic testing generates follow-up test cases based on a source test case."MT is a technique aimed at generating test cases which are based on a source test case that haspassed. One or more follow-up test cases are generated by changing (metamorphizing) the sourcetest case based on a metamorphic relation (MR)."MT has been used for testing route optimization AI systems."In the area of AI, MT has been used for testing image recognition, search engines, routeoptimization and voice recognition, among others."Thus, option A is the correct answer, as it aligns with the principles of metamorphic testing bymodifying input speeds and verifying expected results. 

Answer: A
Explanation:When testing an AI-based chat assistant for e-commerce customers, the lack of sufficientspecifications makes it difficult to use structured test techniques. The ISTQB CT-AI Syllabusrecommends exploratory testing in such cases:Why Exploratory Testing?Exploratory testing is useful when specifications are incomplete or unclear.AI-based systems, particularly those using natural language processing (NLP), may not behavedeterministically, making scripted test cases ineffective.The tester interacts dynamically with the system, identifying unexpected behaviors not documentedin the specification .Analysis of Answer Choices:A (Exploratory testing) → Correct, as it is the best approach when specifications are incomplete.B (Static analysis) → Incorrect, as static analysis checks code without execution, which is not helpfulfor AI chatbots.C (Equivalence partitioning) → Incorrect, as this technique requires well-defined inputs and outputs,which are missing due to insufficient specifications.D (State transition testing) → Incorrect, as state-based testing requires knowledge of valid and invalidtransitions, which is difficult with a chatbot lacking a clear specification .Thus, Option A is the correct answer, as exploratory testing is the best approach when dealing withinsufficient specifications in AI-based systems.Certified Tester AI Testing Study Guide Reference: ISTQB CT-AI Syllabus v1.0, Section 7.7 (Selecting a Test Approach for an ML System)ISTQB CT-AI Syllabus v1.0, Section 9.6 (Experience-Based Testing of AI-Based Systems)

Answer: B
Explanation:A deep neural network (DNN) is a type of artificial neural network that consists of multiple layersbetween the input and output layers. The ISTQB Certified Tester AI Testing (CT-AI) Syllabus outlinesthe following characteristics of a DNN:Structure of a Deep Neural Network:A DNN comprises at least three types of layers:Input layer: Receives the input data.Hidden layers: Perform complex feature extraction and transformations.Output layer: Produces the final prediction or classification .Analysis of Answer Choices:A (Only input and output layers) → Incorrect, as a DNN must have at least one hidden layer.B (At least one internal hidden layer) → Correct, as a neural network must have hidden layers to beconsidered deep.C (Minimum of five layers required) → Incorrect, as there is no strict definition that requires at leastfive layers.D (Output layer is not connected to other layers) → Incorrect, as the output layer must be connectedto the hidden layers .Thus, Option B is the correct answer, as a deep neural network must have at least one hidden layer.Certified Tester AI Testing Study Guide Reference:ISTQB CT-AI Syllabus v1.0, Section 6.1 (Neural Networks and Deep Neural Networks)ISTQB CT-AI Syllabus v1.0, Section 6.2 (Structure of Deep Neural Networks) .

Answer: C
Explanation:When verifying autonomous AI-based systems, a critical aspect is ensuring that they maintain anappropriate level of autonomy while only requesting human intervention when necessary. If an AIsystem unnecessarily asks for human input, it defeats the purpose of autonomy and can:Slow down operations.Reduce trust in the system.Indicate improper confidence thresholds in decision-making.This is particularly crucial in autonomous vehicles, AI-driven financial trading, and robotic processautomation, where excessive human intervention would hinder performance.Why are the other options incorrect?A . Test cases to verify that the system automatically confirms the correct classification of trainingdata → This is relevant for verifying training consistency but not for autonomy validation.B . Test cases to detect the system appropriately automating its data input → While relevant, dataautomation does not directly address the verification of autonomy.D . Test cases to verify that the system automatically suppresses invalid output data → This focuseson output filtering rather than decision-making autonomy.Thus, the most critical test case for verifying autonomous AI-based systems is ensuring that it doesnot unnecessarily request human intervention.Reference from ISTQB Certified Tester AI Testing Study Guide:Section: Section 8.2 - Testing Autonomous AI-Based Systems states that it is crucial to test whether the systemrequests human intervention only when necessary and does not disrupt autonomy .