Alert button

Testing Framework for Black-box AI Models

Feb 11, 2021
Aniya Aggarwal, Samiulla Shaikh, Sandeep Hans, Swastik Haldar, Rema Ananthanarayanan, Diptikalyan Saha

Figure 1 for Testing Framework for Black-box AI Models
Figure 2 for Testing Framework for Black-box AI Models
Figure 3 for Testing Framework for Black-box AI Models

Share this with someone who'll enjoy it:

With widespread adoption of AI models for important decision making, ensuring reliability of such models remains an important challenge. In this paper, we present an end-to-end generic framework for testing AI Models which performs automated test generation for different modalities such as text, tabular, and time-series data and across various properties such as accuracy, fairness, and robustness. Our tool has been used for testing industrial AI models and was very effective to uncover issues present in those models. Demo video link: https://youtu.be/984UCU17YZI

* 4 pages Demonstrations track paper accepted at ICSE 2021  
View paper onarxiv icon

Share this with someone who'll enjoy it: