GUI Component Detection Using YOLO and Faster-RCNN
Yazarlar (1)
Dr. Öğr. Üyesi Senem TANBERK Huawei R&D İstanbul, Türkiye
| Bildiri Türü |
Tebliğ/Bildiri
|
Bildiri Dili | İngilizce |
| Bildiri Alt Türü | Tam Metin Olarak Yayınlanan Tebliğ (Uluslararası Kongre/Sempozyum) | ||
| Bildiri Niteliği | Alanında Hakemli Uluslararası Kongre/Sempozyum | ||
| Kongre Adı | 2023 14th International Conference on Electrical and Electronics Engineering (ELECO) | ||
| Kongre Tarihi | 30-11-2023 / 30-11-2023 | ||
| Basıldığı Ülke | Türkiye | Basıldığı Şehir | |
| Bildiri Linki | https://ieeexplore.ieee.org/abstract/document/10415929/ | ||
| UAK Araştırma Alanları |
Eğitim Bilimleri
|
||
| Özet |
| The graphical user interface (GUI) is crucial for communicating with software users. The detection of GUI elements holds significant importance for various software test automation tasks. In this study, two different object detection models such as YOLOv8 and Faster R-CNN are used to address challenging GUI component detection problems in mobile applications. Two different datasets were used. The first dataset is the RICO data, which consists of 5 classes. The second dataset consists of 600 mobile application screenshots collected from the open-source. This dataset consists of 7 classes and has been labeled and trained on Roboflow. In addition, an automation system was developed to test the object detection models for errors after the version change in the mobile application. With this test automation, the locations of the errors in the mobile application in real-world scenarios were determined and reported. In … |
| Anahtar Kelimeler |
