We are happy to release MMBench-GUI, a hierarchical, multi-platform benchmark framework and toolbox, to evaluate GUI agents. MMBench-GUI is comprising four evaluation levels: GUI Content Understanding ...

Introduction Application of artificial intelligence (AI) tools in the healthcare setting gains importance especially in the domain of disease diagnosis. Numerous studies have tried to explore AI in ...

Abstract: The graphical user interfaces (GUIs) for operating heavy machinery, such as cranes, vary significantly even for the same type of machines depending on machine manufacturers or third-party ...

Abstract: Graphical user interfaces (GUIs) are important software engineering artifacts that commonly connect end users with software apps to fulfill requirements. While previous work extracts ...