Skip to content

Commit

Permalink
Update index.md
Browse files Browse the repository at this point in the history
  • Loading branch information
DaichiHaraguchi authored Oct 2, 2024
1 parent c798f4d commit 07c558c
Showing 1 changed file with 0 additions and 8 deletions.
8 changes: 0 additions & 8 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,15 +13,7 @@ Daichi Haraguchi<sup>1</sup>, Naoto Inoue<sup>1</sup>, Wataru Shimoda<sup>1</sup
### Abstruct
Recent advancements in foundation models show promising capability in graphic design generation. Several studies have started employing Large Multimodal Models (LMMs) to evaluate graphic designs, assuming that LMMs can properly assess their quality, but it is unclear if the evaluation is reliable. One way to evaluate the quality of graphic design is to assess whether the design adheres to fundamental graphic design principles, which are the designer's common practice. In this paper, we compare the behavior of GPT-based evaluation and heuristic evaluation based on design principles using human annotations collected from 60 subjects. Our experiments reveal that, while GPTs cannot distinguish small details, they have a reasonably good correlation with human annotation and exhibit a similar tendency to heuristic metrics based on design principles, suggesting that they are indeed capable of assessing the quality of graphic design.

<!--
### Results
<img src = "https://github.com/CyberAgentAILab/Graphic-design-evaluation-in-GPT/blob/main/images/res.png" title = "res">
### Results with different diversity
<img src = "https://github.com/CyberAgentAILab/Graphic-design-evaluation-in-GPT/blob/main/images/plot.png" title = "cmp">
### Citation
-->
```bibtex
@misc{
coming soon
Expand Down

0 comments on commit 07c558c

Please sign in to comment.