diff --git a/docs/_config.yaml b/docs/_config.yaml deleted file mode 100644 index a91d439..0000000 --- a/docs/_config.yaml +++ /dev/null @@ -1,8 +0,0 @@ -title: Can GPTs Evaluate Graphic Design Based on Design Principles? -description: -show_downloads: true -github: - pub_url: - paper_url: - code_url: -theme: jekyll-theme-cayman diff --git a/docs/_layouts/default.html b/docs/_layouts/default.html deleted file mode 100644 index a223740..0000000 --- a/docs/_layouts/default.html +++ /dev/null @@ -1,45 +0,0 @@ - - - - - - - {% seo %} - - - - - - - {% include head-custom.html %} - - - - Skip to the content. - - - -
- {{ content }} - - -
- - - \ No newline at end of file diff --git a/docs/images/plot.png b/docs/images/plot.png deleted file mode 100644 index 260e5da..0000000 Binary files a/docs/images/plot.png and /dev/null differ diff --git a/docs/images/res.jpg b/docs/images/res.jpg deleted file mode 100644 index 11125d0..0000000 Binary files a/docs/images/res.jpg and /dev/null differ diff --git a/docs/images/teaser.jpg b/docs/images/teaser.jpg deleted file mode 100644 index e93c944..0000000 Binary files a/docs/images/teaser.jpg and /dev/null differ diff --git a/docs/index.md b/docs/index.md deleted file mode 100644 index 7751625..0000000 --- a/docs/index.md +++ /dev/null @@ -1,21 +0,0 @@ ---- -layout: default ---- - -## Can GPTs Evaluate Graphic Design Based on Design Principles? - -![Concept](https://github.com/CyberAgentAILab/Graphic-design-evaluation-in-GPT/blob/main/docs/images/teaser.jpg) - - -Daichi Haraguchi1, Naoto Inoue1, Wataru Shimoda1, Hayato Mitani2, Seiichi Uchida2, Kota Yamaguchi1 -1CyberAgent.Inc, 2 Kyushu University - -### Abstruct -Recent advancements in foundation models show promising capability in graphic design generation. Several studies have started employing Large Multimodal Models (LMMs) to evaluate graphic designs, assuming that LMMs can properly assess their quality, but it is unclear if the evaluation is reliable. One way to evaluate the quality of graphic design is to assess whether the design adheres to fundamental graphic design principles, which are the designer's common practice. In this paper, we compare the behavior of GPT-based evaluation and heuristic evaluation based on design principles using human annotations collected from 60 subjects. Our experiments reveal that, while GPTs cannot distinguish small details, they have a reasonably good correlation with human annotation and exhibit a similar tendency to heuristic metrics based on design principles, suggesting that they are indeed capable of assessing the quality of graphic design. - -### Citation -```bibtex -@misc{ -coming soon -} -```