Skip to content

Commit

Permalink
initial commit
Browse files Browse the repository at this point in the history
  • Loading branch information
unknown committed Feb 1, 2024
0 parents commit eded6dc
Show file tree
Hide file tree
Showing 16 changed files with 3,286 additions and 0 deletions.
48 changes: 48 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
# Compiled Object files, Static and Dynamic libs (Shared Objects)
*.o
*.a
*.so

# Folders
_obj
_test

# Architecture specific extensions/prefixes
*.[568vq]
[568vq].out

*.cgo1.go
*.cgo2.c
_cgo_defun.c
_cgo_gotypes.go
_cgo_export.*

_testmain.go

*.exe
*.test
*.prof

# WebStorm
*.iml

# Directory-based project format:
.idea/
.idea/workspace.xml
**/.idea/workspace.xml

# mac hidden files
.DS_Store

##other
#node_modules/
#bower_components/
.tmp
#.sass-cache
#builds/**/images/*
#*.ogg
#*.mp3
#*.mp4
#*.png
#*.jpeg
*.psd
230 changes: 230 additions & 0 deletions index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,230 @@
<!DOCTYPE html>
<html>

<head>
<meta charset="utf-8">

<title>LimSim++: Closed-Loop Integration of Multimodal Large Language Models in Autonomous Driving</title>
<!-- <link rel="icon" type="image/x-icon" href="static/images/favicon.ico"> -->
<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro" rel="stylesheet">

<link rel="stylesheet" href="static/css/bulma.min.css">
<link rel="stylesheet" href="static/css/bulma-carousel.min.css">
<link rel="stylesheet" href="static/css/bulma-slider.min.css">
<link rel="stylesheet" href="static/css/fontawesome.all.min.css">
<link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css">
<link rel="stylesheet" href="static/css/index.css">
<link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/[email protected]/dist/css/bootstrap.min.css">

<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script>
<script src="https://documentcloud.adobe.com/view-sdk/main.js"></script>
<!-- <script defer src="static/js/fontawesome.all.min.js"></script> -->
<script src="static/js/bulma-carousel.min.js"></script>
<script src="static/js/bulma-slider.min.js"></script>
<script src="static/js/index.js"></script>
<script src="https://kit.fontawesome.com/dcd6d05807.js" crossorigin="anonymous"></script>
<script src="https://cdn.jsdelivr.net/npm/[email protected]/dist/js/bootstrap.bundle.min.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/marked/9.1.0/marked.min.js"></script>
</head>

<body>

<section class="hero">
<div class="hero-body">
<div class="container is-max-desktop">
<div class="columns is-centered">
<div class="column has-text-centered">
<h1 class="title is-1 publication-title">LimSim++: Closed-Loop Integration of Multimodal Large Language Models in Autonomous Driving</h1>
<div class="is-size-5 publication-authors">
<!-- Paper authors -->
<span class="author-block">
<a href="https://wenlc.cn/" target="_blank">Licheng Wen</a><sup>1,<i
class="fa-solid fa-scale-balanced fa-xs"></i></sup>,
</span>
<span class="author-block">
<a href="https://scholar.google.com/citations?user=vIU6eHYAAAAJ" target="_blank">Daocheng
Fu</a><sup>1,<i class="fa-solid fa-scale-balanced fa-xs"></i></sup>,
</span>
<span class="author-block">
<a href="https://sankin97.github.io/" target="_blank">Xin Li</a><sup>1,2,<i
class="fa-solid fa-scale-balanced fa-xs"></i></sup>,
</span>
<span class="author-block">
<a href="https://scholar.google.com/citations?user=v9CvBeUAAAAJ" target="_blank">Xinyu
Cai</a><sup>1</sup>,
</span>
<span class="author-block">
<a href="https://scholar.google.com/citations?user=9h86v8kAAAAJ" target="_blank">Tao
Ma</a><sup>1,3</sup>,
</span>
<span class="author-block">
<a href="https://pinlong-cai.github.io/" target="_blank">Pinlong Cai</a><sup>1</sup>,
</span><br>
<span class="author-block">
<a href="mailto:[email protected]" target="_blank">Min Dou</a><sup>1</sup>,
</span>
<span class="author-block">
<a href="https://scholar.google.com/citations?user=K0PpvLkAAAAJ" target="_blank">Botian
Shi</a><sup>1,<i class="fa-regular fa-envelope fa-shake"></i></sup>,
</span>
<span>
<a href="https://faculty.ecnu.edu.cn/_s16/hl2/main.psp" target="_blank">
Liang He</a><sup>2</sup>,
</span>
<span>
<a href="https://scholar.google.com/citations?user=gFtI-8QAAAAJ" target="_blank">Yu Qiao</a><sup>1</sup>
</span>
</div>

<div class="is-size-5 publication-authors">
<span class="author-block"><sup>1</sup> Shanghai AI Laboratory, Shanghai, China<br><sup>2</sup> Department
of Computer Science, East
China Normal University<br><sup>3</sup> The Chinese University of Hong Kong
</span>
<span class="eql-cntrb">
<small>
<br><sup><i class="fa-solid fa-scale-balanced fa-sm"></i></sup> Equal Contribution
<br><sup><i class="fa-regular fa-envelope fa-shake"></i></sup> Corresponding author
</small>
</span>
</div>

<div class="column has-text-centered">
<div class="publication-links">

<!-- Github link -->
<span class="link-block">
<a href="https://github.com/PJLab-ADG/DiLu" target="_blank"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fab fa-github"></i>
</span>
<span>Code</span>
</a>
</span>

<!-- ArXiv abstract Link -->
<span class="link-block">
<a href="https://arxiv.org/abs/2309.16292" target="_blank"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
</span>
<span>arXiv</span>
</a>
</span>
</div>
</div>
</div>
</div>
</div>
</div>
</section>

<!-- Paper abstract -->
<section class="section hero is-light">
<div class="container is-max-desktop">
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Abstract</h2>
<div class="content has-text-justified">
<p>
<b>
This paper introduces LimSim++, an extended version of LimSim designed for the application of Multimodal Large Language Models ((M)LLMs) in autonomous driving. Acknowledging the limitations of existing simulation platforms, LimSim++ addresses the need for a long-term closed-loop infrastructure supporting continuous learning and improved generalization in autonomous driving. The platform offers extended-duration, multi-scenario simulations, providing crucial information for (M)LLM-driven vehicles. Users can engage in prompt engineering, model evaluation, and framework enhancement, making LimSim++ a versatile tool for research and practice. The contributions include the introduction of an open-source testing platform, a baseline MMLM-driven framework, and validation through quantitative experiments across diverse scenarios. LimSim++ serves as a crucial resource for advancing the integration of (M)LLMs in the development of trustworthy autonomous driving systems. The open-source resources are available at: [...].
</b>
</p>
</div>
</div>
</div>
</div>
</section>
<!-- End paper abstract -->


<section class="section" id="Paradigm">
<div class="container is-max-desktop">
<h2 class="title">Platform Composition</h2>
<div class="hero-body">
<center>
<img src="static/images/paradigm.png" width="80%">
</center>
<h2 class="subtitle has-text-justified" style="padding-top: 1rem;">
caption
</h2>
</div>
</div>
</section>

<!-- Videos should be placed here. -->

<section class="section" id="Framework">
<div class="container is-max-desktop">
<h2 class="title">Framework</h2>
<div class="hero-body">
<center>
<img src="static/images/framework.png" width="80%">
</center>
<h2 class="subtitle has-text-justified" style="padding-top: 1rem;" style="width: 80%;">
caption
</h2>
</div>
</div>
</section>

<!--BibTex citation -->
<section class="section" id="BibTeX">
<div class="container is-max-desktop content">
<h2 class="title">BibTeX</h2>
<div style="position: relative;">
<button id="copyButton" style="position: absolute; top: 0; right: 0;">Copy</button>
<pre><code id="bibtexCode">@misc{wen2023dilu,
title={DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models},
author={Licheng Wen and Daocheng Fu and Xin Li and Xinyu Cai and Tao Ma and Pinlong Cai and Min Dou and Botian Shi and Liang He and Yu Qiao},
year={2023},
eprint={2309.16292},
archivePrefix={arXiv},
primaryClass={cs.RO}
}

@misc{fu2023drive,
title={Drive Like a Human: Rethinking Autonomous Driving with Large Language Models},
author={Daocheng Fu and Xin Li and Licheng Wen and Min Dou and Pinlong Cai and Botian Shi and Yu Qiao},
year={2023},
eprint={2307.07162},
archivePrefix={arXiv},
primaryClass={cs.RO}
}
</code></pre>
</div>
</div>
</section>
<!--End BibTex citation -->


<footer class="footer">
<div class="container">
<div class="columns is-centered">
<div class="column is-8">
<div class="content">

<p style="text-align: center;"><i class="fa-solid fa-heart fa-beat-fade" style="color: #ff8787;"></i>
This page was built using the <a href="https://github.com/eliahuhorwitz/Academic-project-page-template"
target="_blank">Academic Project Page Template</a> <i class="fa-solid fa-heart fa-beat-fade"
style="color: #ff8787;"></i>
</p>

</div>
</div>
</div>
</div>
</footer>

<!-- Statcounter tracking code -->

<!-- You can add a tracker to track page visits by creating an account at statcounter.com -->

<!-- End of Statcounter Code -->

</body>

</html>
3 changes: 3 additions & 0 deletions readme.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# LimSim++

Codes are coming soon...
1 change: 1 addition & 0 deletions static/css/bulma-carousel.min.css

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit eded6dc

Please sign in to comment.