Skip to content

Commit

Permalink
update and improve the proposal
Browse files Browse the repository at this point in the history
Signed-off-by: boX <[email protected]>
  • Loading branch information
safe-b committed Sep 11, 2024
1 parent 6b94c85 commit b59e3ab
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -92,9 +92,9 @@ The format of the issue test set refers to a simple QA question-answering task.

The following is the operation flow of the benchmark system based on user input configuration. Because the interface part is written by Meng Zhuo, the general structure is basically consistent with Meng Zhuo. The flowchart shows the data verification, parsing, initialization and other operations. The difference lies in the reading of the issue data set. In the issue data set, there is only one Question, but there may be multiple Comments, so in the training part, the data reading needs to be adjusted.

<img src="E:\2024\第一次开源之夏\ianvs\docs\proposals\scenarios\Smart Coding\image\data_process_change.png"/>
![](https://github.com/safe-b/ianvs/blob/main/docs/proposals/scenarios/Smart_Coding/image/data_process_change.png?raw=true)

<img src="E:\2024\第一次开源之夏\ianvs\docs\proposals\scenarios\Smart Coding\image\change_part.png"/>
![](https://github.com/safe-b/ianvs/blob/main/docs/proposals/scenarios/Smart_Coding/image/change_part.png?raw=true)

It is worth noting that this design is also compatible with the old version of index data. You only need to change the old version's `train_url` and `test_url` fields to train_index and test_index.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -101,9 +101,9 @@ issue部分测试集格式,参照简单的QA问答任务,通过LLM来回答
如下是基于用户输入配置的基准测试系统的操作流程,这部分因为接口部分是由孟卓同学来写的,所以大体结构基本是与孟卓一致的。流程图展示了数据的验证、解析、初始化等操作。
其中不同的点在于对issue数据集的读取,issue数据集中,Question只有一个,但Comment可能会有多个,所以在训练部分,数据的读取还有调整。

<img src="E:\2024\第一次开源之夏\ianvs\docs\proposals\scenarios\Smart Coding\image\data_process_change.png"/>
![](https://github.com/safe-b/ianvs/blob/main/docs/proposals/scenarios/Smart_Coding/image/data_process_change.png?raw=true)

<img src="E:\2024\第一次开源之夏\ianvs\docs\proposals\scenarios\Smart Coding\image\change_part.png"/>
![](https://github.com/safe-b/ianvs/blob/main/docs/proposals/scenarios/Smart_Coding/image/change_part.png?raw=true)

值得注意的是,该设计同时也兼容对旧版的index数据的支持。仅仅只需要将旧版的train_url和test_url字段改成train_index和test_index即可。

Expand Down

0 comments on commit b59e3ab

Please sign in to comment.