You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I tried to launch a search over a huge database and used gpusim_mergedb.py to process the database files in parallel. However, merging didn't work. It created empty files. After a little bit of digging into the problem, I found the cause.
The gpusim_createdb.py writes 4 values to the top of each database
However, gpusim_mergedb.py read (and then writes to a merged fsim file) only 3: everything except for dbkey. First reading the dbkey for each database and then writing it to a merged file solves the problem.
The text was updated successfully, but these errors were encountered:
Mariewelt
changed the title
Merging multiple databases into 1 not working
Merging multiple databases not working
Oct 3, 2020
Thank you very much @Mariewelt for doing this investigation! We don't have sufficient testing set up of merge_database.py obviously, so this was missed. Do you want to do a pull request of your changes?
Hey @lorton
I tried to launch a search over a huge database and used gpusim_mergedb.py to process the database files in parallel. However, merging didn't work. It created empty files. After a little bit of digging into the problem, I found the cause.
The gpusim_createdb.py writes 4 values to the top of each database
However, gpusim_mergedb.py read (and then writes to a merged fsim file) only 3: everything except for dbkey. First reading the dbkey for each database and then writing it to a merged file solves the problem.
The text was updated successfully, but these errors were encountered: