Some Questions Regarding the WikiSQL Results

[tom68-ll]

Hi author! @Bahuia
Thank you very much for your fix. However, we have some questions regarding the results on WikiSQL and would appreciate your insights.

1. In the revised WikiSQL results, we noticed that all values for the BWT metric are positive, which we also observed in our own replication. This seems somewhat unexpected and inconsistent with the results reported in the paper, unless the model demonstrates a very strong generalization ability.
   

   SSCL-Text2SQL/wikisql.log

   Line 12543 in e55e111

   Backward Transfer: [-inf, 0.033, 0.017, 0.023, 0.031, 0.034, 0.023, 0.022, 0.012, 0.018]

2. Simultaneously, we noticed that on WikiSQL, SFNET's performance even surpasses the ORACLE method, which appears to be a quite intriguing discovery. However, the reasons behind this phenomenon are not entirely clear to us. Could you please provide further insights on this matter?
   

   SSCL-Text2SQL/wikisql.log

   Line 12544 in e55e111

   Forward Transfer: [-inf, 0.445, 0.565, 0.584, 0.606, 0.62, 0.632, 0.639, 0.649, 0.655]

Originally posted by @tom68-ll in #3 (comment)