Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

error for unfound taxa when supplying a file to goat taxon search #23

Open
charlottewright opened this issue Aug 25, 2023 · 3 comments
Open

error for unfound taxa when supplying a file to goat taxon search #23

charlottewright opened this issue Aug 25, 2023 · 3 comments

Comments

@charlottewright
Copy link

Hello!

When running goat-cli taxon search with a file as input I get an error for each query species which does not exist in goat. For species that do return a hit, the output is as expected. The error is:

@media(max-width:640px){body{font-size:10pt}.longfoot aside, .longfoot footer p, aside,footer p{float:none;width:100%;padding:0.5em}}

 </style>
</head>
<body>
<h1><img src="/errors/sanger_289x86.png" alt="The Wellcome Sanger Institute" /></h1>
<div class="msg"> 
<p>
 The Sanger Institute Web service you requested is temporarily unavailable. 
 We are working to diagnose the problem and restore the service as soon as
 possible. We apologise for any inconvenience caused.
</p>
</div>
<footer>
 <aside>
  Further information about this outage may be found on the <a href="http://wtsi-status.blogspot.co.uk/">Sanger status blog</a>.
 </aside>
 <p>
  The Sanger Institute is a genome research institute primarily funded by
  <a href="https://wellcome.ac.uk/">Wellcome</a>. We use large-scale sequencing,
  informatics and analysis of genetic variation to further our understanding of gene function
  in health and disease and to generate data and resources of lasting value to biomedical research.
 </p>
</footer>

</body>
</html>

When running such species individually with -t flag, I get just the header output with no hits as expected so it seems the error is related to using a file with many queries.

The exact command I run is:
goat-cli taxon search -f $i --assembly --country-list --karyotype

Thanks! :)

Charlotte
@rjchallis
Copy link

This is related to the connection timing out after several minutes. breaking the list up into smaller files should be an effective workaround for now to save having to run them one at a time.

The current implementation stops searching if the connection breaks to save the API having to process abandoned queries, but I'll need to implement some way to save the results to be collected when the query has finished in genomehubs/genomehubs to make it possible to fetch large results from the CLI, API and UI.

@Euphrasiologist
Copy link
Collaborator

@rjchallis do think this would be solved in part if the requests were made serially instead of concurrently?

Would make the progress bar issue (#22) easier to solve too.

@Euphrasiologist
Copy link
Collaborator

I've been thinking about this one. We can make this much more efficient by combining multiple taxa into the same search. @rjchallis is there any constraint on number of taxa in URL requests apart from URL length (< 2048 chars)? Not sure how to do this yet, but we could check number of taxa on CLI/in a file and then make fewer requests but with more taxa per request.

I'll see how to implement this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@rjchallis @Euphrasiologist @charlottewright