Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Help needed in Arctos: things stuck in the bulkloader? #8335

Closed
happiah-madson opened this issue Nov 25, 2024 · 4 comments
Closed

Help needed in Arctos: things stuck in the bulkloader? #8335

happiah-madson opened this issue Nov 25, 2024 · 4 comments
Labels
Function-DataEntry/Bulkloading Priority-High (Needed for work) High because this is causing a delay in important collection work..

Comments

@happiah-madson
Copy link

Tell us what you are trying to do

load positions via the loadContainerToPosition tool https://arctos.database.museum/loaders/loadContainerToPosition.cfm

What are relevant pages in Arctos

Provide a link to or a description of the page where you need help.
students have had data marked as autoload in the bulkloader over the weekend...which seems a little long?

@dustymc

@happiah-madson happiah-madson added Priority-High (Needed for work) High because this is causing a delay in important collection work.. Function-DataEntry/Bulkloading labels Nov 25, 2024
@dustymc
Copy link
Contributor

dustymc commented Nov 25, 2024

https://arctos.database.museum/info/component_loader_status.cfm will tell you when things should happen. There should be some comment at the top if there's a priority (there's not), otherwise feel free to reorder. There's no set "too long" time, things can run indefinitely.

@dustymc dustymc added this to the Community Forum milestone Nov 25, 2024
@happiah-madson
Copy link
Author

Screen Shot 2024-11-25 at 3 04 15 PM

Can you point me to somewhere that defines the columns? In the text above, it says that what is in the table is minutes. Does that mean that RPM, Autoloads, Pendings, Runtime, and Cumulitive are all minutes for that given tool?

On the right side, I understand "username", but does "recs" = records? So in this picture does the first user have 525 records in the tool but none of them are have the autoload status, so ostensibly are not being loaded?

@dustymc
Copy link
Contributor

dustymc commented Nov 25, 2024

point me to somewhere that defines

No.... (So Issue please! I try not to write things which don't all make perfect intuitive sense - to me, not easy to guess where that stops for everyone else....)

RPM==records per minute
Autoloads, Pendings==recordcount
Runtime, and Cumulitive==minutes

ostensibly

Don't think there's that much mystery here, but maybe....

none of them are have the autoload status

so they're not doing anything (except hanging around waiting to become problematic at the next yearly cleanup, which makes me think maybe that should be monthly cleanups...) / take zero time to process.

The first row that is doing something is...
Screenshot 2024-11-25 at 12 16 02

which processes 5K records and 10 per minute == 500 minutes

That gets added up all down the page....

Screenshot 2024-11-25 at 12 16 52

... which needs a little over 600 minutes to finish from whenever I loaded it - IF nobody changes anything, and someone loading a million records that run at one per minute in front of you is always possible, so please use the comments if you have a priority!

@happiah-madson
Copy link
Author

Ah, makes mucchhhhhhh more sense. I couldn't quite figure out why tools with 0 or very few records had cumulative minutes in the hundreds...

No.... (So Issue please! I try not to write things which don't all make perfect intuitive sense - to me, not easy to guess where that stops for everyone else....)

as specifically requested: ArctosDB/dev#116

@dustymc dustymc closed this as completed Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Function-DataEntry/Bulkloading Priority-High (Needed for work) High because this is causing a delay in important collection work..
Projects
None yet
Development

No branches or pull requests

2 participants