Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add "extra info" field to the records #332

Closed
wants to merge 4 commits into from
Closed

Conversation

shanedsnyder
Copy link
Contributor

In GitLab by @roblatham00 on Feb 21, 2018, 14:45

I did this a while back on intel-hpdd's repo, where it seems to have been forgotten.

I have sometimes needed to annotate log fields with extra information. for example, in ROMIO, it was helpful to know which round of two-phase collective I/O an operation happened in.

I suspect EXTRA_INFO would be used rarely, so adding 64 bytes to a log entry all the time seems wasteful. Can switch to a more dynamic approach where EXTRA_INFO allocated only if environment variable set if that seems better

probably paranoia, but just in case a compiler is set to turn warnings
into errors, let's explicitly initialize these parameters to
MPI_File_open (even though it's a compile-only check and will never
execute)
We can obtain the implicit file pointer with MPI_File_get_position.
Similar routine for the shared file pointer.  Explicit file ponters
already provide an offset.

In all three cases MPI_File_get_byte_offset turns "offsets in terms of
file types" into an explicit count of bytes, so I stuck _get_byte_offset
into the MPIIO_RECORD_ macro.
@shanedsnyder
Copy link
Contributor Author

In GitLab by @carns on Feb 28, 2018, 13:04

I would vote for a dynamic approach for sure. 64 bytes per access is too much for the general case.

How do you use it exactly? Do you just do putenv() in the code you are annotating to pass information that will show up in DXT?

In that case, maybe a doc update with the pull request too just so we can remember how to use it when needed :)

@shanedsnyder
Copy link
Contributor Author

In GitLab by @roblatham00 on Apr 20, 2020, 10:38

added 152 commits

  • 657de0d7...7dfbddce - 148 commits from branch master
  • cf60c40 - Initialize arguments for MPI-IO check
  • 6bd1cfe - fix a shadowed declaration warning
  • f9eab31 - add an 'offset' to mpi-io traces
  • 0030458 - update parser to show MPI-IO offset information

Compare with previous version

@shanedsnyder
Copy link
Contributor Author

In GitLab by @roblatham00 on May 1, 2020, 15:16

closed

@shanedsnyder
Copy link
Contributor Author

In GitLab by @roblatham00 on May 1, 2020, 15:17

Uh looks like I force-pushed and overwrote these changes. I'll have to find the old work and dust it off; might not even still be a good idea.

@roblatham00
Copy link
Contributor

Not saying the idea is any good, but it wasn't a ton of work to update to main.

@roblatham00
Copy link
Contributor

revisit this work in #979

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants