[ENH]:

[LeSasse]

Are you requiring a new dataset or marker?

• I understand this is not a marker or dataset request

Which feature do you want to include?

I have prototyped a small command line utility to collect and aggregate logging information from junifer pipelines into convenient DataFrames. This DataFrame contains information about resources used (CPUs, time elapsed, memory, disk space used ...), warnings, job success etc. Each row corresponds to a junifer 'element'. For now, it is assumed that logs are from HTCondor as no other queueing backends are implemented in junifer.

As discussed with @fraimondo this could be integrated into junifer similarly to #315

How do you imagine this integrated in junifer?

as an additional command

or simply by linking to the tool in a list of curated external tools in the documentation

Do you have a sample code that implements this outside of junifer?

https://github.com/LeSasse/junilog

Anything else to say?

No response