Skip to content

oduwsdl/archive_profiler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Archive Profiler

Scripts to generate profiles of various Web archives that will be saved in Archive Profiles Repository.

Running Profiler Script

To setup and run the Profiler script, please follow these steps:

Clone the repository.

$ git clone [email protected]:oduwsdl/archive_profiler.git

Change working directory.

$ cd archive_profiler

Install dependencies from the requirement file (add sudo before pip command if necessary.)

$ pip install -r requirements.txt

Run the script on the shipped sample cdx files.

$ python ./main.py cdx/*.cdx

If the script finishes without errors, it should save the profiles in the profiles folder. Now please update the config.ini file to reflect your collection. Then try to run profiler against your own cdx file(s). This will generate profiles for your collection and will save them in the profiles directory (it will overwrite existing files with the same name).

$ python ./main.py path/to/cdx/files/*.cdx

About

Scripts to generate profiles of various Web archives

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published