- fetch connector-architecture
git clone https://github.com/TREEcg/connector-architecture.git
- Setup infrastructure
docker compose up
3.1 Adding pipeline modules
cd processor
git submodule add <MP1 github url>
git submodule add <MP2 github url>
git commit -am "commit message"
3.2 run mp1 and ingest data into MongoDB
node runner/js-runner/bin/js-runner.js mp1_pipeline.ttl
3.3 run mp2 and ingest data into a RDF store
node runner/js-runner/bin/js-runner.js mp2_pipeline.ttl
Port mappings:
0.0.0.0:8080->8080/tcp ldes.server
0.0.0.0:27017->27017/tcp ldes.mongodb
1111/tcp, 0.0.0.0:8890->8890/tcp package-virtuoso-1