This assumes you have docker installed. If not install docker via the docker website
- Run the following in the cloud system directory to persist the graph DB
mkdir -p system_data/neo4j_data
- Add the server IP to Kafka by changing the following in the docker-compose.yml file
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:9092,PLAINTEXT_HOST://<SERVER_IP>:29092
- Start the cloud system
docker compose up
- Initialize the Kafka brokers for the required topics (for the incoming data)
sh ./init_scripts/create-kafka-topics.sh
- Add Kafka Connect connector for Aggregator Stream sink (Replace the server IP)
curl -X POST http://<SERVER_IP>:8083/connectors \
-H "Content-Type:application/json" \
-H "Accept:application/json" \
-d @aggregated_sink.neo4j.json
- Add Kafka Connect connector for Server state sink (Replace the server IP)
curl -X POST http://<SERVER_IP>:8083/connectors \
-H "Content-Type:application/json" \
-H "Accept:application/json" \
-d @model_sink.neo4j.json
- Run the Kafka Stream processor (jar file)
java -jar ckn-streaming-1.0-SNAPSHOT-jar-with-dependencies.jar