Simple web crawler to collect alexa rank of a website and store in database.
Install dependencies:
lein deps
Run:
lein run
lein uberjar
And run the Jar file:
java -jar target/uberjar/alexa-monitor-0.1.0-SNAPSHOT-standalone.jar
Create GraalVM native-image:
lein native-image
Generate docs using Marginalia:
lein marg -f index.html
There's a sample html file in resources directory, all links are changed to point at localhost so it's basically an ugly copy of Alexa`s Mini Siteinfo. You can run a simple webserver on port 8080 to serve this file, and use that for test (instead of submitting actual requests to alexa.com)
cd resources
./run_server.py
#or
python3 -m http.server 8080
No options yet.
Copyright © 2021 Pouya Abbassi
This program and the accompanying materials are made available under the terms of the Eclipse Public License 2.0 which is available at http://www.eclipse.org/legal/epl-2.0.
This Source Code may also be made available under the following Secondary Licenses when the conditions for such availability set forth in the Eclipse Public License, v. 2.0 are satisfied: GNU General Public License as published by the Free Software Foundation, either version 2 of the License, or (at your option) any later version, with the GNU Classpath Exception which is available at https://www.gnu.org/software/classpath/license.html.