Skip to content

dex0423/Django-Elasticsearch-Scrapy-redis-Docker-Search-Engine

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

项目简述:

- 基于 django + scrapy-redis + elasticsearch + docker 搭建分布式搜索引擎。

功能描述:

- 利用 scrapy-redis 抓取网页,此处的抓取对象为六安市房产数据 http://fcj.luan.gov.cn/laweb/Web/PreSellInfo/ShowPreSellCertList.aspx;

- 利用 elasticsearch 存储抓取的数据,同时存储于 MySQL 实现持久化;

- 利用 django 搭建数据搜索界面;

- 实现 docker 容器化部署;

- 实现分布式部署;

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published