Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

定时器 #23

Open
nonacosa opened this issue Apr 23, 2017 · 2 comments
Open

定时器 #23

nonacosa opened this issue Apr 23, 2017 · 2 comments

Comments

@nonacosa
Copy link
Collaborator

对于一些反爬不错的网站 典型：知乎
应该特别注意模仿用户行为，应该增加定时器每天分三个时段进行智能爬取
@JPCui
Copy link

JPCui commented Apr 25, 2017

打算自己做定时么？考虑用quartz么？

反扒也可以考虑使用代理，从网上找几个用用，，，可以考虑实现自动爬取代理的脚本

@nonacosa
Copy link
Collaborator Author

nonacosa commented Apr 25, 2017 •
edited
Loading

@JPCui 是的，我觉得这个框架为了一个任务调度而引入一个quartz太重了，不如 用 Timer 、ScheduledExecutor 等原生java自己封装一个工具类。
代理的话我开始也打算维护自动爬取代理的程序，后来想了想，不如找一个开源的😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JPCui @nonacosa