Repository Issues

dataabc/distribute_crawler

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

View on GitHub
Stars
 (1 star)
Forks
 (2 forks)
Indexed issues
 (0 indexed issues)
open beginner issues
 (0 open beginner issues)
Latest indexed
Jul 26, 2026
Last GitHub push
Aug 7, 2013
License
No license data
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
Python
PR merge metrics
 (No merged PRs in 30d)
Beginner labels
No beginner labels indexed

Issues

0 open indexed issues

RSSAtom

No open indexed issues found for this repository.