âå
¥é¨âæ¯è¯å¥½çå¨æºï¼ä½æ¯å¯è½ä½ç¨ç¼æ
¢ãå¦æä½ æéæè
èåéæä¸ä¸ªé¡¹ç®ï¼é£ä¹å®è·µèµ·æ¥ä½ ä¼è¢«ç®æ 驱å¨ï¼èä¸ä¼åå¦ä¹ 模åä¸æ ·æ
¢æ
¢å¦ä¹ ã
å¦å¤å¦æ说ç¥è¯ä½ç³»éçæ¯ä¸ä¸ªç¥è¯ç¹æ¯å¾éçç¹ï¼ä¾èµå
³ç³»æ¯è¾¹çè¯ï¼é£ä¹è¿ä¸ªå¾ä¸å®ä¸æ¯ä¸ä¸ªæåæ ç¯å¾ãå 为å¦ä¹ Açç»éªå¯ä»¥å¸®å©ä½ å¦ä¹ Bãå æ¤ï¼ä½ ä¸éè¦å¦ä¹ æä¹æ ·âå
¥é¨âï¼å 为è¿æ ·çâå
¥é¨âç¹æ ¹æ¬ä¸åå¨ï¼ä½ éè¦å¦ä¹ çæ¯æä¹æ ·åä¸ä¸ªæ¯è¾å¤§çä¸è¥¿ï¼å¨è¿ä¸ªè¿ç¨ä¸ï¼ä½ ä¼å¾å¿«å°å¦ä¼éè¦å¦ä¼çä¸è¥¿çãå½ç¶ï¼ä½ å¯ä»¥äºè®ºè¯´éè¦å
æpythonï¼ä¸ç¶æä¹å¦ä¼pythonåç¬è«å¢ï¼ä½æ¯äºå®ä¸ï¼ä½ å®å
¨å¯ä»¥å¨åè¿ä¸ªç¬è«çè¿ç¨ä¸å¦ä¹ python :D
çå°åé¢å¾å¤çæ¡é½è®²çâæ¯âââç¨ä»ä¹è½¯ä»¶æä¹ç¬ï¼é£æ就讲讲âéâåâæ¯âå§ââç¬è«æä¹å·¥ä½ä»¥åæä¹å¨pythonå®ç°ã
å
é¿è¯ç说summarizeä¸ä¸ï¼
ä½ éè¦å¦ä¹
åºæ¬çç¬è«å·¥ä½åç
åºæ¬çhttpæåå·¥å
·ï¼scrapy
Bloom Filter: Bloom Filters by Example
å¦æéè¦å¤§è§æ¨¡ç½é¡µæåï¼ä½ éè¦å¦ä¹ åå¸å¼ç¬è«çæ¦å¿µãå
¶å®æ²¡é£ä¹çä¹ï¼ä½ åªè¦å¦ä¼ææ ·ç»´æ¤ä¸ä¸ªææé群æºå¨è½å¤ææå享çåå¸å¼éå就好ãæç®åçå®ç°æ¯python-rq:
https://github.com/nvie/rqrqåScrapyçç»åï¼darkrho/scrapy-redis · GitHub
åç»å¤çï¼ç½é¡µæå(grangier/python-goose · GitHub)ï¼åå¨(Mongodb)