H

heroshi

Settings | Report Duplicate

0

I Use This!

Activity Not Available

Commits : Listings

Analyzed about 1 year ago. based on code collected about 1 year ago.

Commit Message	Contributor	Files Modified	Lines Added	Lines Removed	Code Location	Date
Jan 20, 2023 — Jan 20, 2024 Showing page 5 of 9 Search / Filter on:
setup fix: use find_packages to include heroshi.{data,manager.worker} subpackages in distribution.	Sergey Shepelev	More...				over 14 years ago
Optionally use the `yajl` module for JSON parsing if available	R. Tyler Ballance	More...				over 14 years ago
fix graceful_stop when _queue_updater_thread was not started (because URLs supplied inline w/o manager)	Sergey Shepelev	More...				over 14 years ago
Added distribute setup script.	Sergey Shepelev	More...				over 14 years ago
cosmetic	Sergey Shepelev	More...				over 14 years ago
manager, storage: eager initialization of storage connection, so manager will fail on the very start if storage is not available	Sergey Shepelev	More...				over 14 years ago
manager: eagerly initialize manager (including prefetch worker, which would init storage connection)	Sergey Shepelev	More...				over 14 years ago
Crawler: catch all HTTP exceptions in fetch()	Sergey Shepelev	More...				over 14 years ago
tests: graceful_stop in tests tearDown	Sergey Shepelev	More...				over 14 years ago
extracted common reraise_errors utility function for propagating errors up to another thread	Sergey Shepelev	More...				over 14 years ago
using json module instead of cjson (works on 2.6 and with simplejson installed)	Sergey Shepelev	More...				over 14 years ago
fix: missed `raise_conflict` in `storage.save_content` declaration	Sergey Shepelev	More...				almost 15 years ago
Extracted logging to module `log`; more smooth initialization of logging.	Sergey Shepelev	More...				almost 15 years ago
More specific configuration errors: ConfigNotFound and ConfigNotSpecified.	Sergey Shepelev	More...				almost 15 years ago
manager: more clear handling of links (now used only in bin/heroshi-append)	Sergey Shepelev	More...				almost 15 years ago
cosmetic	Sergey Shepelev	More...				almost 15 years ago
cosmetic: catch all CrawlError-s, instead of particular two	Sergey Shepelev	More...				almost 15 years ago
fix: worker.Crawler: set visited timestamp even in case of error	Sergey Shepelev	More...				almost 15 years ago
cosmetic: removed unused imports	Sergey Shepelev	More...				almost 15 years ago
manager: don't store links count since crawler doesn't supply links anymore	Sergey Shepelev	More...				almost 15 years ago
cosmetic	Sergey Shepelev	More...				almost 15 years ago
worker.Crawler doesn't do content parsing anymore	Sergey Shepelev	More...				almost 15 years ago
manager: extracted postreport worker single step; also do 2 duplicate report checks	Sergey Shepelev	More...				almost 15 years ago
manager: extracted given_items cache timeout to config under prefetch:cache_timeout key	Sergey Shepelev	More...				almost 15 years ago
data.Cache: added popitem. More compliance with dict.	Sergey Shepelev	More...				almost 15 years ago
bin/check: additional flags are passed to nose	Sergey Shepelev	More...				almost 15 years ago
data.Cache: added `pop` method and fixed expiry race bug	Sergey Shepelev	More...				almost 15 years ago
tests for `data.Cache`	Sergey Shepelev	More...				almost 15 years ago
manager: cli_manager, separate entry-point which runs eventlet.wsgi.	Sergey Shepelev	More...				almost 15 years ago
dns: rewrote dns module without class. Cache must be passed to `dns.gethostbyname` explicitly.	Sergey Shepelev	More...				almost 15 years ago

←
1
2
3
4
5
6
7
8
9
→