H

heroshi

Settings | Report Duplicate

0

I Use This!

Activity Not Available

Commits : Listings

Analyzed about 1 year ago. based on code collected about 1 year ago.

Commit Message	Contributor	Files Modified	Lines Added	Lines Removed	Code Location	Date
Jan 20, 2023 — Jan 20, 2024 Showing page 1 of 9 Search / Filter on:
limitmap moved to separate repo github.com/temoto/limitmap	Sergey Shepelev	More...				almost 6 years ago
New DNS subsystem finished, Thanks to https://github.com/miekg/dns	Sergey Shepelev	More...				over 11 years ago
sync with new miekg/dns, robotstxt-go	Sergey Shepelev	More...				over 11 years ago
Resolve DNS explicitly	Sergey Shepelev	More...				over 11 years ago
log crawling speed	Sergey Shepelev	More...				over 11 years ago
Set number of parallel threads to number of CPUs	Sergey Shepelev	More...				over 11 years ago
Cheap chan struct{} semaphore to limit concurrency	Sergey Shepelev	More...				over 11 years ago
util.HasPort	Sergey Shepelev	More...				over 11 years ago
camel case	Sergey Shepelev	More...				over 11 years ago
Merged pure Go implementation with new design - collection of small programs	Sergey Shepelev	More...				over 12 years ago
setup.py version and other metadata cleanup: only in setup script	Sergey Shepelev	More...				over 12 years ago
storage.postgres: store urlhash as bytea	Sergey Shepelev	More...				over 13 years ago
Use github reference to robotstxt package.	Sergey Shepelev	More...				about 14 years ago
fixup: support new 'key' field in heroshi-report script	Sergey Shepelev	More...				about 14 years ago
io-worker: new field in result JSON: 'key'	Sergey Shepelev	More...				about 14 years ago
io-worker: reuse string(line) on parse errors	Sergey Shepelev	More...				about 14 years ago
cosmetic	Sergey Shepelev	More...				about 14 years ago
io-worker: goinstall-friendly redis package import	Sergey Shepelev	More...				about 14 years ago
Export report struct fields, use tags to preserve lowercase keys in output.	Sergey Shepelev	More...				about 14 years ago
io-worker: cache each fetched url independently.	Sergey Shepelev	More...				about 14 years ago
io-worker: too many redirects is no longer an error. Return last result instead.	Sergey Shepelev	More...				about 14 years ago
io-worker: use flag package for runtime configuration via command line options.	Sergey Shepelev	More...				about 14 years ago
cosmetic	Sergey Shepelev	More...				about 14 years ago
io-worker: sync with new robotstxt: use FromResponseBytes	Sergey Shepelev	More...				about 14 years ago
io-worker: sync with new robotstxt library API: pass print_errors=false	Sergey Shepelev	More...				about 14 years ago
cosmetic, gofmt	Sergey Shepelev	More...				about 14 years ago
io-worker: FetchResult.Body is now []byte (was string)	Sergey Shepelev	More...				about 14 years ago
io-worker: don't put cached results to cache again.	Sergey Shepelev	More...				about 14 years ago
cosmetic, typo	Sergey Shepelev	More...				about 14 years ago
New stats column: total_time.	Sergey Shepelev	More...				about 14 years ago

←
1
2
3
4
5
6
7
8
9
→