Commit f0d31a52 authored by Vincent Pelletier's avatar Vincent Pelletier

Add performance tips in README.

parent 3ae657f2
...@@ -151,6 +151,25 @@ without parsing more logs:: ...@@ -151,6 +151,25 @@ without parsing more logs::
apachedex --default foo --state-file save_state.json save_state.2.json apachedex --default foo --state-file save_state.json save_state.2.json
--period day --out index.html --period day --out index.html
Performance
===========
For better performance...
- pipe decompressed files to apachedex instead of having apachedex decompress
files itself::
bzcat access.log.bz2 | apachedex [...] -
- parse log files in parallel processes, saving analysis output and aggregating
them in the end::
for LOG in access*.log; do
apachedex "$@" --format json --out "$LOG.json" "$LOG" &
done
wait
apachedex "$@" --out access.html --state-file access.*.json
Notes Notes
===== =====
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment