Skip to content

A
apachedex
Commit bd9c05c1 authored by Vincent Pelletier's avatar Vincent Pelletier
Browse files
Options

Add line break between parallel parsing and final aggregation.

parent 8b26cf34
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
parallel_parse.sh
View file @ bd9c05c1
...@@ -26,4 +26,5 @@ fi ...@@ -26,4 +26,5 @@ fi
# XXX: any simpler way ? # XXX: any simpler way ?
xargs -0 -r -n 1 -P $PARALLELISM -I "@FILE@" -- "$SHELL" -c 'INFILE="$1";shift;STATE_DIR="$1";shift;echo -n .;"$@" -Q --format json --out "$STATE_DIR/$(sed s:/:@:g <<< "$INFILE").json" "$INFILE"' "$0" "@FILE@" "$STATE_DIR" "$@" xargs -0 -r -n 1 -P $PARALLELISM -I "@FILE@" -- "$SHELL" -c 'INFILE="$1";shift;STATE_DIR="$1";shift;echo -n .;"$@" -Q --format json --out "$STATE_DIR/$(sed s:/:@:g <<< "$INFILE").json" "$INFILE"' "$0" "@FILE@" "$STATE_DIR" "$@"
echo
"$@" --out "$OUT_FILE" --state-file "$STATE_DIR"/* "$@" --out "$OUT_FILE" --state-file "$STATE_DIR"/*
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7