Name Last Update
config/checkstyle Loading commit data...
gradle/wrapper Loading commit data...
lib/embulk/input Loading commit data...
src Loading commit data...
.gitignore Loading commit data...
LICENSE.txt Loading commit data...
README.md Loading commit data...
build.gradle Loading commit data...
gradlew Loading commit data...
gradlew.bat Loading commit data...

Filename file input plugin for Embulk

Embulk filename file input plugin similar to local file input which overloads FileInputStream read methods to provide the filename in the first bytes of the stream

Overview

  • Plugin type: file input
  • Resume supported: yes
  • Cleanup supported: yes

Configuration

  • option1: path_prefix (string, required)

Example

seed.yml:

exec:
  min_output_tasks: 1
in:
  type: filename
  path_prefix: /path/to/my/files
  parser:
    type: none-bin
out:
  type: wendelin
  tag: my_tag
  streamtool_uri: https://my_instance.host.vifib.net:/erp5/portal_ingestion_policies/my_ingestion_policy
  user: my_user
  password: my_password

Install

$ embulk gem install embulk-input-filename embulk-parser-none-bin embulk-output-wendelin

Run

$ embulk run seed.yml -c diff.yml

Build

$ ./gradlew package

Build Package

$ ./gradlew gem  # -t to watch change of files and rebuild continuously