You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
now the error path is configed by user config file. If you run the exchange app over one times without modify error.output, the path will be reused, and the data will append to the file in error path, causing data confuse.
in order to avoid this, we need to generate a unique directory for every spark application to store the writing failed data.
Contents
Related work
The text was updated successfully, but these errors were encountered:
Introduction
now the error path is configed by user config file. If you run the exchange app over one times without modify error.output, the path will be reused, and the data will append to the file in error path, causing data confuse.
in order to avoid this, we need to generate a unique directory for every spark application to store the writing failed data.
Contents
Related work
The text was updated successfully, but these errors were encountered: