Managed by | Updated .
Clean data as close to the source as possible. Implementations should aim to avoid custom data cleansing workflow steps.
Should a filter or a hook script be used?
Data cleansing efforts should be applied as close to the source as possible. The order of priority for cleaning should be:
- Source: Can you arrange for the data to be as close as possible to the expected format? Can you gather only what is needed (include / exclude patterns)?
- Custom filter (Groovy)
- Hook scripts (Groovy)
- Server-side template (Freemarker)