includes test. somehow failing tests are not part of the result?? possibly overwrite the errorformat?