v20.09.3

Bug Fixes

v20.09.2

Features

v20.09.1

Bug Fixes

v20.09.0

Bug Fixes

v20.08.4

Features

v20.08.3

CI Changes

v20.08.2

Features

v20.08.1

v20.08.0

v20.07.0

v20.06.2

v20.06.1

v20.06.0

v20.05.2

v20.05.1

v20.05.0

v8.1.0

v8.0.1

v8.0.0

v7.0.2

v7.0.1

v7.0.0

  • #574 Improve test shard error reporting. Update device catalog to use projectId. (bootstraponline)
  • #582 Fix iOS exit code when using flaky-test-attempts. Don't print environment-variables to stdout for security. (bootstraponline)
  • #584 Poll all test executions instead of only the first per matrix. (bootstraponline)
  • #585 Fix bug in smart flank when sharding tests that run in 0 seconds. (bootstraponline)

v6.2.3

v6.2.2

v6.2.1

v6.2.0

  • #560 Add --test-runner-class support for Android. (jschear)

v6.1.0

  • #542 Add additional-app-test-apks to include multiple app/test apk pairs in a single run. (bootstraponline)

v6.0.1

v6.0.0

v5.1.0

  • #537 Add smart-flank-disable-upload yml option to prevent new results from overriding previous results. (elihart)

v5.0.2

v5.0.1

v5.0.0

  • #506 Add bugsnag reporting to detect Flank crashes. (bootstraponline)
  • #507 Improve error message when credentials fail to load, folder doesn't exist, and on bucket creation failure. Properly pass through user credential when checking the storage bucket. (bootstraponline)
  • #514 Rename testShards to maxTestShards (miguelslemos)
  • #518 Add deprecation warnings when old key names are used. flank android doctor --fix will auto fix the YAML file. (bootstraponline)
  • #519 Rename maxTestShards to max-test-shards, shardTime to shard-time, repeatTests to repeat-tests, smartFlankGcsPath to smart-flank-gcs-path, disableSharding to disable-sharding. Moved project from gcloud to flank (bootstraponline)
  • #523 Add --local-result-dir to make it easy to find the test result at a fixed path. (bootstraponline)
  • #524 Fix iOS test sharding when there's a space in the path (bootstraponline)
  • #522 Correctly report test results and exit code when using flaky-test-attempts (bootstraponline)
  • #530 Save files downloaded with files-to-download to device root folder. Fix web links in HTML report. (bootstraponline)
  • #533 Update matrix_ids.json on every matrix change. Useful for debugging runs that crashed. (jschear)

v4.4.0

v4.3.1

v4.3.0

v4.2.0

  • Fix create Gcs bucket #444
  • Add files-to-download to Android and iOS. Specify a list of regular expressions to download files from the Google Cloud Storage bucket. #441
  • Add flank auth login to authorize with a user account instead of a service account. #446
  • Add flaky-test-attempts support on Android and iOS which automatically retries failed tests. #454

v4.1.1

  • Add support for parameterized iOS tests when shard count is 1. #435
  • Add support for SkipTestIdentifiers when parsing iOS .xctestrun files. #435

v4.1.0

  • app, test, and xctestrun-file now support ~, environment variables, and globs (*, **) when resolving paths. #386
  • Add CLI support for flank android run and flank ios run
  • Add experimental smartFlankGcsPath to shard iOS and Android tests by time using historical run data. The amount of shards used is set by testShards. #385
  • Fix parsing empty testcase #402
  • Add progress bar when uploading files. #403
  • iOS iPhone 8 default device has been updated from 11.2 to 12.0.

v4.0.0

  • Add flank cancel command. See flank cancel --help
  • Add flank refresh command. See flank refresh --help
  • Automatically detect projectId from service account credential
  • Always generate aggregated JUnit XML reports
  • Update HTML report to use create-react-app v2.1.0
  • Add support for Xcode 10.1
  • Improve test parsing to detect Swift tests that throw errors
  • Update Flank exit codes, see readme for details.
  • Link to matrix root when testing on multiple devices