Skip to content

Releases: elastic/rally

2.0.0

07 May 07:24
2.0.0
Compare
Choose a tag to compare

2.0.0

Highlights

  • #970: Add tooling to create a track from existing data
  • #944: Allow to use significantly more clients
  • #935: Add an asyncio-based load generator
  • #875: Add 'Tracker' track-generation tool

Enhancements

  • #988: Add experimental segment stats telemetry device
  • #986: Allow to override GC log parameters
  • #977: Migrate track param check to new IT infrastructure
  • #972: Pass actor system env vars in integration test
  • #971: Add thespian logs to ci
  • #969: Add an it method for rally race
  • #968: Add integration tests with eventdata
  • #967: Raise an error when attempting to bulk-index without any corpora
  • #966: Migrate more integration tests
  • #963: Reduce mapped memory with many bulk clients
  • #962: Increase bulk size to metrics store
  • #959: Clarify the impact on refreshes for node-stats telemetry
  • #958: Avoid duplicate URL parsing for async connections
  • #954: Add flag to handle running processes automatically
  • #953: Pass JAVA14_HOME in build
  • #952: Allow to disable HTTP compression for all queries
  • #951: Upgrade Thespian to 3.10.0
  • #950: Add support for a RALLY_HOME env var everywhere
  • #949: Upgrade Elasticsearch client to 7.6.0
  • #947: Use pbzip2/pigz to decompress corpora if available
  • #945: Add an override for the rally homedir
  • #941: Improve response processing
  • #938: Store units in results
  • #934 (Breaking): Bump minimum Python version to 3.8
  • #932: Improve layout of generated dashboards
  • #931: Store Rally revision in metrics metadata
  • #930: Update psutil to latest version
  • #929: Allow index-stats to compare non-existing path
  • #928: Don't invoke setup.py directly
  • #925: Allow to specify an indices stats condition
  • #923: Assume a TTY for interactive commands
  • #919: Run integration tests with pytest
  • #914: Improve release docs and IT prechecks
  • #913: Normalize handling of --preserve-install

Bug Fixes

  • #983: Assign worker-id globally
  • #978: Remove os environment variables from env prep
  • #965: Always shutdown worker thread pool
  • #961: Determine most recent sample per client
  • #960: Disable docstring linter check
  • #956: Fix fallback implementation of ML-related runners
  • #943: Fix request timeout handling
  • #942: Honor response-compression-enabled parameter
  • #927: Add unit for all query charts
  • #918: Gather system metrics on Docker stop if possible

Doc Changes

  • #980: Change next Rally version in migration docs
  • #955: Update docs to advise use of pbzip2 for new track corpus
  • #948: Align track reference structure with track
  • #939: Correct JMC download link
  • #937: Fix port number in recipes docs

1.4.1

20 Feb 16:33
Compare
Choose a tag to compare

1.4.1

Highlights

  • #890: Speed up client-side bulk-handling

Enhancements

  • #912: Honor only specified Python versions in prereq
  • #909: Add custom probing URL
  • #908: Validate docker-compose exists in it tests
  • #907: Specify useful variables for Rally CI
  • #906: Specify useful variables for Rally CI
  • #904: Eliminate deprecation warnings in Python 3.7+
  • #903: Show more user-friendly track loader errors
  • #899 (Breaking): Use zeroes instead of whitespaces as padding bytes
  • #895: Log race id on startup
  • #887: Allow to override Python binary for make
  • #886: Fix race condition with old ES processes in IT tests
  • #884: Detach ES using Python standard mechanism
  • #880: Show recent log output on integration test failure
  • #879: Don't read from stdout/stderr on ES startup
  • #873: Prevent installation with unsupported Python
  • #872: Extend error msg to specify operation name for missing index
  • #865: Updating force merge operation to force merge only track indices by default

Bug Fixes

  • #901: Fix race in wait_for_pidfile.
  • #894: Only set distribution-version if known
  • #893: Only clear metrics store on benchmark end
  • #891: Align exception handling in disk IO telemetry
  • #885: Fix issue with fetching test-mode -1k document corpora.
  • #883: Stop all locally running nodes
  • #882: Make REST API check stricter
  • #881: Wait for REST layer before version check
  • #877: Don't write metrics to a closed metrics store
  • #874: Store system metrics if race metadata are present
  • #871: Skip setup phase in IT tests during docker release
  • #868: Fix W0631
  • #860: More resilient node shutdown

Doc Changes

  • #902: Add example how to determine actor system status

1.4.0

15 Jan 17:38
1.4.0
Compare
Choose a tag to compare

1.4.0

Highlights

  • #853: Allow to use the bundled JDK in Elasticsearch
  • #830: Manage Elasticsearch nodes with dedicated subcommands
  • #815: Add Python 3.8 in Rally tests

Enhancements

  • #863: Allow piped stdin in run_subprocess_with_logging
  • #862: Add support for excluded tasks in chart_generator
  • #850: Allow to show track details
  • #844: Add task exclude filter
  • #840: Add make target to serve docs locally
  • #836: Upgrade boto3
  • #832: Only keep the most recent build log
  • #829: Reduce usage of platform-specific code
  • #818 (Breaking): Store build.log in log directory
  • #816: Harmonize local pyenv versions with CI ones
  • #805: Add lint + precommit make targets.
  • #803: Calculate system metrics per node
  • #802: Whitelist py.test in tox tests
  • #798: Allow definition of body in restore-snapshot operation
  • #793: Add ability to restore from a snapshot
  • #789: Let the runner determine progress
  • #788: Manage dev dependencies in setup.py
  • #785: Don't attach telemetry devices for Docker
  • #783: Upgrade pytest to 5.2.0
  • #779 (Breaking): Gather cluster-level metrics in driver
  • #778 (Breaking): Expose race-id as command line parameter
  • #776: Add heapdump telemetry device
  • #774: Raise an error if race is not found by id
  • #773: Store race files always as race.json
  • #771: Store track-related meta-data in results
  • #767: Remove merge times from command line report
  • #766: Ensure tox environment is clean
  • #765: Start release process creating NOTICE
  • #727: Allow function-level invocation of integration-test.sh.

Bug Fixes

  • #861: Pass plugin params for all plugins
  • #859: Detach Elasticsearch on startup
  • #858: Use the venv pylint in the makefile
  • #841: Store Disk I/O metrics if available
  • #825: Change remaining it tests to port 19200
  • #820: Upgrade psutil to work with newer linux kernels
  • #814: Fix error handling for automatically derived version
  • #804: Allow multiple nodes per IP
  • #801: Initialize schedule lazily
  • #800: Properly wait for recovery to finish
  • #799: Don't set retries for restore snapshot
  • #784: Attach telemetry device on Docker launch
  • #781: Add support for OSNAME and ARCH variables in dist repo URLs.
  • #768: Honor ingest-percentage for bulks
  • #763 (Breaking): Run a task completely even without time-periods

Doc Changes

  • #834: Clarify uses of distribution-version
  • #826: Add note about mustache template
  • #821: Move logrotate comments to separate lines
  • #817: Fix mistake in wait-for-recovery docs
  • #810: Fix duplicated IP in distributed_load diagram
  • #782: Update Elasticsearch version of targets and metricstore in CCR recipe

1.3.0

09 Sep 14:52
1.3.0
Compare
Choose a tag to compare

1.3.0

Enhancements

  • #764 (Breaking): Remove MergeParts internal telemetry device
  • #762: Check that origin points to main repo for release
  • #761: Allow to retry until success
  • #760: Improve logging of schedules
  • #759: Show track and team revision when listing races
  • #758: Improve error message on SSL errors
  • #755: Add pull request template
  • #748: Consistently render links to the documentation
  • #746: Fixup ProcessLauncherTests issues
  • #744: Change DiskIO callbacks to use attach/detach
  • #739 (Breaking): Remove lap feature and all references.
  • #737: Allow to attach telemetry devices without reprovisioning
  • #735: Assume string type for params by default
  • #731: Update DiskIo telemetry device to persist the counters
  • #730: Be resilient upon startup
  • #729 (Breaking): Drop 1.x support for cluster metadata
  • #728: Allow to set distribution version as parameter
  • #726: Don't check complete list of parameters in integration test
  • #725: Capture team and track revisions in metrics metadata
  • #723: Always exit on OOME
  • #721: Update DiskIo telemetry device to persist the counters
  • #720: Change filestore to be indexed by unique ID
  • #719: ES as a Daemon (again)
  • #716 (Breaking): Drop support for Elasticsearch 1.x
  • #711: Change telemetry devices to rely on jvm.config instead of ES_JAVA_OPTS
  • #701: Implement ES daemon-mode in process launcher

Bug Fixes

  • #751: Option track-revision should work with track-repository
  • #750: Retrieve timestamped commit hash separately
  • #747: Log git output

1.2.1

19 Jun 08:35
1.2.1
Compare
Choose a tag to compare

1.2.1

Highlights

  • #702: Add Rally Docker image to release process
  • #688: Fail Rally early if there are unused variables in track-params

Enhancements

  • #713: Check tags in track and team repos
  • #709 (Breaking): Drop support for Python 3.4
  • #708: Align default request param extraction for queries
  • #707: Upgrade pip for virtualenv
  • #705: Provide default for datastore.secure in all cases
  • #704: Add download subcommand
  • #700: Allow stdout print when running in Docker
  • #694: Measure execution time of bulk ingest pipeline
  • #691: Remove node_count_per_host

Bug Fixes

  • #710 (Breaking): Don't pass request_cache by default
  • #706: Register pyenv Python versions
  • #699: Fix home directory paths in provisioner_test.
  • #698: Enter degraded mode on bootstrap failure
  • #693: Assume UTC timezone if not specified

Doc Changes

  • #714: Document which ES versions are supported by Rally
  • #703: Document known issues in dev setup

1.1.0

07 May 15:42
1.1.0
Compare
Choose a tag to compare

1.1.0

Enhancements

  • #683: Store mean for response-related metrics
  • #681: Use single node discovery type if suitable
  • #679: Skip Python install if already existing
  • #678: Upgrade Jinja to 2.10.1
  • #674: [Experimental] Capture peak usage of JVM mem pools
  • #671: Add ability to download from S3 buckets
  • #670: Pass JAVA12_HOME in integration tests
  • #669: Allow to override request timeout for force-merge
  • #668: Chart generator segment memory and new track combinations
  • #667: Add sleep operation
  • #666: Introduce new command line parameter --track-revision
  • #662: Add distribution flavor to metrics metadata
  • #660: Add user tags when comparing races
  • #659: Sort the track parameters / user tags when listing races
  • #654: Allow to use ES 7.x as metrics store
  • #649 (Breaking): Pass request-params as is in supported operations
  • #648: Updates to support 7.x APIs

Bug Fixes

  • #687: Fix release charts after #684
  • #686: Honor track-params in chart-generator
  • #684: Use license instead of dist flavor in charts
  • #682: Provide a platform-independent Rally binary
  • #675: Fix chart generator segment memory bug
  • #673: Honor runtime JDK in provisioner
  • #661: Small change in the venv-create
  • #655: Add compatibility layer for existing metrics store
  • #652: Properly authenticate at proxy server

Doc Changes

  • #676: Document ccr-stats telemetry device
  • #651: fix typo in custom_scheduler example

1.0.4

20 Feb 11:22
1.0.4
Compare
Choose a tag to compare

1.0.4

Enhancements

  • #650: Use --prune for all git fetch operations
  • #647: Make types optional
  • #646: Add node_name in node-stats docs for ...
  • #644: Allow collection of jvm gc section in node-stats telemetry device
  • #642: Allow passing any request parameter to the create index API
  • #641: Temporarily disable Python 3.4 in build
  • #639: Add recovery-stats telemetry device
  • #637: Ignore JSON logs for merge parts analysis
  • #633: Ensure Makefile install target includes all release dependencies

Bug Fixes

  • #638: Correct recorder-based sampling interval

Doc Changes

  • #640: docs: Clarify that path should start with / for raw-request
  • #634: Fix typo

1.0.3

23 Jan 09:54
1.0.3
Compare
Choose a tag to compare

1.0.3

Enhancements

  • #630: Improve error message on missing repo directory
  • #627: Warn about skewed results when using node-stats telemetry device
  • #625: Allow to specify a team revision
  • #622: Include NOTICE.txt in release
  • #620: Add license headers
  • #617: Fix conflicting pipelines and distribution version
  • #615: Add refresh/merge/flush totals in summary
  • #612: Extract hits either as number or structured object
  • #606: Improve release.sh script and prerequisites
  • #604: Change logging level for esrally command line to DEBUG

Bug Fixes

  • #613: Error can be a string, and shards not always present in response.

Doc Changes

  • #632: Update Release documentation for Rally
  • #623: Update Developing Rally docs sections
  • #621: Minor typo
  • #610: Command fails with "=", ":" is needed.

1.0.2

21 Nov 17:22
1.0.2
Compare
Choose a tag to compare

1.0.2

Enhancements

  • #599: Simplify development setup
  • #594: Add make install as default target
  • #587: Fix typos and inconsistencies in help documentation
  • #576: Improved formatting of document count in list tracks output
  • #574: Rename benchmark data directory to root directory
  • #572: More fine-grained ML metrics
  • #571: Reduce logging when loading tracks
  • #570: Add ML API runners
  • #563: Make Rally compatible with Python 3.7

Bug Fixes

  • #586: Don't fail git clone is tty is not attached
  • #579: Switch to official approach for HTTP compression
  • #575: Always use remote branch for updates

Doc Changes

  • #598: Document --limit

1.0.1

13 Sep 11:21
1.0.1
Compare
Choose a tag to compare

1.0.1

Enhancements

  • #569: Add shrink index runner
  • #559: Write rendered track to a temporary file
  • #558: Avoid throughput throttling in test mode
  • #557: Adjust flight recorder flags for JDK 11
  • #556: Upgrade to Thespian 3.9.3
  • #555: Load only required corpora
  • #549: Exponential back-off for retrying transport errors to metrics store
  • #546: Update ccr stats endpoint
  • #545: Use non-standard port for metrics store in tests
  • #540: Simplify filtering node-stats-related documents
  • #538: Retry metric store for more transport errors

Bug Fixes

  • #565: Improve compatibility when loading invalid JSON
  • #562: Defer startup of mechanic actor
  • #560: Disable automatic log rotation
  • #551: Fix HTTP TLS client certificate verification
  • #544: Fix parsing of boolean values datastore.secure
  • #542: Warn when cluster settings cannot be applied
  • #537: make --test-mode work with uncompressed data #536

Doc Changes

  • #533: State clearly that only Unix is supported