Skip to content

Latest commit

 

History

History
727 lines (618 loc) · 43.3 KB

CHANGELOG.md

File metadata and controls

727 lines (618 loc) · 43.3 KB
Raw

Database Tools Changelog

100.4.1

Released 2021-07-23

We are pleased to announce version 100.4.1 of the MongoDB Database Tools.

This patch fixes a bug (TOOLS-2931) that was introduced in version 100.4.0 which causes mongodump to skip any document that contains an empty field name (e.g. { "": "foo" }). Documents with empty field names were not skipped by default if the --query or --queryFile options were specified. No tools other than mongodump were affected. It is highly recommended to upgrade to 100.4.1 if it is possible that your database contains documents with empty field names.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2927] - Clean up the platforms list inside platform.go

Release

Bug

  • [TOOLS-2931] - mongodump skips documents with empty field names

Task

  • [TOOLS-2926] - Run release on 'test' and 'development' linux repo separately.

100.4.0

Released 2021-07-19

We are pleased to announce version 100.4.0 of the MongoDB Database Tools.

This release includes server 5.0 support, including dump/restoring timeseries collections.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2892] - aws-auth tests failing on all variants
  • [TOOLS-2893] - legacy-js-tests 4.4 and 5.0 failing on all variants

Release

Bug

  • [TOOLS-2041] - Mongorestore should handle duplicate key errors during oplog replay
  • [TOOLS-2833] - Creating an index with partialFilterExpression during oplogReplay fails
  • [TOOLS-2925] - RPM packages are only signed with the 4.4 auth token

New Feature

  • [TOOLS-2857] - Dump timeseries collections
  • [TOOLS-2858] - Mongodump can query timeseries collections by metadata
  • [TOOLS-2859] - Restore timeseries collections
  • [TOOLS-2860] - Include/Exclude/Rename timeseries collections in mongorestore

Task

  • [TOOLS-2719] - Add Enterprise RHEL 8 zSeries to Tools
  • [TOOLS-2721] - Add RHEL8 ARM to Tools
  • [TOOLS-2777] - Generate Full JSON variant should not be running on every commit
  • [TOOLS-2823] - Build with go 1.16
  • [TOOLS-2824] - Add static analysis task that runs "evergreen validate"
  • [TOOLS-2849] - Mongodump should fail during resharding
  • [TOOLS-2850] - Mongorestore should fail when restoring geoHaystack indexes to 4.9.0
  • [TOOLS-2851] - importCollection command should cause mongodump to fail
  • [TOOLS-2853] - Hide deprecated --slaveOk option
  • [TOOLS-2866] - Drop support for zSeries platforms
  • [TOOLS-2873] - Run full test suite on all supported distros in evergreen
  • [TOOLS-2881] - Push tools releases to 4.9+ linux repos
  • [TOOLS-2921] - Upgrade to Go Driver 1.6

100.3.1

Released 2021-03-17

We are pleased to announce version 100.3.1 of the MongoDB Database Tools.

This release includes various bug fixes. Particularly notable is TOOLS-2783, where we reverted a change from 100.2.1 (TOOLS-1856: use a memory pool in mongorestore) after discovering that it was causing memory usage issues.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2796] - mongotop_sharded.js failing on all versions of the qa-tests
  • [TOOLS-2815] - Development build artifacts accidentally uploaded for versioned release

Release

Bug

  • [TOOLS-2584] - Restoring single BSON file should use db set in URI
  • [TOOLS-2783] - Mongorestore uses huge amount of RAM

Task

  • [TOOLS-704] - Remove system.indexes collection dumping from mongodump
  • [TOOLS-2801] - Migrate from dep to Go modules and update README
  • [TOOLS-2802] - Make mongo-tools-common a subpackage of mongo-tools
  • [TOOLS-2805] - Add mod tidy static analysis check for Go modules
  • [TOOLS-2806] - Migrate mongo-tools-common unit tests to mongo-tools
  • [TOOLS-2807] - Migrate mongo-tools-common integration tests to mongo-tools
  • [TOOLS-2808] - Migrate mongo-tools-common IAM auth tests to mongo-tools

100.3.0

Released 2021-02-04

We are pleased to announce version 100.3.0 of the MongoDB Database Tools.

This release includes support for PKCS8-encrypted client private keys, support for providing secrets in a config file instead of on the command line, and a few small bug fixes.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2795] - Tools failing to build on SUSE15-sp2
  • [TOOLS-2800] - RPM creation failing on amazon linux 1

Release

Investigation

  • [TOOLS-2771] - SSL connection problems mongodump

Bug

  • [TOOLS-2751] - Deferred query EstimatedDocumentCount helper incorrect with filter
  • [TOOLS-2760] - rpm package should not obsolete itself
  • [TOOLS-2775] - --local does not work with multi-file get or get_regex

New Feature

  • [TOOLS-2779] - Add --config option for password values

Task

  • [TOOLS-2013] - Support PKCS8 encrypted client private keys
  • [TOOLS-2707] - Build mongo-tools and mongo-tools-common with go 1.15
  • [TOOLS-2780] - Add warning when password value appears on command line
  • [TOOLS-2798] - Add Amazon Linux 2 Arm64 to Tools

100.2.1

Released 2020-11-13

We are pleased to announce version 100.2.1 of the MongoDB Database Tools.

This release includes a mongorestore performance improvement, a fix for a bug affecting highly parallel mongorestores, and an observability improvement to mongodump and mongoexport, in addition to a number of internal build/release changes.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Release

Bug

  • [TOOLS-2744] - mongorestore not scaling due to unnecessary incremental sleep time

New Feature

  • [TOOLS-2750] - Log before getting collection counts

Task

  • [TOOLS-1856] - use a memory pool in mongorestore
  • [TOOLS-2651] - Simplify build scripts
  • [TOOLS-2687] - Add archived releases JSON feed for Database Tools
  • [TOOLS-2735] - Move server vendoring instructions to a README in the repo
  • [TOOLS-2748] - Add a String() to OpTime
  • [TOOLS-2758] - Bump Go driver to 1.4.2

100.2.0

Released 2020-10-15

We are pleased to announce version 100.2.0 of the MongoDB Database Tools.

This release deprecates the --sslAllowInvalidHostnames and --sslAllowInvalidCertificates flags in favor of a new --tlsInsecure flag. The mongofiles put and mongofiles get commands can now accept a list of file names. There is a new mongofiles get_regex command to retrieve all files matching a regex pattern. The 100.2.0 release also contains fixes for several bugs. It fixes a bug introduced in version 100.1.0 that made it impossible to connect to clusters with an SRV connection string (TOOLS-2711).

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2693] - Most tasks failing on race detector variant
  • [TOOLS-2737] - Fix TLS tests on Mac and Windows
  • [TOOLS-2747] - Git tag release process does not work

Release

Bug

  • [TOOLS-2587] - sslAllowInvalidHostnames bypass ssl/tls server certification validation entirely
  • [TOOLS-2688] - mongodump does not handle EOF when passing in the password as STDIN
  • [TOOLS-2706] - tar: implausibly old time stamp error on Amazon Linux/RHEL
  • [TOOLS-2708] - Atlas recommended connection string for mongostat doesn't work
  • [TOOLS-2710] - Non-zero index key values are not preserved in ConvertLegacyIndexes
  • [TOOLS-2711] - Tools fail with "a direct connection cannot be made if multiple hosts are specified" if mongodb+srv URI or a legacy uri containing multiple mongos is specified
  • [TOOLS-2716] - mongodb-database-tools package should break older versions of mongodb-*-tools

New Feature

  • [TOOLS-2667] - Support list of files for put and get subcommands in mongofiles
  • [TOOLS-2668] - Create regex interface for getting files from remote FS in mongofiles

Task

  • [TOOLS-2674] - Clarify contribution guidelines
  • [TOOLS-2700] - Use git tags for triggering release versions
  • [TOOLS-2701] - Log target linux repo in push task

100.1.1

Released 2020-07-31

We are pleased to announce version 100.1.1 of the MongoDB Database Tools.

This release fixes contains a fix for a linux packaging bug and a mongorestore bug related to the convertLegacyIndexes flag.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Release

Bug

  • [TOOLS-2645] - Check for duplicate index keys after converting legacy index definitions
  • [TOOLS-2683] - Ubuntu 16.04 DB Tools 100.1.0 DEB depends on libcom-err2, should be libcomerr2

100.1.0

Released 2020-07-24

We are pleased to announce version 100.1.0 of the MongoDB Database Tools.

This release officially adds support for MongoDB 4.4. In addition to various bug fixes, it adds support for MongoDB 4.4's new MONGODB-AWS authentication mechanism.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

  • [TOOLS-2604] - integration-4.4-cluster is failing on master
  • [TOOLS-2638] - Test-case failure for mongorestore
  • [TOOLS-2643] - New linux distros missing from repo-config.yaml

Release

Bug

  • [TOOLS-2287] - URI parser incorrectly prints unsupported parameter warnings
  • [TOOLS-2337] - nsInclude does not work with percent encoded namespaces
  • [TOOLS-2366] - ^C isn't handled by mongodump
  • [TOOLS-2494] - mongorestore thorw error "panic: close of closed channel"
  • [TOOLS-2531] - mongorestore hung if restoring views with --preserveUUID --drop options
  • [TOOLS-2596] - DBTools --help links to old Manual doc pages
  • [TOOLS-2597] - swallows errors from URI parsing
  • [TOOLS-2609] - Detached signatures incorrectly appearing in download JSON
  • [TOOLS-2622] - Tools do not build following README instructions
  • [TOOLS-2669] - macOS zip archive structure incorrect
  • [TOOLS-2670] - Troubleshoot IAM auth options errors

New Feature

Task

  • [TOOLS-2363] - Update warning message for "mongorestore"
  • [TOOLS-2476] - Notarize builds for macOS catalina
  • [TOOLS-2505] - Add missing 4.4 Platforms
  • [TOOLS-2534] - Ignore startIndexBuild and abortIndexBuild oplog entries in oplog replay
  • [TOOLS-2535] - commitIndexBuild and createIndexes oplog entries should build indexes with the createIndexes command during oplog replay
  • [TOOLS-2554] - Remove ReplSetTest file dependencies from repo
  • [TOOLS-2569] - Update tools to go driver 1.4.0
  • [TOOLS-2618] - Refactor AWS IAM auth testing code
  • [TOOLS-2628] - Add 3.4 tests to evg
  • [TOOLS-2644] - Update barque authentication
  • [TOOLS-2650] - Create changelog for tools releases

100.0.2

Released 2020-06-04

We are pleased to announce version 100.0.2 of the MongoDB Database Tools.

This release contains several bugfixes. It also adds support for dumping and restoring collections with long names since the 120 byte name limit will be raised to 255 bytes in MongoDB version 4.4.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Bug

  • [TOOLS-1785] - Typo in mongodump help
  • [TOOLS-2495] - Oplog replay can't handle entries > 16 MB
  • [TOOLS-2498] - Nil pointer error mongodump
  • [TOOLS-2559] - Error on uninstalling database-tools 99.0.1-1 RPM
  • [TOOLS-2575] - mongorestore panic during convertLegacyIndexes from 4.4 mongodump
  • [TOOLS-2593] - Fix special handling of $admin filenames

Task

100.0.1

Released 2020-04-28

We are pleased to announce version 100.0.1 of the MongoDB Database Tools.

This release was a test of our new release infrastructure and contains no changes from 100.0.0.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Task

  • [TOOLS-2493] - Cut tools 100.0.0 and 100.0.1 GA releases

100.0.0

Released 2020-04-28

We are pleased to announce version 100.0.0 of the MongoDB Database Tools.

This is the first separate release of the Database Tools from the Server. We decided to move to a separate release so we can ship new features and bugfixes more frequently. The new separate release version starts from 100.0.0 to make it clear the versioning is separate from the Server. You can read more about this on the MongoDB blog.

This release contains bugfixes, some new command-line options, and quality of life improvements. A full list can be found below, but here are some highlights:

  • There are no longer restrictions on using --uri with other connection options such as --port and --password as long as the URI and the explicit option don't provide conflicting information. Connection strings can now be specified as a positional argument without the --uri option.
  • The new --useArrayIndexFields flag for mongoimport interprets natural numbers in fields as array indexes when importing csv or tsv files.
  • The new --convertLegacyIndexes flag for mongorestore removes any invalid index options specified in the corresponding mongodump output, and rewrites any legacy index key values to use valid values.
  • A new delete mode for mongoimport. With --mode delete, mongoimport deletes existing documents in the database that match a document in the import file.

The Database Tools are available on the MongoDB Download Center. Installation instructions and documentation can be found on docs.mongodb.com/database-tools. Questions and inquiries can be asked on the MongoDB Developer Community Forum. Please make sure to tag forum posts with database-tools. Bugs and feature requests can be reported in the Database Tools Jira where a list of current issues can be found.

Build Failure

Bug

  • [TOOLS-1493] - Tools crash running help when terminal width is low
  • [TOOLS-1786] - mongodump does not create metadata.json file for views dumped as collections
  • [TOOLS-1826] - mongorestore panic in archive mode when replay oplog failed
  • [TOOLS-1909] - mongoimport does not report that it supports the decimal type
  • [TOOLS-2275] - autoIndexId:false is not supported in 4.0
  • [TOOLS-2334] - Skip system collections during oplog replay
  • [TOOLS-2336] - Wrong deprecation error message printed when restoring from stdin
  • [TOOLS-2346] - mongodump --archive to stdout corrupts archive when prompting for password
  • [TOOLS-2379] - mongodump/mongorestore error if source database has an invalid index option
  • [TOOLS-2380] - mongodump fails against hidden node with authentication enabled
  • [TOOLS-2381] - Restore no socket timeout behavior
  • [TOOLS-2395] - Incorrect message for oplog overflow
  • [TOOLS-2403] - mongorestore hang while replaying last oplog failed in archive mode
  • [TOOLS-2422] - admin.tempusers is not dropped by mongorestore
  • [TOOLS-2423] - mongorestore does not drop admin.tempusers if it exists in the dump
  • [TOOLS-2455] - mongorestore hangs on invalid archive
  • [TOOLS-2462] - Password prompt does not work on windows
  • [TOOLS-2497] - mongorestore may incorrectly validate index name length before calling createIndexes
  • [TOOLS-2513] - Creating client options results in connection string validation error
  • [TOOLS-2520] - Fix options parsing for SSL options
  • [TOOLS-2547] - Installing database tools fails on rhel 7.0
  • [TOOLS-2548] - Installing database tools fails on SLES 15

New Feature

  • [TOOLS-1954] - Support roundtrip of mongoexport array notation in mongoimport
  • [TOOLS-2268] - Add remove mode to mongoimport
  • [TOOLS-2412] - Strip unsupported legacy index options
  • [TOOLS-2430] - mongorestore: in dotted index keys, replace "hashed" with "1"
  • [TOOLS-2459] - Allow --uri to be used with other connection string options
  • [TOOLS-2460] - A connection string can be set as a positional argument
  • [TOOLS-2521] - Add support for the tlsDisableOCSPEndpointCheck URI option
  • [TOOLS-2529] - Mongodump outputs new file format for long collection names

Task

  • [TOOLS-2418] - Remove mongoreplay from mongo-tools
  • [TOOLS-2421] - Maintain test coverage after moving tools tests from server
  • [TOOLS-2438] - Create MSI installer in dist task
  • [TOOLS-2439] - Tools formula included in homebrew tap
  • [TOOLS-2440] - Sign MSI installer
  • [TOOLS-2441] - Update release process documentation
  • [TOOLS-2442] - Automate release uploads
  • [TOOLS-2443] - Generate tarball archive in dist task
  • [TOOLS-2444] - Generate deb packages in dist task
  • [TOOLS-2449] - Create sign task
  • [TOOLS-2464] - Update platform support
  • [TOOLS-2470] - Sign linux packages
  • [TOOLS-2471] - Automate JSON download feed generation
  • [TOOLS-2472] - Automate linux package publishing
  • [TOOLS-2473] - Consolidate community and enterprise buildvariants
  • [TOOLS-2475] - Manually verify tools release
  • [TOOLS-2480] - Generate rpm packages in dist task
  • [TOOLS-2488] - Update package naming and versioning
  • [TOOLS-2493] - Cut tools 100.0.0 and 100.0.1 GA releases
  • [TOOLS-2506] - Update maintainer in linux packages
  • [TOOLS-2523] - Remove Ubuntu 12.04 and Debian 7.1 variants
  • [TOOLS-2536] - ignoreUnknownIndexOptions option in the createIndexes command for servers >4.1.9
  • [TOOLS-2538] - Move convertLegacyIndexKeys() from mongorestore to mongo-tools-common
  • [TOOLS-2539] - Publish linux packages to curator with correct names
  • [TOOLS-2549] - Push GA releases to server testing repo
  • [TOOLS-2550] - Push GA releases to the 4.4 repo
  • [TOOLS-2551] - Split release uploading into per-distro tasks