This is the changelog for Berkeley DB Release 18.1 (library version 18.1.32).
Fixed a few null pointer crashes in the Tcl API when a function returned a null value. [#26331]
Automatically copy any databases in sub-directories when using the utility db_hotbackup or the ENV->backup() function by including the -C command line argument or the flag DB_BACKUP_DEEP_COPY, respectively [#26736].
Fixed a "malformed disk error" caused by not properly refreshing the thread info. [#26945]
If a database rename or remove operation fails due to replication lockout, DB_REP_LOCKOUT will now be returned instead of EINVAL. [#27010]
Fixed an "invalid page format" error when performing a key_range search on an empty database. [#27011]
Fixed a bug in the JNI API involving the function Environment.lockVector(). [#27068]
Added the option -S to the db_convert and db_tuner utilities, which causes db_verify to verify the database before running the utility. [#27080]
Improved stability with several changes that prevent crashes when running db_verify against corrupt files. [#27088]
Improved the reliability of DB_ENV->open(DB_REGISTER) when the Berkeley DB application is the principal process of a Docker container which is stopped and restarted. [#27100]
Fixed build failure in repmgr ssl support for openssl version 1.1.0. [#27152]
Added support for Java 10. [#27154]
Added the db_sqlthreadtest project to Windows. [#27170]
Fixed a possible crash when running db_verify on a corrupted DB_QUEUE database. [#27179]
Improved the performance of the purging process performed when the number of free mutexes is low. [#27219]
Fixed an error in the repmgr035.tcl test. [#27392]
The Berkeley DB client-server architecture has been updated to use Thrift 0.11.0. [#27407]
The log file format did not change in library version 18.1
The database file formats did not change in library version 18.1.
Multiversion concurrency control and snapshot isolation are now supported on replication clients. [#21968]
Several new types of objects have been added to the DB_ENV->set_memory_init() method to enable an application to account for any additional environment region memory needed for replication. [#24153]
There are several new pieces of information available to replicated applications. The DB_EVENT_REP_AUTOTAKEOVER event indicates which subordinate process has taken over as the new replication process. The st_group_stable_log_file Replication Manager statistic indicates the earliest log file that is still needed by any site in the replication group. The DB_REPMGR_SITE structure now contains a max_ack_lsn field that indicates to a master site the most recently acknowledged LSN on each replica. The DB_REPMGR_SITE structure now also sets a new flag value DB_REPMGR_ISELECTABLE. [#25073]
Added a utility program "db_convert" to convert between big-endian (e.g. SPARC) and little-endian (e.g., X86) machines. This supports multi-platform applications which standardize on one endianness, even when both big-endian and little-endian machines are used. Since db_upgrade requires the database to be in the local machine's endianness, such applications can use db_convert to translate the byte order of the database into the local format. Then, the application can run db_upgrade. [#25086]
Increased the number of instances in which failchk can successfully clean the environment without requiring full recovery after a thread crashes while using Berkeley DB. [#25087]
Added DPL APIs to Berkeley DB Java client driver. [#25089]
Added support for the C11/C++11 standards. [#25416]
Added a graphical user interface "db_gui" to Berkeley DB that allows easy browsing of database data and execution of some administrative tasks such as running recovery. [#25496]
The replication manager has been changed to use poll() and epoll() in preference to select() to manage connections. This scales better for applications with a very large number of databases, network connections, or files. [#25795]
Starting with this release, Berkeley DB products are licensed in two ways depending on the source of the package. Packages downloaded from the Oracle Technology Network (OTN) are licensed under the GNU AFFERO GENERAL PUBLIC LICENSE (AGPL), version 3. Packages downloaded from the Oracle Software Data Cloud (OSDC) are licensed under the Oracle Master Agreement. Example code included in the packages is in all cases licensed under the Universal Permissive License. [#25916]
Added the -S command line option to db_stat, db_dump, and db_upgrade, which verifies the correctness of the database before executing the utilities. [#26207]
The version numbering scheme for Berkeley DB changed from a five-part number to a three-part number of the form <year>.<release>.<build>. This release is numbered 18.1.x, indicating that it is the first release of the year 2018. 18.1.x is the successor to the 6.2.x (also known as 12.2.6.2.x) releases. The third and fourth parameters of db_full_version() are no longer meaningful and are now deprecated; if present, they are are set to zero. [#26743]
Improved the compatibility of DB_FAILCHK with DB_REGISTER. [#25204]
Improve environment 'panic' detection so that it is much less likely for processes to incorrectly use outdated environment handles after the environment has been recovered. [#25204]
Add the error code DB_SYSTEM_MEM_MISSING which is used when a System-V style shared memory segment is not found during DB_ENV->open(). [#25204]
Fixed a bug where setting the absolute path of a file on Windows could result in the file being created on the wrong disk. [#25284]
Syncing a database with external files will now also sync the meta database associated with the external files. [#25284]
Include a new field in the per-thread statistics output: the number of locked mutexes. [#25690]
Improved parallelism of DB->open() calls to open a DB_BTREE when the database name is NULL; that is, when opening a file that does not contain sub-databases. [#25624]
Fixed a bug on btree databases using unusually large keys that can occur when compaction is performed. [#25847]
Fixed a hang which could occur when Berkeley DB errors are returned to the SQLite layer. [#23081]
SQLite user authentication extension now always requires encryption. To build with the authentication extension encryption must be enabled. Otherwise, it results in a compiler error. To convert a database to require authentication, the database must be encrypted. sqlite3_user_authenticate() now always returns SQLITE_AUTH if called on a database that does not require authentication. [#24598]
Added PRAGMA bdbsql_upgrade, which upgrades the connected database. If the database is encrypted, the encryption key must be set before calling this pragma. If the database uses keystore authentication and the encryption key is not unknown, a user must log in before calling this pragma. [#24598]
Added PRAGMA statistics, which prints out statistics about the database and its environment. [#25550]
Added PRAGMA statistics_files, which redirects output from the statistics PRAGMA to a file. [#25550]
Internal Berkeley DB messages are now redirected to the same file where internal Berkeley DB error messages are redirected. [#25568]
Updated SQL API build to be compatible with SQLite 3.18.2. [#25986]
Fixed a race condition if multiple threads simultaneously attempt to create a previously non-existing on-disk environment. [#26708]
Added support for Java 9. [#26847]
Fixed a compile warning in BytecodeEnhancer.java. [#26824]
Fixed a possible crash when using the Slices feature through the Java API. [#24988]
Added Database.convert() which converts database file byte order. [#25086]
Fixed a bug that could have caused duplicate records to be returned via the iterator() method of the DPL and Collections API. The iterator reads records in batches, and if a record at the end of the last batch was deleted by another thread, fetching the next batch could have read (and later returned via the iterator) duplicate records, depending on thread timing. [#25976]
Fixed a bug preventing some changes to external files performed through the DB_STREAM API from replicating to the clients. [#25432]
Fixed a bug that could cause a client undergoing internal initialization to fail to request all the necessary logs for a correct recovery. The major symptom of this bug was that some client database files were left with empty pages that would later cause log sequence errors or other failures. [#25624]
Fixed a bug where clients in the replication group might panic during synchronization with the master. [#25800]
Fixed a bug where client specific log records resulted in incorrect calculation of subsequent log offset. This would later result in a DB panic on master. [#26090]
Eliminated a spurious crash in CDB environments that use both --enable-diagnostic and DB_ENV->set_thread_count(). [#26149]
When the number of free mutexes is low, removed databases and closed unnamed in-memory databases are purged from the memory pool to free mutexes. [#24974]
Fixed a bug where an application might hang because it could not obtain a TAS lock when running Linux on Sparc architecture. [#24805]
Fixed a bug where mutexes could not be acquired on arm64-v8a Android systems. [#25752]
Fixed the panic "No space available in latch table" which could occur on systems where conventional (non-hybrid) Pthreads-based mutexes are used. [#26903].
Added a new error message when opening an environment which is still being recovered: Recovery is still running on the newly created (<start>) environment The <start> field contains the ctime(3) date when recovery started. [#25204]
Improve the robustness of applications that ignore certain error return codes from DB_ENV->txn_begin() and incorrectly use the transaction handle. Before this fix, DB_ENV->txn_begin() did not always set the returned transaction pointer to NULL when returning a DB_REP_LOCKOUT, EINVAL, or DB_RUNRECOVERY error. Now this pointer is set to NULL in all cases, making it more apparent if the application later ignores the DB_ENV->txn_begin() failure. [#25607]
Removed the db_sql_codegen utility. [#25030]
Fixed a possible segfault in db_verify when used with external files. [#25920]
Fixed several out-of-bounds memory reads and divide-by-zero bugs in the utility programs. [#26270]
The -c option of db_hotbackup can now work with replication manager applications. The -c option cannot be used with base replication applications. [#25702]
Removed support for Windows Mobile. [#24675]
Fixed a bug where built-in atomic functions are used only when --enable-cxx is specified. [#24974]
Added cross-compile support for detecting built-in atomic functions. [#25055]
Re-organized message numbers so that identical messages now have the same message number. [#25196]
Fixed a configure bug which prevented shared library support on FreeBSD 10. [#25251]
Added support for -with-mutex=BSD/OSSpinLockTry, to avoid using the undocumented spin_lock_try function, which is not permitted on iOS. [#25342]
Fixed a bug where ADO .Net package had debug pre-processors for release configurations. [#25549]
Fixed a bug where the configure script may fail to find the JNI include directories on macOS. [#25713]
Fixed a bug where the JAVACFLAGS environment variable was not passed to the JDBC driver. [#25752]
Added the ARM platform to Visual Studio 2015 projects and solutions. [#25860]
Added Visual Studio 2015 projects and solutions. [#25860]
Removed support for Visual Studio 2008. [#25860]
Environments are now automatically recreated the first time a new version of Berkeley DB opens the environment, if the flock() system call is available. This is typical for versions of Linux. [#25884]
Added support for VxWorks 7. [#25930]
When opening a database handle which was created outside of an environment, if the current working directory contains a DB_CONFIG file it will no longer be processed. [#26319]
Removed support for QNX. [#26339]
Fixed a documentation mistake that stated that the flag DB_VERB_BACKUP should be passed to DB_ENV->backup() instead of DB_ENV->set_verbose(). [#26501]
Added support for PHP 7. [#26566]
Removed support for PHP 5 and below and the php function DB4->pget. [#26566]
Third party JDBC driver code was removed from the distribution. Instructions have been added about how to download and integrate with Berkeley DB. [#26746]
Third party ADO.NET driver code was removed from the distribution. Instructions have been added about how to download and integrate with Berkeley DB. [#26746]
Fixed a bug where SQL authentication APIs might raise assertion failures. [#24598]
Fixed undefined symbol errors for configurations including --enable-dtrace and -enable-perfmon_statistics when replication is also enabled. [#25061]
Improved db_verify's handling of corrupted database files. [#25239]
Fixed bugs where printed statistics might contain "unknown" flags. [#25461]
Fixed a bug where hot backup of queue extent files did not follow the original directory structure. [#25545]
The function flag DB_BACKUP_NO_LOGS now prevents logs from being backed up when passed to the backup function. [#25651]
Fixed a bug on Linux systems where temporary files would not be properly deleted. [#25997]
Fixed a bug where setting initial number of lockers might cause a segfault. [#26085]
The BDB SQL test suite is no longer part of the release package. [#26749]
32-bit Windows binaries will no longer be released. [#26823]
The STL interface does not work correctly on a Mac OS X platform.
The Solaris Studio 12.5 C++ compiler can fail to build Berkeley DB because of our support for built-in atomic functions. Falling back to Solaris Studio 12.4 should be a successful workaround.
Some Java tests ported from Berkeley DB JE, used to test the Direct Persistence Layer, fail when run in enhanced mode.
Asynchronous loggers cannot be used.