Release Notes for Bacula Enterprise 12.6

The Director (Dir) and all Storage Daemons (SDs) must all be upgraded to version 12.6 as they they are not compatible with prior versions.

Catalog format in version 12.6 and greater:

The major release 12.6 of Bacula uses a new catalog format. We provide a set of scripts that convert 6.6.x and earlier catalog versions to the new 12.6 format (1023). Please see the white paper “Migration-to-12.6” for detailed instructions on the migration process.

The database upgrade from 1022 to 1023 is fast and simple for most users.

The Bacula Enterprise RPM spec files have been modified to detect the database change and to do the upgrade for you (from 8.10, 10.0, 10.2). We strongly recommend that you save a copy of your existing database before upgrading using RPMs. If you want to have more control over the catalog upgrade step when upgrading using RPMs, you may want to contact the Bacula Systems support team to get the update_bacula_tables script from the updatedb package and run it before the RPM installation step or you can stop the database server before the upgrade.

If you upgrade the BWeb Management Suite from 8.x and you use a MySQL catalog, you must first update the BWeb SQL tables with the script upgrade-8.8_10.2_mysql.sql.

If you are starting from scratch, you will not need to run the update_bacula_tables script since the create_bacula_tables script automatically creates the tables in the new format.

Misc notes:

The major release 12.2 of BCloud Service uses a new catalog format. We provide a SQL script that converts 12.0.x and earlier catalog versions (2) to the new 12.2 format (3). More information can be found in the Migration-to-12.2 whitepaper or in the BCloud Service user’s guide.

Restricted Console users must modify their existing Console resources to specify DirectoryACL=*all* and UserIdACL=*all* in order to continue to use the restore command. If these two directives are not set, the restore command will return an error.

Redhat 5, SLES 10, SLES 11, SLES 11.1, SLES 11.2 are no longer supported in version 12.0. Old filedaemons versions are still compatible and can be used to protect these systems.

Known Issues and Workarounds:

  • #1723 The hardlinks=yes FileSet option is not compatible with VirtualFull jobs.

    This incompatibility might lead to problems performing a restore. The error message displayed during a restore job is:

    Error: create_file.c:327 Could not hard link /path: ERR=No such file or directory

    To restore the file correctly, it is required to select the first occurrence of the hardlink file in the backup manually. The procedure to distinguish hardlinks in the catalog is available from the Bacula Systems Customer Success Team.

  • #4957 VirtualFull, Copy/Migration jobs based on Incomplete jobs potential issue.

    Under some circumstances a Copy/Migration/VirtualFull job may not be able to copy the data from a Job that was interrupted and restarted using the Incomplete Job feature. In version 10.2.3 and above, the Copy/Migration/VirtualFull job is aborted with the following error message:

    Fatal error: catreq.c:691 SHA1 digest not same FileIndex=344 as attributes FI=343 or Fatal error: catreq.c:691 MD5 digest not same FileIndex=344 as attributes FI=343

    It is recommended to re-execute the Job that was interupted then restarted to be able to copy/migrate the data. We do NOT recommend including an Incomplete Job into a Progressive Virtual Full chain of jobs.

    The automatic rescheduling of Incomplete jobs can be disabled to avoid restarted Incomplete jobs finishing successfully and being selected to be copied/migrated/consolidated in Virtual Full using the “RescheduleIncompleteJobs=no” Job directive.

    Please contact the Bacula Systems Customer Success Team for more information.

Release 12.6.5 25 Jun 2021

12.6.5 is a minor bug fix release.

  • Fix db_get_accurate_jobids() with concurrent queries on the same jobs

  • Fix org#2622 About incorrect behaviour of the MaxDiffInterval directive

  • Fix #7776 About FD error not correctly reported in the job log

  • cloud: Fix #7801 stderr strout format forced to text for background compatibility

  • mssql: Fix #7777 About ‘Create database Plugin Object record’ error

  • mssql: Fix #7891 Accept “complex” passwords for the connection string

  • bweb: Fix displaying page after saving resource if backurl function is used

  • bweb: Fix #7827 backurl function not working in some places

  • rhv: Added a generic mechanism to allow to set up all the internal timeouts and sleep times

  • rhv: Increased internal timeout to receive Bacula streams from 2min to 60min. Corrected timeout exception message

  • rhv: Added missing backup/restore parameters. Fixed some parameters which were miss-written. Fixed an Incremental restore problem

  • Fix memory problem in bpipe plugin

Bugs fixed/closed since last release: 7762 7801 7777 7891 2622 7776 7827 7762 7596

Release 12.6.4 12 May 2021

12.6.4 is a minor bug fix release. There are however a few new features.

  • Add bconsole .jlist command to get JSON output from regular list commands

  • Add new options to list events command

  • vsphere: Add force_hotadd plugin command option

  • bweb: Add -F option to split_bacula_conf.pl tool

  • hdfs: Fix #7587 Add support for kerberos authentication

  • mssql: Add function to list instances in queryParameter()

  • Fix stop/incomplete feature

  • Fix #7530 About allpools keyword ignored in cloud truncate command

  • Fix #7548 About wrong backup client displayed to the user

  • Fix org#2605 About incorrect message in restore command

  • bweb: Add -F option to split_bacula_conf.pl tool

  • bweb: Add OpenShift configuration page

  • exchange: Add support for symlinks on Windows2012

  • hdfs: Fix #7609 about setting up service principal programmatically during kerberos authentication

  • openshift: Fix #7550 About issue with the backend

  • k8s: Fix #7575 About bacula-backup pod stuck in ContainerCreating due to ‘Volume is already used by pod(s)’

  • k8s: Fix ‘NoneType’ object is not iterable. Fixes #0007574.

  • oracle: Adapt oracle/sap/sybase installer scripts with new resource names

  • postgresql: Fix #7517 About postgresql-fd failed to open ‘first_wal’ file

Bugs fixed/closed since last release: 2605 7517 7530 7548 7550 7574 7575 7587 7609

Release 12.6.3 18 March 2021

12.6.3 is a minor bug fix release.

  • Fix FD crash when the SD disk is full introduced with SDPacketCheck feature

  • Add support for store_alist_str() in plugin configuration items

  • vsphere: Fix segfault with dedup optimizer enabled

  • bweb: Update bsys report to version 3.41

  • dedup: Fix #7456 Cannot allocate more chunk, container exists but is not recognized

  • docs: Fix verify fileset keyword documentation

Bugs fixed/closed since last release: 7456

Release 12.6.2 11 March 2021

12.6.2 is a minor bug fix release. There are however a few new features.

  • Add SDPacketCheck in the FileDaemon resource to control network flow

  • Fix #6132 Add support for PostgreSQL 12 and above

  • Handle lin_tape end of device with the new ‘Use Lintape=yes’ Device directive

  • Fix #7286 DIR segfault when doing a “dir” command in a restore

  • Fix #7321 About issue when stopping jobs waiting for resources

  • Fix #7449 About incorrect JSON output with TlsAllowedCn directive

  • Fix #7451 About deleted files incorrectly kept in Virtual Full

  • Fix Verify job issue with offset stream and compressed blocks

  • Fix #7396 Grant command error in granting privileges script for MySQL

  • Fix org#2573 About Syntax error in granting privileges script with MySQL if –with-db-password parameter is used

  • Fix possible memory corruption in the label process

  • Fix reload issue when a Job doesn’t have a Pool defined

  • Possible fix for SD high memory usage problem

  • bweb: Add an option to display the newly generated bacula-fd.conf at the end of the New Client Wizard

  • bweb: Fix #7347 minor text modification in new client wizard

  • bweb: Fix #7348 installing file daemon on Windows hosts

  • bweb: Fix #7362 header boxes order in virtual machine dashboard

  • bweb: Fix #7388 wrong error message in checking push windows component configuration for remote hosts

  • bweb: Fix #7414 too long table pagination pager if in table is many rows

  • bweb: Fix #7434 PowerShell commands error while deploying Windows FD

  • bweb: Hide option to deploy Windows SD (it hasn’t been sufficiently tested)

  • bweb: Request #7322 add fileset column to running jobs box

  • kvm: Fix #7324 Add support for OpenNebula

  • proxmox: Fix Plugin Object shows zero bytes for a Proxmox VM object.

  • proxmox: Fix regression on plugin object in estimate.

  • sir: Force single thread interface with fuse systems

  • sir: Try to fix vmwarebackend options

  • sir: merged install and install_ir commands and put NFS detection warning in more evidence

  • vsphere: Add support for HotAdd transport method

  • vsphere: added code to retry NFS Datastore creation for a couple of times

  • vsphere: fix #7297 about vsphere plugin not handling InvalidDeviceSpec faults correctly

  • vsphere: fix #7386 about comparing SSL thumbprint during backups and restores

  • vsphere: fix #7389 about plugin not handling SATA disk controllers

  • mssql: Fix #7416 Wrong replica should be reported as an error when the db is explicitly selected

  • win32: Update to OpenSSL 1.1.1j

  • win32: Fix #7373 binaries are tagged with correct ressource

  • docs: Add section about ‘Enabled’ directive for Storage’s Device

  • dedup2: avoid duplicate in the same extents

Bugs fixed/closed since last release: 2573 6132 7286 7292 7297 7315 7318 7321 7322 7324 7340 7341 7342 7347 7348 7362 7386 7388 7389 7396 7414 7434 7449 7451 7416 7373

Release 12.6.1 03 February 2021

12.6.1 is a minor bug fix release. There are however a few new features.

  • Add .bvfs_ls_all_files command

  • Fix #7262 About adding MaximumJobErrorCount FileDaemon directive

  • Fix #6637 About pool overriding for copy jobs

  • Fix #7137 About checking for Storage being used for job restart/resume

  • Fix #7164 About Director reload issue with missing Job’s directive

  • Fix #7165 About incorrect JSON output for SHA256/SHA512 option

  • Fix #7168 About incorrect start time displayed for canceled jobs not yet running

  • Fix #7207 About ‘dbcheck -n’ not working properly

  • Fix #7214 Adapt mtx-changer.conf for GNU cpio mt version

  • Fix #7222 About ‘yes’ parameter for ‘label barcodes’ command

  • Fix #7247 About incorrect variable substitution with the query command

  • Fix #7261 About the director segfaulting due to too small msg buffer

  • Fix MySQL update procedure with incorrect handling of the FileIndex type

  • Fix org#2579 About incorrect JSON generated from empty Messages resource

  • Fix org#2588 About incorrect Object/ObjectId type in update_postgresql_tables

  • Fix update_sqlite3_tables to upgrade from 9.6 to 11.0

  • alist: Fix for memory overflow access

  • Initialize StartTime in db_create_job_record()

  • Introduce more filters for ‘delete object’ command

  • Take PluginObjects into account when copying a job

  • bsmtp: Add the possibility to add emails separated with a comma as recipient list

  • bweb: Add Instant Recovery restore method to restore VMware wizard

  • bweb: Add new KVM timeout option to kvm.json

  • bweb: Add to VM dashboard support for object versions

  • bweb: Add unix_user to KVM Fileset page

  • bweb: Fix #7087 add error message to deploy scripts if config tar archive is not available

  • bweb: Fix #7138 displaying error message if client bandwidth limit set to unlimited

  • bweb: Fix #7150 add refreshing to running job box

  • bweb: Fix #7163 About issue with –commit_and_reload option on scan_proxmox_cluster program

  • bweb: Fix #7182 Allow specifying the Level in the scan_proxmox_cluster command line

  • bweb: Fix #7197 default Kubernetes plugin directive values and add missing directives

  • bweb: Fix #7205 incorrect regular expression to validate docker_host directive

  • bweb: Fix #7255 about sending HTTP headers on statistics boxes loading

  • bweb: Fix #7258 remove misleading text in help box on console settings page

  • bweb: Fix #7306 support in scan_datacenter.pl program for VMware resources with spaces

  • bweb: Fix Hyper-V plugin icon on VM dashboard page

  • bweb: Fix setting boolean values in plugin settings if default value is checked

  • bweb: Implement new Fileset browser in new Fileset wizard

  • bweb: Fix #7212 hide ‘edit’ options in admin sections if “Disable Bacula Configuration Menu” option is set

  • dedup2: Fix #7209 Tokyo hash table size at initialization

  • dedup2: Fix #7225 debug message segfault during the vacuum

  • dedup2: Fix #7273 unknown dedup command freezes bconsole

  • docs: Add info about possible filters for ‘delete object’ command

  • docs: Add info about setting ‘0’ as ‘MaximumJobErrorCount’

  • docs: Add note about File daemon’s new ‘MaximumJobErrorCount’ directive

  • docs: Fix #7159 About incorrect bold text in New Features section

  • k8s: Add Bacula Pod annotations support functions

  • k8s: Add PVC Clone configuration

  • k8s: Add PVC Data backup with CSI Snapshot support

  • k8s: Add Pod remote execution support functions

  • k8s: Add capacity to PVC data list

  • k8s: Add code comments

  • k8s: Add pod annotations for Estimation Job

  • k8s: Add run.after.snapshot annotation

  • k8s: Add util.boolparam class

  • k8s: Correct Bacula Pod label to baculabackup

  • k8s: Ensure proper handling of bacula.volumes annotation

  • k8s: Fix #6213 issue with Python dependency problem

  • k8s: Fix PVC Data restore regression

  • k8s: Fix compilation issue with Python

  • k8s: Fix #7178 for empty annotations

  • k8s: Fix invalid PVC Data tar name when shapshot

  • k8s: Refactor send_file_info in default io

  • k8s: Sync with upstream to fix compilation issue

  • k8s: Update PVCData support functions

  • k8s: Update Bacula Pod annotations for containers

  • k8s: Update descriptions and debugging messages

  • k8s: Update estimate job to show PVC Data size

  • k8s: Update joblog messages and sort imports

  • k8s: Add resource filtering with labels

  • k8s: Avoid protocol errors with backend warnings

  • k8s: Bump and synchronize plugin versions

  • k8s: Correct requirements.txt file

  • k8s: Disable unwanted urllib ssl warnings

  • k8s: Fix #7285 parameter verification

  • kvm: Add unix_user plugin command line option

  • kvm: Fix #7062 add timeout plugin command line option

  • mssql: Fix #7169 about incorrect output from the queryParameter() interface

  • ndmp: Add debug to EMCtar scanner

  • ndmp: Fix #7160 about SMTAPE Full backup snapshots not being deleted

  • ndmp: Try to locate next EMCTar header if lost

  • netapp-hfc: Fix #7170 try to fix symlinks error message

  • sap-hana: Add missing #NOTFOUND

  • sap-hana: Add support for maxsize pipe/file argument

  • sap-hana: Allow empty lines in inquire mode

  • sap-hana: Fix install-sap.sh client detection

  • sap-hana: Implement protocol 1.5

  • sap-hana: Increase fifo timeout to 90s

  • sap-hana: Return proper error after buffer overflow in sbt_send_bconsole_cmd()

  • postgresql: Fix #6788 add support for non-exclusive backup

  • proxmox: Add default description to resources

  • proxmox: Fix #7190 about scan_proxmox_cluster program issue with VMs that are renamed

  • proxmox: Fix #7194 remove Fileset with –remove_jobs option in scan_proxmox_cluster program

  • rest: rest-api: Fix creating SQL tables

  • rpms: Fix #7141 rpm install try a “useradd root” instead of “useradd bacula”

  • rpms: Add OpenShift spec file

  • sir: Fix #7146 about Instant Recovery not handling vsphere-ctl list_vsphere_servers query errors

  • sir: Avoid JSON issue with debug messages generated by bacula-fused

  • sir: Fix #7153 about mount-vm leaving leftover entries on NFS exports file

  • sir: Fix #7173 About orphan buffer printed by bacula-fused

  • sir: Fix #7173 “Orphaned buffer” message on exit

  • sir: Add repair and status actions support to Exchange Single Item Restore

  • sir: Fix restore issue with Exchange 2019

  • sir: Implement automatic repair of Exchange DB

  • sir: Update upload procedure for exchange browser

  • sir: Added JSON mode to Instant Recovery feature

  • sir: Fix #7155 added support for multiple, concurrent Instant Recovery sessions

  • sir: Changed JSON mode to accept disks=All parameter even if the VM has only one disk

  • sir: Fix #7143 about Instant Recovery leaving leftover processes

  • sir: Fix #7154 about better explanatory text of valid server options and detection of standalone hosts

  • sir: Added NFS server service detection after its installation

  • sir: Fixed issue where repeated datastores were shown during migration process

  • sir: Fixed error handling of some bvmware queries

  • sir: Fixed handling of standalone ESXi hosts. Now the script detects the ESXi IP addresses and migration is disabled in this scenario

  • sir: Fixed issue where mount-vm was not removing vmwarebackend.trace

  • vsphere: Added command purge_ds to purge datastores

  • vsphere: Fix #7154 about better explanatory text of valid server options and detection of standalone hosts

  • vsphere: Fix #7154 about textual enhancements during vsphere server selection

  • vsphere: Fix #7174 about unclear error message when a PlatformConfigFault exception happens

  • vsphere: Fix #7175 about VM migrate operation not returning the right error code when an error occurs

  • vsphere: Fix about incorrect handling of orphan VMs

  • win32: Avoid unnecessary xml creation in VSS Plugin

  • win32: Fix #7111 better file path handling to avoid warnings at restore with VSS Plugin

  • win32: Update OpenSSL for Windows to 1.1.1i

  • win32: Fix #7256 update Windows version detection with latest versions (Windows 10)

  • vss: Fix #7272 update VSS plugin version to 1.1

Bugs fixed/closed since last release:

2579 2588 6213 6637 6788 7062 7087 7111 7137 7138 7141 7143 7146 7150 7153 7154 7155 7159 7160 7163 7164 7165 7168 7169 7170 7173 7174 7175 7178 7182 7190 7194 7197 7205 7207 7209 7212 7214 7222 7225 7247 7255 7256 7258 7261 7262 7272 7273 7285 7306

Release 12.6.0 04 December 2020

12.6.0 is a major release.

New Features:

  • Windows CSV (Cluster Shared Volumes) support

  • Support for SHA256 and SHA512 signatures in FileSet

  • Plugin Object support

Plugin:

  • VMware Instant Recovery

  • VSS HyperV Cluster support

  • External LDAP Console Authentication

  • MariaDB 10 Support in the MySQL Plugin’s Binary Backup Mode

  • Global Endpoint Deduplication support for vSphere plugin

BWeb Features:

  • New FileSet editing dialog box

  • Tag support for Jobs, Clients and Volumes

  • Remote installation and configuration for Windows clients

  • Virtual Machine Dashboard

Misc Features:

  • Bacula Enterprise Installation Manager for Windows

  • Windows Binaries are now signed

  • Windows Installer Silent Mode options

  • Support of the RestoreObject in bscan

  • LinuxBMR support for Grub v1.x

More information and examples may be found in the “New Features” section of the main manual.