Release Notes for Bacula Enterprise 12.8

The Director (Dir) and all Storage Daemons (SDs) must all be upgraded to version 12.8 as they they are not compatible with prior versions.

Catalog format in version 12.8 and greater:

The major release 12.8 of Bacula uses a new catalog format. We provide a set of scripts that convert 6.6.x and earlier catalog versions to the new 12.8 format (1024). Please see the Migration to New Major Version of Bacula for detailed instructions on the migration process.

The database upgrade from 1022 to 1024 is fast and simple for most users.

The Bacula Enterprise RPM spec files have been modified to detect the database change and to do the upgrade for you (from 8.10, 10.0, 10.2). We strongly recommend that you save a copy of your existing database before upgrading using RPMs. If you want to have more control over the catalog upgrade step when upgrading using RPMs, you may want to contact the Bacula Systems support team to get the update_bacula_tables script from the updatedb package and run it before the RPM installation step or you can stop the database server before the upgrade.

If you upgrade the BWeb Management Suite from 8.x and you use a MySQL catalog, you must first update the BWeb SQL tables with the script upgrade-8.8_10.2_mysql.sql.

If you are starting from scratch, you will not need to run the update_bacula_tables script since the create_bacula_tables script automatically creates the tables in the new format.

Misc notes:

The major release 12.2 of the BCloud Service uses a new catalog format. We provide a SQL script that converts 12.0.x and earlier catalog versions (2) to the new 12.2 format (3). More information can be found in the Migration-to-12.2 whitepaper or in the BCloud Service user’s guide.

Restricted Console users must modify their existing Console resources to specify DirectoryACL=*all* and UserIdACL=*all* in order to continue to use the restore command. If these two directives are not set, the restore command will return an error.

Redhat 5, SLES 10, SLES 11, SLES 11.1, SLES 11.2 are no longer supported in version 12.0. Old filedaemons versions are still compatible and can be used to protect these systems.

Known Issues and Workarounds:

  • #1723 The hardlinks=yes FileSet option is not compatible with VirtualFull jobs.

    This incompatibility might lead to problems performing a restore. The error message displayed during a restore job is:

    Error: create_file.c:327 Could not hard link /path: ERR=No such file or directory

    To restore the file correctly, it is required to select the first occurrence of the hardlink file in the backup manually. The procedure to distinguish hardlinks in the catalog is available from the Bacula Systems support team.

  • #4957 VirtualFull, Copy/Migration jobs based on Incomplete jobs potential issue.

    Under some circumstances a Copy/Migration/VirtualFull job may not be able to copy the data from a Job that was interrupted and restarted using the Incomplete Job feature. In version 10.2.3 and above, the Copy/Migration/VirtualFull job is aborted with the following error message:

    Fatal error: catreq.c:691 SHA1 digest not same FileIndex=344 as attributes FI=343

    or

    Fatal error: catreq.c:691 MD5 digest not same FileIndex=344 as attributes FI=343

    It is recommended to re-execute the Job that was interupted then restarted to be able to copy/migrate the data. We do NOT recommend including an Incomplete Job into a Progressive Virtual Full chain of jobs.

    The automatic rescheduling of Incomplete Jobs can be disabled to avoid restarted Incomplete jobs finishing successfully and being selected to be copied/migrated/consolidated in Virtual Full using the “RescheduleIncompleteJobs=no” Job directive.

    Please contact the Bacula Systems Customer Success team for more information.

Release 12.8.4 21 January 2022

12.8.4 is a minor bug fix release.

  • Add PriorJob to llist job output

  • Add bjoblist command line tool to manage external snapshot pruning

  • Allow plugin metadata with size >64KB

  • Allow to use PriorJob in db_get_job_record() if the Job is not found

  • Change .bvfs_get_jobids() to use PriorJob

  • Check for IP SANs when verifying TLS certs

  • Clarify SD vbackup device error message

  • Remove deprecated sbrk in macOS and Windows.

  • The presence of FileSet and Pool directives in the Job. Bug #2188

  • Fix #8276 About segfault when plugins are not loaded

  • Fix #8343 About weird output characters after stopping job

  • Fix #8515 About wrong mysql arguments order

  • Fix #8576 Cancel duplicate self deadlock

  • Fix #8719 About segfault after an incorrect copy job

  • Fix incorrect error message with metadata backup

  • Fix issue with MySQL 8 in src/cats/grant_mysql_privileges

  • Fix org#2588 About incorrect Object/ObjectId type in update_postgresql_tables

  • Fix potential segfault in default bhash_info()

  • bweb: Add -F option to split_bacula_conf.pl tool

  • bweb: Add new tpls

  • bweb: Add support for Microsoft 365 plugin

  • bweb: Enhance error message when the URL is empty and we call get_thumbprint()

  • bweb: Fix #8253 Add default Label Format in the Backup Policy wizard

  • bweb: Fix #8310 disable delete registrator app button for tenant with incomplete registration state

  • bweb: Fix #8312 finish incomplete registration if registration interrupted before log in

  • bweb: Fix #8321 add capability to copy Microsoft 365 plugin registration link to clipboard

  • bweb: Fix #8325 add missing m365 objectid parameter to fileset created by wizard

  • bweb: Fix #8338 autocommit saved resources using copy resource function

  • bweb: Fix #8425 displaying zero value of volume retention directive

  • bweb: Fix #8436 not working fileset delete button

  • bweb: Fix 8394 update volume statuses allowed to set on update media page

  • bweb: Fix Messages edition with types not included in All

  • bweb: Fix adding more than one Microsoft 365 tenant

  • bweb: Fix creating plugin directory if it does not exist

  • bweb: Fix op#1070 new fileset wizard add entry buttons issue

  • bweb: Fix previous patch to store the new LabelFormat

  • bweb: Request #8314 add missing RHV plugin parameters

  • cloud: Fix #8265 Do not re-open part.1 during truncate

  • dedup: query_dde: new addr_info command and “dump –raw” option

  • dedup: Fix #8451 vacuum report RefTooSmall when not appropriate

  • ldap: Add more information when a buffer cannot be allocated

  • m365: Add JobId in each debug line. Implement Delta restart for badTokens with retries and regular backup fallback

  • m365: Added new ouptut to check command to now connection status

  • m365: Backported network resiliency improvements. Attachment fail won’t fail entire folder. Empty attachments detection. Other fixes

  • m365: Do not backup objects with metadata > 1MB, but write info in filesystem objects

  • m365: Download spool files are now independent of the name of the coming file. Partial fix for #8262

  • m365: Fix mail search in subfolders. Fix #8279

  • m365: Fix restore over different folder when source is some well-known folder

  • m365: Fix to avoid generating useless spool files with 0bytes

  • m365: Fixed bad token problem for emails #8474

  • m365: Fixed big metadata on mime big sub-attachments. Improved restore speed

  • m365: Fixed incorrect dependency to propper build in java 8

  • m365: Further pages retry-control for all remaining entities. Fix for delta file being emptied

  • m365: Further pages retry-control for email and attachments. Retry 410 code. Page size now is 200. Automatic refresh token

  • m365: Persist JVM memory upon upgrades. Fix sharepoint listitems backup issue #8438

  • m365: Prepare the plugin for greater metadata objects. Add support for on/off on boolean values. Fixed hounoring of log variable

  • m365: Put back old method to send metadata without splitting

  • m365: Single calendar entity errors will not cause backup to fail. Fix #8317

  • m365: Solved log4j cve

  • rhv: Fix duplicate disk count in backup summary. #8324

  • rpms: Fix #8347 about incorrect detection of the gssntlmssp package in BWeb

  • swift: Correct auth_url for KeystoneV3.

  • vsphere: Fix #8244 Report incorrect plugin command line as M_ERROR

Bugs fixed/closed since last release: 1070 2188 2588 8244 8253 8261 8262 8265 8267 8268 8276 8279 8298 8310 8312 8314 8317 8321 8324 8325 8329 8338 8343 8345 8346 8347 8400 8408 8417 8418 8419 8421 8422 8423 8425 8436 8438 8451 8458 8474 8515 8543 8545 8546 8547 8550 8551 8553 8567 8576 8579 8581 8584 8585 8589 8599 8637 8639 8687 8719

Release 12.8.3 23 September 2021

12.8.3 is a minor bug fix release.

  • Fix #7998 About dir crashing for client intiated backup

  • Fix #8098 About director crash for Migration job

  • Fix #8126 About incorrect ouput for the .status client command

  • Fix #8140 About wrong version mentioned in catalog update scripts

  • Fix #8142 Skip XATTR larger than MaximumNetworkBuffer

  • Fix #8159 About a deadlock when starting the Director with a missconfigured catalog

  • Fix #8167 About BAT tool crashing the dir

  • Fix org#2627 About DIR crashing for copy jobs and resource rename

  • Move the delete volume event just before the actual deletion

  • Ensure that the DIR will reject catalog update from the FD

  • bweb: Add python34 detection code for Redhat7 in install_win.py test mode

  • bweb: Add support for managing autochangers if SELinux is enabled

  • bweb: Add verified message type support

  • bweb: Fix #8100 setting datastore_allow_overprovisioning option in VMware Center

  • bweb: Fix #8102 restart components in initial wizard on deb-based distributions

  • bweb: Fix #8108 Update bsys_report script

  • bweb: Fix #8110 show Microsoft Hyper-V WMI icon

  • bweb: Fix #8120 About catalog configuration module

  • bweb: Fix config_check page about the gssntlmssp detection

  • bweb: Fix displaying MSSQL VDI plugin icon on running job status page

  • bweb: Fix nextpool directive in run job wizard

  • bweb: Request #7860 display information about debug on status storage page

  • cdp: open the inotify stream using the CLOEXEC (close on exec) flag

  • cloud: Fix #8101 Update S3 error list to match the libs3 index

  • cloud: Fix S3 error msg generation during upload

  • cloud: Fix destination name when moving part

  • cloud: S3 delete parts once it’s been renamed

  • docker: Check the presence of the docker tools duing loadPlugins()

  • hdfs: Set hdfs plugin log to working/hdfs/hdfs.log instead of just working/hdfs.log

  • m365: Fix for Sharepoint backup. Force installation of PnP.Powershell #8089

  • m365: Internal multi-stream data managed. RestoreObject fixes. Teams basic function. GUI commands and Perf command

  • postgres: Fix #8118 About the postgresql plugin crash in PITR mode

  • postgres: Fix #8131 About permision denied for creating tmp file

  • proxmox: Add support for proxmox v7

  • rhv: Added script to auto-detect Java 11. Reduced frequency of logs associated to current operations. Minor text corrections

  • rhv: Changed ovirt environment alert messages from warning to info.

  • rhv: Do not show errors in joblog when alert request are not possible for some reason

  • rhv: Fix Storage domain report

  • rhv: Improved proxy backup mode: More log, corrected filterlog, increased timeouts. Possibly solved #8001 #7762

  • rpms: Added comment about duplicated javahome_finder scripts

  • rpms: Corrected path of javahome_finder in compilation time

  • rpms: Fix #8035 About incorrect dependency for BWeb package

  • rpms: Fix issue with clientonly option

  • rpms: Fix suse html-manuals package

  • swift: Add KeystoneV3 authentication.

  • udpate NDMP version

  • win32: Switch to OpenSSL 1.1.1l

Bugs fixed/closed since last release:

2627 7860 7998 8001 8035 8089 8098 8100 8101 8102 8108 8110 8118 8120 8126 8131 8140 8142 8159 8167

Release 12.8.2 / 06 August 2021

12.8.2 is a minor bug fix release. There are however a few new features.

  • Allow restoration of VSS Plugin files on Linux and bextract

  • Fix #6119 About listing files being verified

  • Fix #7600 About variable for PreviousJobId in mail messages

  • Fix #7660 About respecting the ‘nodump’ flag in more OSes than just BSD

  • win32: Add Sharepoint plugin

  • Add debug/trace/tags information to .status header

  • Fix #6986 About mail variables not working after a conf reload

  • Fix #7981 About OpenBSD chio-changer script fix

  • Fix SQL query generated with ACLs

  • Fix for the PluginObject table name for the MAC jobs

  • vss: Fix incorrect partial data stream type

  • bweb: Request #7860 display information about debug on status client page

  • bweb: Add restart components directly from BWeb split component configuration wizard

  • bweb: Fix #7589 keep current page in running job table

  • bweb: Fix #7941 remove in fileset browser all excludes at once

  • bweb: Fix #7961 displaying fileset browser content if client does not use any plugin

  • bweb: Fix #8009 blank page on editing volume if nothing selected

  • bweb: Fix #8012 displaying admin job runscript commands in run job wizard

  • bweb: Fix NDMP fileset box with OnTAP Hostname not required

  • bweb: Fix displaying icons for windows specific plugins on status client page

  • bweb: Fix install_win.py for Redhat7 with Python3

  • cloud: Fix #7986 About incorrect message when wait_one_transfer fails

  • hdfs: fix #7846 about backwards incompatibility of snapshotdiff between Hadoop 2 and Hadoop 3

  • hyperv: Fix #7947 Increase backup bpipe timeout

  • m365: Added comments about Azure AD app generation, secrets and more. Removed unused private_key from code

  • m365: Added todo-tasks module and associated test

  • m365: Changed local paths for sharepoint templates, from name to simplified id. Fix #8019

  • m365: Fix for XML read process when it is working with strange char paths

  • m365: Fixed issue with jobname in deltaFile when it contains dots. Fix #7972

  • m365: New message categories (non-fatal error, operator..). Log framework changed to log4j2

  • m365: Prepared compatibility with Java 11. Changed some messages from debug to trace level

  • m365: Upgraded calendar accessDenied error from warning to error

  • ndmp: Enhance EMC UnityOE dedup analyzer

  • rest-api: Fix #7952 OAuth2 user script to test REST API

  • rest-api: Update for deb packages web server config to support PHP 7

  • rhv: Add proxy udev restart

  • rhv: Add support iSCSI uploads. Change outputs in debug and fix waits snapshots outputs

  • rhv: Added Makefile to compile through Maven. Fixed backend file. Standarized Maven properties

  • rhv: Alerts checking and Storage domain report

  • rhv: Basic integration with meta-plugin library. New nonfatalerror type applied to some former warning situations

  • rhv: Change plugin version from 4.0.0 to 4.1.0. rhv: Remove final json resume except listing.

  • rhv: Add new final resume format. rhv: Async backup feature.

  • rhv: Fix labels of job logs.

  • rhv: Fix statistics.

  • rhv: Fix RAM limit.

  • rhv: Fix default log path.

  • rhv: Fixed disk size in proxy backup mode and logging. #7762

  • rhv: Fixed unit error on upload rate of snapshot disk restore

  • rhv: Hardened final summary method to not be making a job to fail, even if we find any unexpected error

  • rhv: Join target_exclude_disks and vm_exclude_disks in restore time, and more logging.

  • rhv: Messages fixes. SDK Upgraded to 4.4.5. Java upgraded to Java 11

  • rhv: added linux sync command to proxy mode in prepare phase, before starting disk copy

  • sir: fix #7752 about BWeb spinning gears after a successful instant recovery migration

Bugs fixed/closed since last release: 6119 6986 7589 7600 7660 7752 7846 7941 7947 7952 7953 7959 7961 7972 7981 7985 7986 8009 8012 8015 8019 7860

Release 12.8.1 / 29 June 2021

12.8.1 is a minor bug fix release.

  • Fix #6001 About adding more logging for daemon<->daemon connection

  • Fix MySQL default connection in the grant_mysql_privileges script

  • Fix backward compatibility problem for plugin objects

  • Fix heartbeat segfault when the job is terminated very quickly

  • bcloud: Request #6185 LDAP authentication improvements

  • bweb: Fix #7874 improve text to display online plugin documentation if Download Area ID is not defined

  • bweb: Request #7693 hide instant recovery wizard steps if selected backup job is not vSphere type

  • bweb: Request #7720 add links to new online plugins documentation

  • bweb: Request #7788 make access/secret keys, host and region fields disabled if Google cloud driver is selected

  • cloud: Report Goodle driver improvements to Azure and Oracle cloud drivers

  • hdfs: fix #7846 about incrementals and differentials not handling snapshot diffs correctly

  • hyperv-wmi: Fix #7855 Add missing function to powershell module

  • hyperv-wmi: Fix #7881 Fix segfault with invalid path

  • m365: Fixed restore of the same event in several calendars during same restore job: #7862. Fixed bug of finding calendar groups by name

  • mssql: Fix #7891 Accept “complex” passwords for the connection string

  • rest: rest-api: Add support for PostgreSQL 12

  • vsphere: Generate a new set of vix disk libraries

  • win32: Fix #7743 Modify Windows Installer options

Bugs fixed/closed since last release: 6001 6185 7693 7720 7743 7788 7846 7855 7862 7874 7881 7891

Release 12.8.0 / 18 June 2021

12.8.0 is a major release.

New Features:

Plugin:

  • Microsoft 365 Plugin

  • XenServer Single Item Restore support

  • HyperV VSS Single Item Restore support

  • VMware vSphere Automatic Permission detection

  • HyperV Non-VSS Plugin with Incremental/Differential support

  • SAP HANA 1.50 Support

  • Redhat OpenShift Plugin

  • vSphere HotAdd and NBDSSL transport method added

BWeb Management Center Features:

  • New Event Dashboard

  • VMware Instant Recovery support

  • Automatic syntax checking of the vsphere configuration file

  • Autochanger page improvements

  • Add ability to push full and restricted console configuration to remote hosts

Misc Features:

  • Plugin Object Status support

  • Job Storage group support

  • SDPacketCheck FileDaemon used to control the network flow

More information and examples may be found in the “New Features” section of the main manual.