Release Notes for Bacula Enterprise 10.0

Catalog format in version 10.0 and greater

The major release 10.0.0 of Bacula uses a new catalog format. We provide a set of scripts that convert 6.6.x and earlier catalog versions to the new 10.0.0 format (1020). Please see the white paper “Migration-to-10.0” for detailed instructions on the migration process.

The database upgrade from 1019 to 1020 is fast and simple for most users.

The Bacula Enterprise RPM spec files have been modified to detect the database change and do the upgrade for you (from 8.2, 8.6 and 8.8). We strongly recommend that you save a copy of your existing database before upgrading using RPMs. If you want to have more control over the catalog upgrade step when upgrading using RPMs, you may want to contact the Bacula Systems support team to get the update_bacula_tables script and run it before the RPM installation step.

If you upgrade BWeb Management Suite from 8.x, you must update the BWeb SQL tables with the script upgrade-6.0-8.8_postgresql.sql or upgrade-6.0-8.8_mysql.sql.

If you are starting from scratch, you don’t need to run the update_bacula_tables script because the create_bacula_tables script automatically creates the tables using the new format.

Incremental Accelerator for NetApp users should carefully read the lastest plugin user’s guide or contact the support team to upgrade the plugin to the 8.2.9 or later version.

vSphere plugin users must specify the “thumbprint” parameter in the vsphere_global.conf file for each ESX server defined. The thumbprint can be obtained with the “/opt/bacula/bin/vsphere-ctl thumbprint <esxi ip address>” command. More information can be found on the vSphere plugin user’s guide.

Global Endpoint Deduplication volume size now computes the virtual non-dedup size of a volume in the VolABytes catalog field. Directives such as MaximumVolumeBytes or MaximumPoolBytes use the physical and the virtual volume size to check the limits.

Restricted Console users must modify their existing Console resources to specify DirectoryACL=*all* and UserIdACL=*all* in order to continue to use the restore command. If these two directives are not set, the restore command will return an error.

The default for the “limit” parameter of the “setbandwidth” command is now in bytes/s instead of kb/s. The parameter can now accept a speed suffix. ex: limit=10kb/s

On Suse Linux, the Director and the Storage Daemons are now started with the unix account “bacula”. To upgrade a Suse system to Bacula Enterprise 8.8 or later, the ownership of the Bacula volumes and the configuration files must be changed to “bacula:bacula” and the PostgreSQL/MySQL configuration may have to be adapted. More information can be found in the Migration-to-10.0 whitepaper available in your download area.

Known Issues and Workarounds:

Remaining issues are carried over from 6.x/8.x and still apply.

#1723 The hardlinks=yes FileSet option is not compatible with VirtualFull jobs.

This incompatibility might lead to problems during a restore. The error message displayed during a restore job is:

Error: create_file.c:327 Could not hard link /path: ERR=No such file or directory

To restore the file correctly, it is required to select the first occurrence of the hardlink file in the backup manually. The procedure to distinguish hardlinks in the catalog is available from Bacula Systems support team.

#3007 Delta Plugin on Windows FD throws error in Incremental jobs when VSS is enabled

Backup and restore with any version of the Delta Plugin up to 8.6.19 works flawlessly. The incremental backup and the restore of data with the delta plugin from version 8.0.8 up to 8.8.6 may fail on Windows platform.

Fatal error: vss.cpp:449 Backup is not Initialized or Error: Open sig file failed: \?c:/Program Files/Bacula/workingdelta.… ERR=No such file or directory

To restore the file correctly, it is required to restore files with a 8.0.7 File Daemon and the 8.0.7 delta plugin. More information about the procedure is available from Bacula Systems support team.

Release 10.0.8 22 October 2018

10.0.8 is a minor bug fix release.

  • Add warning message about failure to update volume info

  • Fix bugs #C2335 and #C2349 Volume messages printed many times

  • Fix incorrectly indicating: malformed message

  • Make “scan” keyword in update help command optional

  • Improve error messages for JobMedia errors

  • Make detection of duplicate M_SECURITY messages work

  • Fix Filedaemon status output to handle long list of plugins

  • bweb: Fix #4185 support for VMware setting where virtual disk is not located on a datastore

  • aligned: Add support for LZO compressed data

  • aligned: Fix Single Item Restore with non standard data packet size

  • dedup: fix vacuum that was not always doing an optimize when required

  • dedup: speed up vacuum by taking advantage of the new_match_all() function

  • mssql: Update help message to mention that stop_before_mark and stop_at_mark don’t use datetime (use stop_at)

  • mssql: Report VDI errors to the Job log

  • registration wizard: Fix #4192 add option to manually locate OpenVPN

  • sir: Fix FileMedia index despooling issue when SpoolData=yes

  • sir: Report errors from bfuse-extract in bfuse-daemon

  • catalog: Fix mixed catalog upgrade issues

  • win32: fix installer doesn’t generate password on 32bit machines

Bugs fixed/closed since last release: C2335 C2349 4185 4192

Release 10.0.7 05 October 2018

10.0.7 is a minor bug fix release.

  • Fix #4113: dedup scrub variable not initialized

  • oracle: Fix #3949 about plugin that cannot get the job list on Solaris

  • mssql: Fix #4052. Information level in trace log file is increased to debug level 30

  • mssql: Fix #4157 About compatibility issue whith mssql version older than 2012 with new check replica code

  • win32: make Win32Filter handle corrupted data

  • docs: Add documentation about MaximumFileIndex

  • rest-api: Add an update SQL tables script

  • rest-api: Change default bcloud setting options

  • rest-api: Define maximum concurrent jobs in file daemon template

  • rpms: Add php-ldap to the BCloud dependencies

  • rpms: Do not overwrite bcloud vpn template file

Bugs fixed/closed since last release: 4052 4113 4157

Release 10.0.6 13 September 2018

10.0.6 is a minor bug fix release. There are a few new BCloud features.

  • bweb: Add generating tls certificates for vpn purposes

  • bweb: Fix VMware ‘VM Tag’ support in scan_datacenter.pl script

  • bweb: Fix URL value to be compatible between vSphere and VMware ‘VM Tag’ features

  • registration wizard: add configure VPN option

  • registration wizard: add useVPN in mime multipart

  • registration wizard: don’t timeout on OpenVPN start

  • registration wizard: update OpenVvpn config

  • rest-api: Add client behind NAT option

  • rpms: Add ovpn_config.sh script to the registration wizard package

  • rpms: Fix bug #4081 - Fix acsls-changer executable ownership

Bugs fixed/closed since last release: 4081

Release 10.0.5 06 September 2018

10.0.5 is a minor bug fix release.

  • Fix Dir crash on releasing CLIENT_GLOBALS

  • aligned: Fix #4032 about SD crashing when using the vSphere plugin’s ‘index’ option

  • mssql: Fix #4069 about issue with non-preferred replica backup

  • postgresql: Fix #4060 about a hanging issue

  • proxmox: Add support for Proxmox 5.2 in Proxmox plugin

  • bweb: Update bsys_report.pl script

  • rpms: Add php-bcmath dependency for REST API

  • rpms: Fix bacula.spec when building client-only

  • rpms: Fix bug #4036 - bsys_report.pl not found in BWeb

  • rpms: Fix #4085 about bacula unix group creation during install

  • Add line about bug #4017 in changelog and ReleaseNotes 10.0.4

Bugs fixed/closed since last release: 4032 4036 4060 4069

Release 10.0.4 22 August 2018

10.0.4 is a minor bug fix release.

  • Add M_SECURITY when connection is bad, and fix bug where invalid probes sent to Dir

  • Add ability to replace the file mtime in a Bacula RegexWhere expression with $m

  • Fix #3990 about update_mysql_tables_1019_to_1020 and update_mysql_tables upgrade issue

  • Fix #4025 about incorrect comment in vsphere_global.conf.example template file

  • Fix #3972 escaping special characters in bvfs restore for sqlite catalog

  • postgresql: Do not read the .psqlrc file during backup/restore

  • bweb: Add support for VMware’s “VM Tags” to the scan_datacenter.pl tool

  • bweb: Fix #4017 about a typo in the restore wizard multiple file version popup

  • rest-api: Fix optional jobstatus filter value

  • rest-api: Fix undefined index error if no job level specified

  • rest-api: Fix warning about trying to get property on non-object in fileset popup

  • swift: Fix #3809 about improvements to the restore speed

  • rpms: Create the bacula group even for the bacula-client package

  • rpms: Fix #4006 - bzip2 command not found

  • rpms: Fix bug #3981 - BWeb does not show FD version

  • snapshot: Add mountopts to bsnapshot.conf option

  • vsphere: Keep the VIXERROR string in Bacula job log

  • docs: Change “pvf” to “Progressive Virtual Full”

  • docs: Document snapshot mountopts

  • docs: Eliminate “MCJ” and spell out “Maximum Concurrent Jobs”

  • docs: Document the commands used by the tray monitor

  • docs: Update catalog information

Bugs fixed/closed since last release: 3809 3972 3981 3990 4006 4025

Release 10.0.3 19 July 2018

10.0.3 is a minor bug fix release.

  • Fix #3615 about bconsole Socket errors reported in the bacula log file

  • Ensure that plugins ndmp/mysql/bpipe don’t mix data with stderr messages

  • Fix #3854 missing tls library initialization in bdirjson, bfdjson, bsdjson and bbconsjson

  • Fix #3904 about MySQL 5.7 issue with PriorJob field in the Job and JobHisto tables

  • Fix #3945: Add “ocfs2” to list of filesystems known by the “FsType” FileSet directive

  • Fix #3451 about a segfault with the “prune expired” command with the SQLite backend

  • bweb: Add Proxmox plugin support

  • bweb: Default set self-signed certificates as CA in openssl.cnf template

  • bweb: Fix #3670 add viperl installation instructions to BWeb’s VMware Center

  • bweb: Fix #3896 storage umount action

  • bweb: Fix #3919 about extending “Nb” short form of the word “number”

  • bweb: Fix #3920 add client side validation to user self restore password field

  • bweb: Fix #3813 getting and comparing PostgreSQL version

  • bweb: Fix #3813 pg_wrapper error when running install_bweb.sh

  • bweb: Fix showing error message if config error occurs

  • bweb: Request #3536 about using the same job details in job zoom as on job list page

  • bweb: Request #3909 about adding “BackupsToKeep” and “DeleteConsolidatedJobs” directives support

  • bweb: Update Portuguese translations made by Heitor Faria

  • dedup: Fix #3924 about a segfault with “dedup quiesce” command

  • dedup: Workaround #3940 scrub_pos has a large negative value

  • swift: Improve backup speed

  • swift: Problem restoring to local directory using the “restore_local = yes” Plugin Option

  • aligned: Add support for indexed streams to Aligned Volumes

  • mssql: safeguards for Always On configurations.

  • ndmp: Fix #3936 Redirect Session messages to the Job log instead of the trace file

  • docs: Fix “BackupsToKeep” directive documentation

  • rpms: Remove tapealert from clientonly package

Bugs fixed/closed since last release: 3451 3536 3615 3670 3813 3854 3896 3904 3909 3919 3920 3924 3936 3940 3945

Release 10.0.2 29 May 2018

10.0.2 is a minor bug fix release. There are a few new features.

  • ldap: Add AD Tombstone recovery and special handling for userAccountControl attribute

  • bweb: Add capability to download bsys_report.pl output archive

  • bweb: Add Microsoft VSS Hyper-V plugin support

  • bweb: Request #2427 add hourly schedule support

  • Applied modified patch from #2117 to fix bpipe end of stream

  • Fix #3607 about SQLite optimization with BVFS restore

  • Fix #3672 about bdirjson issue with the Autochanger directive

  • Fix #3745 update the client SQL record after a reload

  • Fix #3769 about compatibility issue with Bacula FD 7.4 and 9.0

  • Fix backup ACL/XATTR after fatal error and not only errors

  • Fix bug reported by jesper@schmitz.computer where bat hangs on FreeBSD

  • Fix Solaris 10 compilation error on BXATTR when no linkat(2) found.

  • Fix showing PkiCipher and PkiDigest values in bfdjson output

  • Fix loading issue of RestoreObject with SQLite

  • Fix #3824 about incorrect setdebug command description

  • Fix org#2343 where truncate of explicit Volume name truncates non-purged volumes

  • bvfs: Fix hardlinks detection with files having imcomplete st_mode attribute

  • bweb: Add alert to vSphere host popup when an user is trying to use a backslash character in a username field

  • bweb: Add “Enabled = yes|no” directive support to device resource setting

  • bweb: Add shebang to VMware push script

  • bweb: Extend allowed characters in Cloud resource secret key

  • bweb: Fix #1172 about required storage directive in job or pool resource

  • bweb: Fix #3609 required vSphere section in the vsphere_global.conf config file

  • bweb: Fix #3673 downloading zip archive with config during client registration

  • bweb: Fix #3684 about missing unknown label on pie charts

  • bweb: Fix #3757 PkiDigest directive setting not working

  • bweb: Fix #3783 FD and SD address fields incorrectly auto-filled with port value

  • bweb: In restore wizards move “clear selection area” button to the bottom left

  • bweb: Request #3794 about adding button to move volumes to a different pool

  • bweb: Fix #3814 failing SQL query while getting pool status

  • bweb: Fix saving runscript directive by external bconfig interface

  • bweb: Update Japanese language support (translation made by 3ware)

  • cloud: Fix #3701 about libwas not being loaded correctly

  • cloud: Fix #3818 about Azure driver error in update_last_error

  • cloud: Improve error message when loading Azure library

  • cloud: Remove the source code reference in a job message #3656

  • cloud: disable ‘was’ and ‘s3’ build based on configure

  • cloud: redirect libwas errors from stdout to an error string

  • cloud: Partial Fix #3776 Implement workaround for concurent download part overlap

  • mssql: Make mssql-driver more exception-safe

  • mssql: Stack corruption detected in ProcessSqlDiagnosticMessage

  • mssql: when no instance is specified, prefer “.” to “(localdb)”

  • mssql: Fix #3772 Single hostname can be specified for server name

  • mssql: Fix recover commands when restoring to a different instance

  • ndmp: Display all DLM messages in the job output

  • ndmp: Do not display warning message about HIST file if use_hist was not set

  • ndmp: Fix #3842 about NDMP type=config not displayed correctly during restore

  • postgresql: Fix #3837 about issue with postgresql version detection

  • bcloud: Add button to remove single schedule line

  • bcloud: Fix error when saving a schedule resource

  • bcloud: Adapt the backup/restore filters to ok/warning/error/canceled options

  • rest-api: Add support for multiple job statuses in one request

  • rest-api: Fix #3775 about not setting address field value

  • rest-api: Fix #3798 about restore browser not working for Windows paths

  • rest-api: Fix escaping quote characters in fileset values

  • rest-api: Add button to remove single schedule line

  • rest-api: Adapt the backup/restore filters to ok/warning/error/canceled options

  • rest-api: Fix saving schedule

  • rest-api: Fix warning when job doesn’t have schedule assigned

  • rest-api: Extend allowed chars in paths to the UTF national characters

  • rest-api: Add validation pattern to the client name field

  • rest-api: Fix #3811 delete jobs/filesets/schedules when client is removed

  • sir: Fix #3768 about mount-vmware/mount-exchange -s option not working as expected

  • win32: Fix backup issue with path > 250 characters

  • proxmox: Fix for “Cannot restore to different Proxmox node in cluster”

  • proxmox: Fix unexpected error message during standard files backup

  • proxmox: Update job messages on “No VZDump backup content found”

  • proxmox: Fix #3661 default storage “wrong content type” issue

  • proxmox: Fix for multiple LXC backup problem (no config file for second LXC)

  • proxmox: Update job log messages when no valid vzdump_storage found

  • proxmox: double “Using no pool (default)” during single LXC restore

  • docs: Fix #3777 about FDAddress used instead of Address in a Director Client resource example

  • rpms: Fix #2861 Add vSphere plugin example config file

  • rpms: Fix #3630 Unable to run Bacula tray monitor

  • rpms: Fix bug #1757 about DDE ulimit issue on RHEL6 platform

  • rpms: Fix bug 3405 - /opt/bacula/sap missing for sap-hana-plugin

  • rpms: Fix cloud libwas permissions

  • rpms: Disable WAS build on unsupported platforms

  • rpms: Do not overwrite custom bcloud logo during upgrade

  • rpms: Fix bug #3730 - BEE rest-api upgrade overwriting lighttpd.conf

  • rpms: Fix bug #3819 - Fix permissions on Bacula’s logrotate config file

  • rpms: Fix cloud libwas permissions for SUSE

  • swift: Add ‘insecure’ restore plugin parameter

  • swift: Extend the plugin with a listing procedure

  • swift: Fix for missing EOD handling at the end of the backup job when error packet receieved

  • swift: Fix incorrect restore object parameters merge

  • xenserver: Fix possible unexpected error message during standard files backup

Bugs fixed/closed since last release: 1172 1757 2117 2861 3607 3609 3630 3656 3661 3672 3673 3677 3679 3684 3701 3745 3757 3768 3769 3775 3777 3783 3794 3798 3819 org#2343

10.0.1 was a minor bug fix release not publicly released.

Release 10.0.0 28 March 2018

10.0.0 is a major release.

The Director (Dir) and all Storage Daemons (SDs) must be version 10.0 because they are not compatible with prior versions. The Director uses a new catalog format.

New Features:

New Features:

  • Add BCloud Service product based on REST API

  • Add Registration Wizard to register client via BCloud Service

  • Add MaximumPoolBytes Pool directive

  • Add quiesce command to synchronize dedup systems

  • Allow to copy/migrate jobs with plugins

Plugin:

  • Add Proxmox plugin with support for LXC and QEMU

  • Add XEN Server Plugin

Misc Features:

  • Add support for PostgreSQL 10

  • The Where/Replace parameters are displayed in the Restore job summary

  • Implementation of .ls command for Plugins

  • Use O/SOCK_CLOEXEC in open() calls

  • Add info message of #jobs consolidated in Virtual Full

  • Display ulimit settings in the storage status output

  • Add command to change the pool of a job and the associated volumes

  • ndmp: Display QR messages in the job log

  • sap: Add option to configure a SAP HANA cluster

  • sap: Add the restoreclient option to the backint.conf

  • snapshot: Add support for LVM 1.02/2.02

  • bweb: Add delete client button in admin part - feature request #322

  • mssql: Fix #3361 Add checksum option for restore and backup

Important Changes:

  • Fix #3593 VirtualFull will select jobs to consolidate using Job name in addition to Client/FileSet

  • Fix concurrent acquire and release device

  • Fix #3537 About adding %o in the Job code edition for the Job Priority variable

  • Check that Minimum Block Size <= Maximum Block Size in check_resources()

  • Correct FS size calculation for FreeBSD, Solaris, and Windows

  • Fix #3438 about MaximumConcurrentJobs issue with Copy/Migration jobs

  • Fix #3496 about bvfs offset parameter ignored

  • Fix a crash in tray monitor runjob. init must be called first.

  • replace readdir_r() with breaddir()

  • Add –maintenance-only parameter to the make_catalog_backup.pl script

  • Add catalog Job column PriorJob

  • Fix #2414 about a deadlock with the reload command when using the Counter resource

  • Fix #3508 About Counter catalog value not properly updated after a reload

  • Fix #3593 VirtualFull will select jobs to consolidate using Job name in addition to Client/FileSet

  • ndmp: Fix #3354 about a FD Segfault in ndmp-fd.so when doing a backup without type=config

  • bweb: Add button to set tape autochanger #3391

  • bweb: Add swift plugin support

  • bweb: Add to autochanger page information about test autochanger

  • bweb: Display non JSON data in scan_datacenter.pl output when –json is not specified

  • bweb: Fix #3375 invalid equivalent standard file or tape storage space value on the dedup usage page

  • bweb: Fix #3377 mark currently selected file in the restore file browser

  • bweb: Fix #3378 height of the path field in restore file browser

  • bweb: Fix #3394 incorrect quiesce option in vsphere plugin

  • bweb: Fix #3416 wrong documentation to the vmware integration feature

  • bweb: Fix #3452 about tab key navigating in the admin menu

  • bweb: Fix #3455 missing acl directives in console created for BMR products

  • bweb: Fix #3459 about improving Net::SSH::Perl install documentation

  • bweb: Fix #3601 about missing vsphere plugin root directory after pushing configuration

  • bweb: Fix #3602 about deleting fileset include lists

  • bweb: Implement multiple workset management

  • bweb: Fix #1067 about enlarging backup client drop down list in the restore wizard

  • bweb: Fix #3600 enable @ character in names

  • dedup: Inside the client, access DDE through the DDECon instead of directly

  • dedup: allow Scrubber to be paused for other reasons than vacuum

  • dedup: enforcing mlock_max

  • rpms: Avoid error messages with existing configuration files during upgrade

  • rpms: Disable Azure cloud driver build on unsupported platforms

  • windows: Update OpenSSL to 1.0.2n

  • rest-api: Add custom session directory support

  • rest-api: Add priorjob column definition

  • rest-api: Add workset name setting for config requests

  • rest-api: Fix hardcoded path in script to add director

  • mssql: Fix IClientVirtualDeviceSet2::CreateEx failed crash

  • mssql: Fix #2996 PREV_BACKUP subquery that can return more than one value

Bugs fixed/closed since last release: 2324 2325 3354 3375 3376 3377 3378 3384 3391 3393 3394 3411 3416 3434 3438 3601 3602 3450 3452 3455 3459 3465 3496 2414 322 3395 3413 3474 3508 3537 2996 3600 1067