Hi,
I was reading Veeam user guide about Compact, Transformation, Full backup file merge and health check but I didnt really found how is the logic behind.
The problem is that we have a lot of jobs in Veeam which we are duplicating with backup copy job to a NAS.
Source/primary backup storage is a physical hardened linux repo and secondary storage is a NAS in RAID6 attached as SMB backup repo.
We have a lot of jobs/Data which we are duplicating to the NAS with forever incremental, so I scheduled a compact backup job once per month for every job and scheduled it through the whole month, I also scheduled health checks job the same way.
As we have linux repo, we also created some physical servers as gateways (gatewayA,B etc...) as linux can not send data to NAS.
And now my question if someone would have the info.
1. Compact - "creates a new full backup file in the target repository: it copies existing data blocks from the old backup file, rearranges and stores them close to each other" - this means in our case that customerA has 1TB Full backup job on the NAS, on the day when compact is scheduled VBR will trigger a job which will copy the existing customerA full backup on the same NAS but in reality VBR copied 1TB through the gatewayA Server so read 1TB from NAS to gatewayA and again write 1TB to NAS? SO 1 TB go through the gatewayA Server, right?
2. Transformation - this is the task injecting oldest incr. into the full as we have forever incr. or full backup file merge which needs to be done on every run now, how is this task in reality be done?
I also see in the jobs Processing VMName_xy:vm-138285 CTransformAlg_f849dc04-71bb-4b3f-9aef-973875a5bc65 etc... this belong to which task because I have in inside the job for example 10 VMs, 9 VMs are done, state successfully but I still see the log, when I do not press on the VM inside the job but only open the job and check general info that this kind of processing is still running for 8/10 VMs.This job is deleting the the oldest restore point after the injection of the oldest incr. to the full was done? So the steps are: incr. backup job->injecting odtest incr. job into full-> deleting oldest incr. job from storage?
3. Health check - "calculates CRC values for backup metadata and hash values for data blocks of a disk in the backup file and saves these values in the metadata of the backup file" who is doing here the main work?
The problem is that the performance is bad and compact or transformation or health check is taking sometimes more hours, so I try to figure out how we can make it faster that we can duplicate/backup copy within 24 hours, if it makes sense for big jobs to scheduled a GFS that we do not need to do a compact job and transformation of if we can change something on the setup to make it quicker, if you have any info please let me know. Thank you!
I was reading Veeam user guide about Compact, Transformation, Full backup file merge and health check but I didnt really found how is the logic behind.
The problem is that we have a lot of jobs in Veeam which we are duplicating with backup copy job to a NAS.
Source/primary backup storage is a physical hardened linux repo and secondary storage is a NAS in RAID6 attached as SMB backup repo.
We have a lot of jobs/Data which we are duplicating to the NAS with forever incremental, so I scheduled a compact backup job once per month for every job and scheduled it through the whole month, I also scheduled health checks job the same way.
As we have linux repo, we also created some physical servers as gateways (gatewayA,B etc...) as linux can not send data to NAS.
And now my question if someone would have the info.
1. Compact - "creates a new full backup file in the target repository: it copies existing data blocks from the old backup file, rearranges and stores them close to each other" - this means in our case that customerA has 1TB Full backup job on the NAS, on the day when compact is scheduled VBR will trigger a job which will copy the existing customerA full backup on the same NAS but in reality VBR copied 1TB through the gatewayA Server so read 1TB from NAS to gatewayA and again write 1TB to NAS? SO 1 TB go through the gatewayA Server, right?
2. Transformation - this is the task injecting oldest incr. into the full as we have forever incr. or full backup file merge which needs to be done on every run now, how is this task in reality be done?
I also see in the jobs Processing VMName_xy:vm-138285 CTransformAlg_f849dc04-71bb-4b3f-9aef-973875a5bc65 etc... this belong to which task because I have in inside the job for example 10 VMs, 9 VMs are done, state successfully but I still see the log, when I do not press on the VM inside the job but only open the job and check general info that this kind of processing is still running for 8/10 VMs.This job is deleting the the oldest restore point after the injection of the oldest incr. to the full was done? So the steps are: incr. backup job->injecting odtest incr. job into full-> deleting oldest incr. job from storage?
3. Health check - "calculates CRC values for backup metadata and hash values for data blocks of a disk in the backup file and saves these values in the metadata of the backup file" who is doing here the main work?
The problem is that the performance is bad and compact or transformation or health check is taking sometimes more hours, so I try to figure out how we can make it faster that we can duplicate/backup copy within 24 hours, if it makes sense for big jobs to scheduled a GFS that we do not need to do a compact job and transformation of if we can change something on the setup to make it quicker, if you have any info please let me know. Thank you!
Statistics: Posted by StanoSedliak — Jan 12, 2024 8:29 am







