KB10044 Errors during backup and restore "Fault reason is "Operation Failed". Fault detail is "[Cannot remove VM. VM test_vm is being imported.]". HTTP response code is "409". HTTP response message is "Conflict"."

📚

Documentation

Installation guides, configuration steps, and product documentation.

Explore documentation →

🎧

Support

Create a support request or review your existing cases.

Go to support →

⬇️

Download trial

Download the product trial and try it out.

View downloads →

KB10044 Errors during backup and restore "Fault reason is "Operation Failed". Fault detail is "[Cannot remove VM. VM test_vm is being imported.]". HTTP response code is "409". HTTP response message is "Conflict"."

KB ID: 10044

Product: vProtect

Version: not applicable

Published: 2021-10-18

Last modified: 2021-10-18

Problem

When I try to backup or restore VM an error occurs with the message similar to this:

eu.storware.vprotect.engine.exception.ExternalAPIException
eu.storware.vprotect.engine.exception.ExternalAPIException: Fault reason is "Operation Failed". Fault detail is "[Cannot remove VM. VM test_vm is being imported.]". HTTP response code is "409". HTTP response message is "Conflict". at eu.storware.vprotect.engine.hypervisormanager.rhv.RhvHypervisorManager.importFull(RhvHypervisorManager.java:229) ~[engine.jar:?] at eu.storware.vprotect.engine.hypervisormanager.rhv.RhvHypervisorManager.importFull(RhvHypervisorManager.java:79) ~[engine.jar:?] at eu.storware.vprotect.engine.task.ImportTask.run(ImportTask.java:81) [engine.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] at java.lang.Thread.run(Thread.java:829) [?:?] Caused by: org.ovirt.engine.sdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot remove VM. VM test_vm is being imported.]". HTTP response code is "409". HTTP response message is "Conflict". at org.ovirt.engine.sdk4.internal.services.ServiceImpl.throwError(ServiceImpl.java:116) ~[engine.jar:?] at org.ovirt.engine.sdk4.internal.services.ServiceImpl.checkFault(ServiceImpl.java:43) ~[engine.jar:?] at org.ovirt.engine.sdk4.internal.services.VmServiceImpl$RemoveRequestImpl.send(VmServiceImpl.java:894) ~[engine.jar:?] at org.ovirt.engine.sdk4.internal.services.VmServiceImpl$RemoveRequestImpl.send(VmServiceImpl.java:837) ~[engine.jar:?] at eu.storware.vprotect.engine.hypervisormanager.rhv.api.RhvApi.removeVm(RhvApi.java:103) ~[engine.jar:?] at eu.storware.vprotect.engine.hypervisormanager.rhv.RhvHypervisorManager.importVm(RhvHypervisorManager.java:602) ~[engine.jar:?] at eu.storware.vprotect.engine.hypervisormanager.rhv.RhvHypervisorManager.importFull(RhvHypervisorManager.java:223) ~[engine.jar:?]

 

In the engine.log we can see that there is a problem with releasing lock from the disks so they cannot be attached to VM. vProtect tries to clean up after the failed task but is not allowed by ovirt-engine.

ACTION_TYPE_FAILED_DISK_IS_LOCKED
2021-10-05 21:50:26,118+03 WARN [org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default task-1) [38353b4b] Validation of action 'AttachDiskToVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__ATTACH_ACTION_TO,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_IS_LOCKED 2021-10-05 21:50:26,137+03 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-1) [38353b4b] EVENT_ID: VM_IMPORT_FROM_CONFIGURATION_ATTACH_DISKS_FAILED(175), VM test_vm has been imported from the given configuration but the following disk(s) failed to attach: test_vm_Disk1. 2021-10-05 21:50:26,618+03 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (default task-1) [c61b9f4f-a682-4e0e-8ca4-d8f7fa56fe16] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[test_vm=VM_NAME]', sharedLocks='[91f5fbf7-744b-455a-8c64-1b1f8fc462ea=VM]'}' 2021-10-05 21:50:26,618+03 WARN [org.ovirt.engine.core.bll.UpdateVmCommand] (default task-1) [c61b9f4f-a682-4e0e-8ca4-d8f7fa56fe16] Validation of action 'UpdateVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED,$VmName test_vm 2021-10-05 21:50:26,650+03 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-1) [] Operation Failed: [Cannot edit VM. VM test_vm is being imported.] 2021-10-05 21:50:26,719+03 INFO [org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default task-1) [99843147-243d-43a3-bbe4-4f3611585834] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[91f5fbf7-744b-455a-8c64-1b1f8fc462ea=VM_DISK_BOOT, 577c9329-8ebe-4268-ae62-6da64b55dcd7=DISK]', sharedLocks=''}' 2021-10-05 21:50:26,719+03 WARN [org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default task-1) [99843147-243d-43a3-bbe4-4f3611585834] Validation of action 'AttachDiskToVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__ATTACH_ACTION_TO,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_IS_LOCKED 2021-10-05 21:50:26,720+03 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-1) [] Operation Failed: [Cannot attach Virtual Disk: Disk is locked. Please try again later.] 2021-10-05 21:50:26,789+03 INFO [org.ovirt.engine.core.bll.storage.disk.RemoveDiskCommand] (default task-1) [cfebf2da-a1f0-40fc-af6c-85b13c09c3ab] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[577c9329-8ebe-4268-ae62-6da64b55dcd7=DISK]', sharedLocks=''}' 2021-10-05 21:50:26,789+03 WARN [org.ovirt.engine.core.bll.storage.disk.RemoveDiskCommand] (default task-1) [cfebf2da-a1f0-40fc-af6c-85b13c09c3ab] Validation of action 'RemoveDisk' failed for user admin@internal-authz. Reasons: VAR__ACTION__REMOVE,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_IS_LOCKED 2021-10-05 21:50:26,815+03 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-1) [] Operation Failed: [Cannot remove Virtual Disk: Disk is locked. Please try again later.] 2021-10-05 21:50:26,936+03 INFO [org.ovirt.engine.core.bll.RemoveVmCommand] (default task-1) [ecc95fff-034b-435f-9113-5e691cf31829] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[91f5fbf7-744b-455a-8c64-1b1f8fc462ea=VM]', sharedLocks=''}' 2021-10-05 21:50:26,936+03 WARN [org.ovirt.engine.core.bll.RemoveVmCommand] (default task-1) [ecc95fff-034b-435f-9113-5e691cf31829] Validation of action 'RemoveVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__REMOVE,VAR__TYPE__VM,ACTION_TYPE_FAILED_VM_IS_BEING_IMPORTED,$VmName test_vm 2021-10-05 21:50:26,978+03 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-1) [] Operation Failed: [Cannot remove VM. VM test_vm is being imported.]

Solution

This is a known bug in oVirt/RHV 4.4.8 version. It is not related to vProtect software. The bug has been reported and can be tracked here:

https://bugzilla.redhat.com/show_bug.cgi?id=1917893

You can check the progress of the fix on this page:

https://gerrit.ovirt.org/c/ovirt-engine/+/116984