04/24/17 20:01:22 933421 [MainThread] [INFO ] Log configuration generated - '/etc/vmware/vmdkops/log_config.json'. 04/24/17 20:01:22 933421 [MainThread] [INFO ] ==== Starting vmdkops service pid=933421 ==== 04/24/17 20:01:22 933421 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 20:01:22 933421 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:02:42 933814 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:02:43 933814 [MainThread] [INFO ] Creating /vmfs/volumes/sharedVmfs-0/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/sharedVmfs-0/dockvols'' 04/24/17 20:02:43 933814 [MainThread] [INFO ] Created /vmfs/volumes/sharedVmfs-0/dockvols 04/24/17 20:02:43 933814 [MainThread] [INFO ] Creating /vmfs/volumes/sharedVmfs-1/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/sharedVmfs-1/dockvols'' 04/24/17 20:02:43 933814 [MainThread] [INFO ] Created /vmfs/volumes/sharedVmfs-1/dockvols 04/24/17 20:02:43 933814 [MainThread] [INFO ] Creating /vmfs/volumes/local.1-0/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/local.1-0/dockvols'' 04/24/17 20:02:43 933814 [MainThread] [INFO ] Created /vmfs/volumes/local.1-0/dockvols 04/24/17 20:02:43 933814 [MainThread] [INFO ] Creating /vmfs/volumes/local.1-1/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/local.1-1/dockvols'' 04/24/17 20:02:44 933814 [MainThread] [INFO ] Created /vmfs/volumes/local.1-1/dockvols 04/24/17 20:02:44 933814 [MainThread] [INFO ] Creating /vmfs/volumes/local.1-2/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/local.1-2/dockvols'' 04/24/17 20:02:44 933814 [MainThread] [INFO ] Created /vmfs/volumes/local.1-2/dockvols 04/24/17 20:02:44 933814 [MainThread] [INFO ] Creating /vmfs/volumes/vsanDatastore/dockvols, running '/usr/lib/vmware/osfs/bin/osfs-mkdir -n '/vmfs/volumes/vsanDatastore/dockvols'' 04/24/17 20:02:47 933814 [MainThread] [INFO ] Created /vmfs/volumes/vsanDatastore/dockvols 04/24/17 20:02:47 933814 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:02:47 933814 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:02:47 933814 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:09:54 934836 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:09:55 934836 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:09:55 934836 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:09:55 934836 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:14:15 933421 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/24/17 20:14:16 933421 [Thread-1] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:14:17 933421 [Thread-1] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:14:17 933421 [Thread-1] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:14:17 933421 [Thread-1] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:14:17 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'allocated': '0', 'size': '100MB'}, 'attach-as': 'independent_persistent', 'created': 'Mon Apr 24 20:14:15 2017', 'fstype': 'ext4', 'status': 'attached', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS'} 04/24/17 20:14:25 935514 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:14:26 935514 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:14:26 935514 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:14:26 935514 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:18:36 936123 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:18:45 936144 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:19:38 936256 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:19:49 936289 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:19:50 936289 [MainThread] [WARNING] Invalid datastore 'None'. 04/24/17 20:19:59 936313 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:19:59 936313 [MainThread] [WARNING] Invalid datastore 'None'. 04/24/17 20:20:06 936381 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:20:06 936381 [MainThread] [WARNING] Invalid datastore 'None'. 04/24/17 20:20:13 936400 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:20:13 936400 [MainThread] [WARNING] Invalid datastore 'None'. 04/24/17 20:20:44 936475 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:20:44 936475 [MainThread] [WARNING] Invalid datastore 'None'. 04/24/17 20:21:33 936579 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:21:34 936579 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:21:34 936579 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:21:34 936579 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:21:39 936594 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:21:39 936594 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:21:39 936594 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:21:39 936594 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:21:55 936631 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:21:56 936631 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:21:56 936631 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:21:56 936631 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:22:01 936691 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:22:02 936691 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:22:02 936691 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:22:02 936691 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:08 933421 [Thread-2] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:08 933421 [Thread-2] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:08 933421 [Thread-2] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol2 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk)'} 04/24/17 20:24:09 933421 [Thread-3] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:09 933421 [Thread-3] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:09 933421 [Thread-3] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk opts = {'fstype': 'ext4', 'size': '10gb'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] No access control, skipping volumes tracing in auth DB 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'create' completed with ret=None 04/24/17 20:24:09 933421 [Thread-4] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:09 933421 [Thread-4] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:09 933421 [Thread-4] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk as independent_persistent 04/24/17 20:24:09 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Adding a PVSCSI controller 04/24/17 20:24:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Added a PVSCSI controller, controller_key=1001 pci_slot_number=160 04/24/17 20:24:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/24/17 20:24:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'attach' completed with ret={'Unit': '0', 'ControllerPciSlotNumber': '160'} 04/24/17 20:24:16 933421 [Thread-5] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:16 933421 [Thread-5] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:16 933421 [Thread-5] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:21 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 20:24:21 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/24/17 20:24:21 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'detach' completed with ret=None 04/24/17 20:24:21 937043 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:24:22 937043 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:22 937043 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:22 937043 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:33 937071 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:24:34 937071 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:34 937071 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:34 937071 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:52 933421 [Thread-6] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:24:52 933421 [Thread-6] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:24:52 933421 [Thread-6] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:24:53 933421 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol3@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol2@sharedVmfs-0'}] 04/24/17 20:27:36 937505 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:27:42 937524 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:27:47 937539 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:27:49 937539 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:27:49 937539 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:27:49 937539 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:28:21 937673 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:28:26 937688 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:28:26 937688 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:28:26 937688 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:28:26 937688 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:33:20 938382 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:07 938516 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:11 938529 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:12 938529 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:34:12 938529 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:34:12 938529 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:34:16 938545 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:21 938560 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:22 938560 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:34:22 938560 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:34:22 938560 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:34:22 938560 [MainThread] [ERROR ] Failed to remove abc policy file Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/bin/vsan_policy.py", line 209, in delete os.remove(policy_path(name)) FileNotFoundError: [Errno 2] No such file or directory: '/vmfs/volumes/vsanDatastore/dockvols/policies/abc' 04/24/17 20:34:28 938579 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:28 938579 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:34:28 938579 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:34:28 938579 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:34:57 938647 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:34:57 938647 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:34:57 938647 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:34:57 938647 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:35:13 938700 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:35:38 938763 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:35:44 938780 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:35:53 938803 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:35:53 938803 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:35:53 938803 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:35:53 938803 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:36:09 938875 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:36:47 938956 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:36:47 938956 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:36:47 938956 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:36:47 938956 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:36:55 938975 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:36:55 938975 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:36:55 938975 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:36:55 938975 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:37:08 939010 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:37:15 939029 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:37:27 939056 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:37:35 939077 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:37:35 939077 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:37:35 939077 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:37:35 939077 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:38:22 939217 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:41:10 939621 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:41:10 939621 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:41:10 939621 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:41:10 939621 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:51:55 941153 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:04 941213 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:27 941262 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:27 941262 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:52:27 941262 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:52:27 941262 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:52:27 933421 [MainThread] [WARNING] Received signal num: 10, restarting. 04/24/17 20:52:27 933421 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 20:52:27 933421 [MainThread] [INFO ] ==== Starting vmdkops service pid=933421 ==== 04/24/17 20:52:27 933421 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 20:52:27 933421 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:32 941290 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:32 941290 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:52:32 941290 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:52:39 941309 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:39 941309 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:52:39 941309 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:52:45 941326 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:47 941326 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:52:47 941326 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:52:57 941381 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:52:58 941381 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:52:58 941381 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:53:02 941404 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:53:02 941404 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:53:02 941404 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:53:17 941439 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:53:17 941439 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:53:17 941439 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:53:54 941516 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:53:56 941516 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:53:56 941516 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:54:10 933421 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/24/17 20:54:10 933421 [Thread-1] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:54:11 933421 [Thread-1] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:54:11 933421 [Thread-1] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:54:11 933421 [Thread-1] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vo4 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk)'} 04/24/17 20:54:11 933421 [Thread-2] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:54:11 933421 [Thread-2] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:54:11 933421 [Thread-2] [WARNING] Volume size not specified 04/24/17 20:54:11 933421 [Thread-2] [WARNING] Volume size not specified 04/24/17 20:54:11 933421 [Thread-2] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [WARNING] Volume size not specified 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'create' completed with ret=None 04/24/17 20:54:11 933421 [Thread-3] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:54:11 933421 [Thread-3] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:54:11 933421 [Thread-3] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 20:54:11 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk as independent_persistent 04/24/17 20:54:12 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/24/17 20:54:12 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'attach' completed with ret={'Unit': '0', 'ControllerPciSlotNumber': '160'} 04/24/17 20:54:15 933421 [Thread-4] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:54:15 933421 [Thread-4] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:54:15 933421 [Thread-4] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 20:54:15 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 20:54:15 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk 04/24/17 20:54:15 933421 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'detach' completed with ret=None 04/24/17 20:54:31 941641 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:54:32 941641 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:54:32 941641 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:56:12 941911 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:56:17 941928 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:56:23 941943 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:56:23 933421 [MainThread] [WARNING] Received signal num: 10, restarting. 04/24/17 20:56:23 933421 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 20:56:23 933421 [MainThread] [INFO ] ==== Starting vmdkops service pid=933421 ==== 04/24/17 20:56:23 933421 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 20:56:23 933421 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:56:32 941977 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:56:32 941977 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:56:32 941977 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:56:32 941977 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:56:53 933421 [MainThread] [WARNING] Received signal num: 15, exiting. 04/24/17 20:56:53 933421 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 20:56:56 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/24/17 20:56:56 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 20:56:56 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:57:00 942138 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:57:00 942138 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:57:00 942138 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:57:00 942138 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:57:11 942173 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:57:11 942173 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:57:11 942173 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:57:11 942173 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:57:51 942257 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:57:51 942257 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:57:51 942257 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 20:57:51 942257 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 20:57:51 942108 [MainThread] [WARNING] Received signal num: 10, restarting. 04/24/17 20:57:51 942108 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 20:57:51 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/24/17 20:57:51 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 20:57:51 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:57:58 942287 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:58:08 942349 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:58:10 942358 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:58:10 942358 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:58:10 942358 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 20:58:23 942391 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 20:58:23 942391 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 20:58:23 942391 [MainThread] [INFO ] Config DB exists and has modifications, mode SingleNode 04/24/17 21:00:23 942701 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:00:23 942108 [MainThread] [WARNING] Received signal num: 10, restarting. 04/24/17 21:00:23 942108 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 21:00:24 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/24/17 21:00:24 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 21:00:24 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:00:28 942727 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:00:28 942727 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:00:28 942727 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/24/17 21:00:28 942727 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/24/17 21:00:31 942108 [MainThread] [WARNING] Received signal num: 10, restarting. 04/24/17 21:00:31 942108 [MainThread] [WARNING] Operations in flight will be terminated 04/24/17 21:00:31 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/24/17 21:00:31 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/24/17 21:00:31 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:00:37 942761 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:00:37 942761 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:00:37 942761 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:05 942108 [Thread-1] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:01:05 942108 [Thread-1] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:05 942108 [Thread-1] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:06 942108 [Thread-1] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 21:01:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol4 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk)'} 04/24/17 21:01:06 942108 [Thread-2] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:06 942108 [Thread-2] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:06 942108 [Thread-2] [WARNING] Volume size not specified 04/24/17 21:01:06 942108 [Thread-2] [WARNING] Volume size not specified 04/24/17 21:01:06 942108 [Thread-2] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 21:01:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/24/17 21:01:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [WARNING] Volume size not specified 04/24/17 21:01:14 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'create' completed with ret=None 04/24/17 21:01:14 942108 [Thread-3] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:14 942108 [Thread-3] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:15 942108 [Thread-3] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 21:01:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 21:01:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk as independent_persistent 04/24/17 21:01:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/24/17 21:01:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/24/17 21:01:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [WARNING] vmci_reply returned error Broken pipe (errno=32) 04/24/17 21:01:16 942108 [Thread-4] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:16 942108 [Thread-4] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:16 942108 [Thread-4] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 21:01:16 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 21:01:16 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk as independent_persistent 04/24/17 21:01:16 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [WARNING] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk already attached. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 21:01:16 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/24/17 21:01:17 942108 [Thread-5] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:17 942108 [Thread-5] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:17 942108 [Thread-5] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 21:01:17 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 21:01:18 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk 04/24/17 21:01:18 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'detach' completed with ret=None 04/24/17 21:01:28 943040 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:01:29 943040 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:29 943040 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:37 942108 [Thread-6] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:01:38 942108 [Thread-6] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:01:38 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol3@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol2@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol5@sharedVmfs-0'}] 04/24/17 21:03:49 943374 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:03:49 943374 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:03:49 943374 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 21:04:19 943479 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 21:04:19 943479 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 21:05:03 943479 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:27:33 956192 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:27:33 956192 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:27:33 956192 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:21 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/24/17 22:46:21 942108 [Thread-7] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:46:21 942108 [Thread-7] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:21 942108 [Thread-7] [WARNING] Reconnecting to the local Service Instance 04/24/17 22:46:22 942108 [Thread-7] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol6 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk)'} 04/24/17 22:46:22 942108 [Thread-8] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:46:22 942108 [Thread-8] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:22 942108 [Thread-8] [WARNING] Volume size not specified 04/24/17 22:46:22 942108 [Thread-8] [WARNING] Volume size not specified 04/24/17 22:46:22 942108 [Thread-8] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] Volume size not specified 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'create' completed with ret=None 04/24/17 22:46:22 942108 [Thread-9] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:46:22 942108 [Thread-9] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:22 942108 [Thread-9] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 22:46:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk as independent_persistent 04/24/17 22:46:23 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/24/17 22:46:23 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/24/17 22:46:24 942108 [Thread-10] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:46:24 942108 [Thread-10] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:24 942108 [Thread-10] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/24/17 22:46:24 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/24/17 22:46:24 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/24/17 22:46:24 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/24/17 22:46:44 959007 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:46:44 959007 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:46:44 959007 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:46:59 959043 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:47:20 959091 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:47:20 959091 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:47:20 959091 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:47:20 959091 [MainThread] [INFO ] Existing default_datastore None is being changed to vsanDatastore for tenant 04/24/17 22:47:48 959152 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:47:48 959152 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:47:48 959152 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:48:01 959183 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:48:01 959183 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:48:01 959183 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:48:02 959183 [MainThread] [INFO ] Existing default_datastore None is being changed to vsanDatastore for tenant 04/24/17 22:48:13 959249 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:48:13 959249 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:48:13 959249 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:48:30 942108 [Thread-11] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:48:30 942108 [Thread-11] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:48:30 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/24/17 22:49:56 942108 [Thread-12] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:49:56 942108 [Thread-12] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:49:56 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/24/17 22:51:07 959670 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:51:08 959670 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:51:08 959670 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:51:08 959670 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d81f7-d886-7c9c-66f9-27c4d05875ba', 'VM_17_SVMFS')] 04/24/17 22:51:08 959670 [MainThread] [INFO ] backing disk name is photon-VM0.1/photon-VM0.1.vmdk 04/24/17 22:51:10 959681 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:51:10 959681 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:51:10 959681 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:52:15 959852 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:52:15 959852 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:52:15 959852 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:52:17 959863 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:52:17 959863 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:52:17 959863 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:52:30 959895 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/24/17 22:52:30 959895 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/24/17 22:52:30 959895 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/24/17 22:52:30 959895 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d4e04-f778-487a-5e1c-50e6215af0a5', 'VM_8_SVMFS'), ('564d81f7-d886-7c9c-66f9-27c4d05875ba', 'VM_17_SVMFS')] 04/24/17 22:52:31 959895 [MainThread] [ERROR ] Cannot complete vmgroup rm. Cannot find vm 564d4e04-f778-487a-5e1c-50e6215af0a5 04/25/17 00:41:57 975979 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 00:41:57 975979 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:41:57 975979 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:42:54 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/25/17 00:42:54 942108 [Thread-13] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:42:55 942108 [Thread-13] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:42:55 942108 [Thread-13] [WARNING] Reconnecting to the local Service Instance 04/25/17 00:42:55 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol9@vsanDatastore'}] 04/25/17 00:43:01 942108 [Thread-14] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:43:01 942108 [Thread-14] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:43:01 942108 [Thread-14] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 00:43:01 942108 [Thread-14] [INFO ] Creating directory /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28 04/25/17 00:43:01 942108 [Thread-14] [INFO ] Symlink /vmfs/volumes/sharedVmfs-0/dockvols/T1 is created to point to path /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28 04/25/17 00:43:01 942108 [Thread-14] [INFO ] Created /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28 04/25/17 00:43:01 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol6 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk)'} 04/25/17 00:43:01 942108 [Thread-15] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:43:01 942108 [Thread-15] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:43:01 942108 [Thread-15] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 00:43:01 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol6 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk)'} 04/25/17 00:43:01 942108 [Thread-16] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:43:01 942108 [Thread-16] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:43:01 942108 [Thread-16] [WARNING] Volume size not specified 04/25/17 00:43:01 942108 [Thread-16] [WARNING] Volume size not specified 04/25/17 00:43:01 942108 [Thread-16] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 00:43:01 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=94e144ec-c244-40f5-8396-3ce102014d28 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/25/17 00:43:01 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [WARNING] Volume size not specified 04/25/17 00:43:01 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'create' completed with ret=None 04/25/17 00:43:01 942108 [Thread-17] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:43:01 942108 [Thread-17] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:43:02 942108 [Thread-17] [INFO ] cmd=attach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 00:43:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 00:43:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk as independent_persistent 04/25/17 00:43:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/25/17 00:43:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/25/17 00:43:03 942108 [Thread-18] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:43:03 942108 [Thread-18] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:43:03 942108 [Thread-18] [INFO ] cmd=detach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 00:43:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 00:43:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk 04/25/17 00:43:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 00:54:56 942108 [Thread-19] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:54:57 942108 [Thread-19] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:54:57 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol9@vsanDatastore'}] 04/25/17 00:55:02 942108 [Thread-20] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:02 942108 [Thread-20] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:02 942108 [Thread-20] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:55:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 23:16:57 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '80MB'}, 'clone-from': 'None', 'datastore': 'vsanDatastore', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_8_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 00:55:02 942108 [Thread-21] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:02 942108 [Thread-21] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:02 942108 [Thread-21] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:55:02 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 23:16:57 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '80MB'}, 'clone-from': 'None', 'datastore': 'vsanDatastore', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_8_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 00:55:02 942108 [Thread-22] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:02 942108 [Thread-22] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:03 942108 [Thread-22] [INFO ] cmd=attach opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:55:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] *** attachVMDK: /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 00:55:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] Attaching /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk as independent_persistent 04/25/17 00:55:03 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [WARNING] Failed to find VM (id 564d4e04-f778-487a-5e1c-50e6215af0a5) attaching the disk /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk, resetting volume metadata 04/25/17 00:55:28 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'. disk /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk already attached to VM=564d4e04-f778-487a-5e1c-50e6215af0a5"} 04/25/17 00:55:28 942108 [Thread-23] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:29 942108 [Thread-23] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:29 977951 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 00:55:29 942108 [Thread-23] [INFO ] cmd=detach opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:55:29 977951 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:29 977951 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:29 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] *** detachVMDK: /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 00:55:29 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [WARNING] *** Detach disk=/vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol9.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 00:55:29 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 00:55:53 942108 [Thread-24] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:55:53 942108 [Thread-24] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:55:54 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol9@vsanDatastore'}] 04/25/17 00:56:17 942108 [Thread-25] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:56:17 942108 [Thread-25] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 00:56:17 942108 [Thread-25] [INFO ] executeRequest 'get' completed with ret={'Error': 'DB access error at /etc/vmware/vmdkops/auth-db: BrokenLink (Broken link or corrupted DB file)'} 04/25/17 00:56:28 978117 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 00:56:29 978117 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:56:29 978117 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:57:06 942108 [Thread-26] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:57:06 942108 [Thread-26] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:57:07 942108 [Thread-26] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:57:20 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 23:16:57 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '80MB'}, 'clone-from': 'None', 'datastore': 'vsanDatastore', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 00:59:20 978513 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 00:59:20 978513 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:59:20 978513 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:59:26 942108 [Thread-27] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 00:59:26 942108 [Thread-27] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 00:59:26 942108 [Thread-27] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 00:59:26 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 23:16:57 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '80MB'}, 'clone-from': 'None', 'datastore': 'vsanDatastore', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 01:00:22 978702 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:00:22 978702 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:22 978702 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:33 942108 [Thread-28] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:34 942108 [Thread-28] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:34 942108 [Thread-28] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 01:00:34 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol9] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 23:16:57 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '80MB'}, 'clone-from': 'None', 'datastore': 'vsanDatastore', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 01:00:39 942108 [Thread-29] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:39 942108 [Thread-29] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:39 942108 [Thread-29] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:00:39 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:00:57 942108 [Thread-30] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:58 942108 [Thread-30] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:58 942108 [Thread-30] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:00:59 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:00:59 942108 [Thread-31] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:59 942108 [Thread-31] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:59 942108 [Thread-31] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:00:59 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:00:59 942108 [Thread-32] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:00:59 942108 [Thread-32] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:00:59 942108 [Thread-32] [INFO ] cmd=attach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:00:59 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:00:59 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk as independent_persistent 04/25/17 01:00:59 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [WARNING] Failed to find VM (id 564d4e04-f778-487a-5e1c-50e6215af0a5) attaching the disk /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk, resetting volume metadata 04/25/17 01:01:18 978994 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:01:18 978994 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:01:18 978994 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:01:25 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'. disk /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk already attached to VM=564d4e04-f778-487a-5e1c-50e6215af0a5"} 04/25/17 01:01:25 942108 [Thread-33] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:01:25 942108 [Thread-33] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:01:25 942108 [Thread-33] [INFO ] cmd=detach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:01:25 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:01:25 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:01:25 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 01:01:27 979019 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:01:27 979019 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:01:27 979019 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:01:49 942108 [Thread-34] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:01:49 942108 [Thread-34] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:01:49 942108 [Thread-34] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:01:49 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:01:49 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:03:00 979251 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:03:01 979251 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:03:01 979251 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:03:30 942108 [Thread-35] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:03:30 942108 [Thread-35] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:03:31 942108 [Thread-35] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:03:31 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:04:20 979454 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:04:36 979491 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:04:44 979512 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:04:44 979512 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:04:44 979512 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:04:45 979512 [MainThread] [INFO ] Existing default_datastore None is being changed to vsanDatastore for tenant 04/25/17 01:04:50 979533 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:04:50 979533 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:04:50 979533 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:05:09 979592 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:05:09 979592 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:05:14 979592 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:05:40 979668 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:05:40 979668 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:05:40 979668 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:20 942108 [Thread-36] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:20 942108 [Thread-36] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:21 942108 [Thread-36] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:08:21 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:08:21 942108 [Thread-37] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:21 942108 [Thread-37] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:21 942108 [Thread-37] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:08:21 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:08:21 942108 [Thread-38] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:21 942108 [Thread-38] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:21 942108 [Thread-38] [INFO ] cmd=attach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:08:21 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:08:21 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk as independent_persistent 04/25/17 01:08:21 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [WARNING] Failed to find VM (id 564d4e04-f778-487a-5e1c-50e6215af0a5) attaching the disk /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk, resetting volume metadata 04/25/17 01:08:30 980087 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:08:30 980087 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:30 980087 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:39 980111 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:08:40 980111 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:40 980111 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:47 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'. disk /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk already attached to VM=564d4e04-f778-487a-5e1c-50e6215af0a5"} 04/25/17 01:08:47 942108 [Thread-39] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:47 942108 [Thread-39] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:47 942108 [Thread-39] [INFO ] cmd=detach opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:08:47 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:08:47 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:08:47 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 01:08:55 942108 [Thread-40] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:08:55 942108 [Thread-40] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:08:55 942108 [Thread-40] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:08:55 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:08:55 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:09:03 942108 [Thread-41] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:09:04 942108 [Thread-41] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:09:04 942108 [Thread-41] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=/vmfs/volumes/vsan:5243e62ab7f74c98-5b5d3cf1c7cd8091 is allowed to execute 04/25/17 01:09:04 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol6 not found (file: /vmfs/volumes/vsanDatastore/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk)'} 04/25/17 01:09:56 942108 [Thread-42] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:09:57 942108 [Thread-42] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:09:57 942108 [Thread-42] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:09:57 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/94e144ec-c244-40f5-8396-3ce102014d28/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:09:57 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:10:28 942108 [Thread-43] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:10:32 942108 [Thread-43] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:10:33 942108 [Thread-43] [INFO ] cmd=get opts={} vmgroup=T1 datastore_url=_VM_DS:// is allowed to execute 04/25/17 01:10:33 942108 [VM_17_SVMFS-sharedVmfs-0.T1.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 00:43:01 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 01:11:17 980502 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:11:17 980502 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:11:21 980502 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:11:21 980502 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d81f7-d886-7c9c-66f9-27c4d05875ba', 'VM_17_SVMFS')] 04/25/17 01:11:21 980502 [MainThread] [INFO ] backing disk name is photon-VM0.1/photon-VM0.1.vmdk 04/25/17 01:11:32 980537 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:11:32 980537 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:11:32 980537 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:11:53 942108 [Thread-44] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:11:53 942108 [Thread-44] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:11:54 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol3@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol2@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}] 04/25/17 01:22:30 982136 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:22:44 982169 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:22:49 982184 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:22:49 982184 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:22:50 982184 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:23:05 982222 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:23:05 982222 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:23:05 982222 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:23:19 982222 [MainThread] [INFO ] Existing default_datastore None is being changed to vsanDatastore for tenant 04/25/17 01:23:39 982293 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:23:39 982293 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:23:39 982293 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:24:35 942108 [Thread-45] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:24:36 942108 [Thread-45] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:24:36 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 01:25:21 982565 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:25:22 982565 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:25:22 982565 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:27:44 982899 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:27:44 982899 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:27:44 982899 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:27:44 982899 [MainThread] [INFO ] backing disk name is photon-VM0.1/photon-VM0.1.vmdk 04/25/17 01:27:56 942108 [Thread-46] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:28:09 942108 [Thread-46] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:28:10 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol3@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol2@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}] 04/25/17 01:28:24 942108 [Thread-47] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:28:24 942108 [Thread-47] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:28:24 942108 [Thread-47] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:28:24 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 22:46:22 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:28:54 942108 [Thread-48] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:28:54 942108 [Thread-48] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:28:54 942108 [Thread-48] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:28:54 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 22:46:22 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:29:23 942108 [Thread-49] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:29:24 942108 [Thread-49] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:29:25 942108 [Thread-49] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:29:25 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 22:46:22 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:29:25 942108 [Thread-50] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:29:25 942108 [Thread-50] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:29:25 942108 [Thread-50] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:29:25 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 22:46:22 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_8_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 01:29:25 942108 [Thread-51] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:29:25 942108 [Thread-51] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:29:25 942108 [Thread-51] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:29:25 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:29:25 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk as independent_persistent 04/25/17 01:29:25 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] Failed to find VM (id 564d4e04-f778-487a-5e1c-50e6215af0a5) attaching the disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk, resetting volume metadata 04/25/17 01:29:43 983319 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:29:43 983319 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:29:43 983319 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:29:51 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'. disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk already attached to VM=564d4e04-f778-487a-5e1c-50e6215af0a5"} 04/25/17 01:29:51 942108 [Thread-52] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:29:51 942108 [Thread-52] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:29:51 942108 [Thread-52] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:29:51 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:29:51 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:29:51 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 01:30:01 942108 [Thread-53] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:03 942108 [Thread-53] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:03 942108 [Thread-53] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:30:03 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:30:03 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:30:16 942108 [Thread-54] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:21 942108 [Thread-54] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:22 942108 [Thread-54] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:30:22 942108 [Thread-55] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:22 942108 [Thread-55] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:22 942108 [Thread-55] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:30:22 942108 [Thread-56] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:22 942108 [Thread-56] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:22 942108 [Thread-56] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:30:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk as independent_persistent 04/25/17 01:30:29 983617 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 01:30:29 983617 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:29 983617 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'."} 04/25/17 01:30:48 942108 [Thread-57] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:30:48 942108 [Thread-57] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:30:48 942108 [Thread-57] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:30:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:30:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:30:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 01:31:08 942108 [Thread-58] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:31:14 942108 [Thread-58] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:31:14 942108 [Thread-58] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:31:14 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:31:14 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:31:14 942108 [Thread-59] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:31:14 942108 [Thread-59] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:31:14 942108 [Thread-59] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:31:14 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:31:14 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:31:14 942108 [Thread-60] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:31:14 942108 [Thread-60] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:31:15 942108 [Thread-60] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:31:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:31:15 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk as independent_persistent 04/25/17 01:31:40 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'."} 04/25/17 01:31:40 942108 [Thread-61] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:31:45 942108 [Thread-61] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:31:46 942108 [Thread-61] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:31:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:31:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:31:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 01:31:58 942108 [Thread-62] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:31:58 942108 [Thread-62] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:31:58 942108 [Thread-62] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:31:58 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:31:58 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:31:58 942108 [Thread-63] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:32:06 942108 [Thread-63] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:32:06 942108 [Thread-63] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:32:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 01:32:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 01:32:06 942108 [Thread-64] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:32:06 942108 [Thread-64] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:32:06 942108 [Thread-64] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:32:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:32:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk as independent_persistent 04/25/17 01:32:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'attach' completed with ret={'Error': "Failed to add disk 'scsi1:0'."} 04/25/17 01:32:32 942108 [Thread-65] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 01:32:32 942108 [Thread-65] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 01:32:32 942108 [Thread-65] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 01:32:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:32:33 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 01:32:33 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 06:26:54 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/25/17 06:26:54 942108 [Thread-66] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:26:56 942108 [Thread-66] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:26:56 942108 [Thread-66] [WARNING] Reconnecting to the local Service Instance 04/25/17 06:26:56 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol3@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol2@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vo5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol4@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol5@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}] 04/25/17 06:27:30 1028109 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:27:31 1028109 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:27:31 1028109 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:12 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/25/17 06:28:12 942108 [Thread-67] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:12 942108 [Thread-67] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:12 942108 [Thread-67] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:28:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:14:15 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:28:12 942108 [Thread-68] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:12 942108 [Thread-68] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:12 942108 [Thread-68] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:28:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:14:15 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:28:12 942108 [Thread-69] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:12 942108 [Thread-69] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:13 942108 [Thread-69] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:28:13 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:28:13 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk as independent_persistent 04/25/17 06:28:13 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/25/17 06:28:13 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/25/17 06:28:18 1028252 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:28:20 1028252 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:20 1028252 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:36 942108 [Thread-70] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:36 942108 [Thread-70] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:28:36 942108 [Thread-70] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:28:36 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:28:36 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 06:28:36 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 06:28:41 1028303 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:28:41 1028303 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:28:41 1028303 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:09 942108 [Thread-71] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:10 942108 [Thread-71] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:10 942108 [Thread-71] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo5] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:54:18 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:29:10 942108 [Thread-72] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:10 942108 [Thread-72] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:10 942108 [Thread-72] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo5] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo5.vmdk 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo5] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo5.vmdk 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo5] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:10 942108 [Thread-73] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:10 942108 [Thread-73] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:10 942108 [Thread-73] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:54:11 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:29:10 942108 [Thread-74] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:10 942108 [Thread-74] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:10 942108 [Thread-74] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk 04/25/17 06:29:10 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vo4.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vo4] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:11 942108 [Thread-75] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-75] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-75] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:24:09 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '10GB', 'allocated': '81MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:29:11 942108 [Thread-76] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-76] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-76] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:11 942108 [Thread-77] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-77] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-77] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol3] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:24:09 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '10GB', 'allocated': '81MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:29:11 942108 [Thread-78] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-78] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-78] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol3] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol3.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol3] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol3.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol3] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:11 942108 [Thread-79] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-79] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-79] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 21:01:06 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:29:11 942108 [Thread-80] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:11 942108 [Thread-80] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:11 942108 [Thread-80] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk 04/25/17 06:29:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol4.vmdk 04/25/17 06:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol4] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:12 942108 [Thread-81] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:12 942108 [Thread-81] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:12 942108 [Thread-81] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol5] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 21:01:13 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:29:12 942108 [Thread-82] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:12 942108 [Thread-82] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:12 942108 [Thread-82] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol5] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol5.vmdk 04/25/17 06:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol5] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol5.vmdk 04/25/17 06:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol5] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:29:16 942108 [Thread-83] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:16 942108 [Thread-83] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:16 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol7@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}] 04/25/17 06:29:35 942108 [Thread-84] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:35 942108 [Thread-84] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:35 942108 [Thread-84] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:35 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk (Required field "uuid" not provided (not @optional)) 04/25/17 06:29:35 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 06:29:35 942108 [Thread-85] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:41 942108 [Thread-85] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:41 942108 [Thread-85] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:29:41 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:29:41 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:29:45 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:29:50 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:29:55 1028483 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:29:55 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:29:56 1028483 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:29:56 1028483 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:29:56 1028483 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:30:00 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:30:06 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] Failed to clean /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk file: {'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 06:30:11 942108 [Thread-86] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:30:11 942108 [Thread-86] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:30:11 942108 [Thread-86] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol7] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 22:46:25 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:30:11 942108 [Thread-87] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:30:11 942108 [Thread-87] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:30:11 942108 [Thread-87] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol7] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol7.vmdk 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol7] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol7.vmdk 04/25/17 06:30:11 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol7] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:31:09 942108 [Thread-88] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:31:09 942108 [Thread-88] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:31:09 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}] 04/25/17 06:31:18 942108 [Thread-89] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:31:18 942108 [Thread-89] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:31:18 942108 [Thread-89] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:31:18 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:31:18 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk ('NoneType' object is not subscriptable) 04/25/17 06:31:18 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 06:31:18 942108 [Thread-90] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:31:18 942108 [Thread-90] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:31:19 942108 [Thread-90] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:31:19 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:19 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:31:19 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:23 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:28 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:33 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:38 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:43 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 06:31:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [WARNING] Failed to clean /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk file: {'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 06:31:48 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 06:32:21 942108 [Thread-91] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:32:22 942108 [Thread-91] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:32:22 942108 [Thread-91] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:32:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Mon Apr 24 20:14:15 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_8_SVMFS', 'access': 'read-write'} 04/25/17 06:32:22 942108 [Thread-92] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:32:22 942108 [Thread-92] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:32:22 942108 [Thread-92] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:32:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 06:32:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 06:32:22 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'remove' completed with ret=None 04/25/17 06:32:34 942108 [Thread-93] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:32:34 942108 [Thread-93] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:32:35 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}] 04/25/17 06:33:44 942108 [Thread-94] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:46 942108 [Thread-94] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:46 942108 [Thread-94] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk)'} 04/25/17 06:33:46 942108 [Thread-95] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:46 942108 [Thread-95] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:46 942108 [Thread-95] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk)'} 04/25/17 06:33:46 942108 [Thread-96] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:46 942108 [Thread-96] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:46 942108 [Thread-96] [WARNING] Volume size not specified 04/25/17 06:33:46 942108 [Thread-96] [WARNING] Volume size not specified 04/25/17 06:33:46 942108 [Thread-96] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/25/17 06:33:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [WARNING] Volume size not specified 04/25/17 06:33:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'create' completed with ret=None 04/25/17 06:33:46 942108 [Thread-97] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:47 942108 [Thread-97] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:47 942108 [Thread-97] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk as independent_persistent 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/25/17 06:33:47 942108 [Thread-98] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:47 942108 [Thread-98] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:47 942108 [Thread-98] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 06:33:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 06:33:55 942108 [Thread-99] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:33:55 942108 [Thread-99] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:33:56 942108 [Thread-99] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:33:56 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:36:10 1029461 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:36:10 1029461 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:36:14 1029461 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:36:14 1029461 [MainThread] [ERROR ] Cannot complete vmgroup vm replace. Cannot find vm 564d4e04-f778-487a-5e1c-50e6215af0a5 04/25/17 06:36:57 1029560 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:36:57 1029560 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:36:58 1029560 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:39:04 942108 [Thread-100] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:39:04 942108 [Thread-100] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:39:04 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}] 04/25/17 06:39:29 942108 [Thread-101] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:39:31 942108 [Thread-101] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:39:31 942108 [Thread-101] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:39:31 942108 [Thread-102] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:39:31 942108 [Thread-102] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:39:31 942108 [Thread-102] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'detached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'diskformat': 'thin', 'created by VM': 'VM_17_SVMFS', 'access': 'read-write'} 04/25/17 06:39:31 942108 [Thread-103] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:39:31 942108 [Thread-103] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:39:31 942108 [Thread-103] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk as independent_persistent 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk successfully attached. controller pci_slot_number=160, disk_slot=0 04/25/17 06:39:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '0'} 04/25/17 06:40:09 1030048 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:40:09 1030048 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:40:09 1030048 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:40:09 1030048 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:40:32 1030100 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:40:32 1030100 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:40:33 1030100 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:41:29 1030227 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:41:29 1030227 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:41:29 1030227 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:41:31 1030227 [MainThread] [INFO ] Existing default_datastore None is being changed to sharedVmfs-0 for tenant 04/25/17 06:41:36 1030246 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:41:36 1030246 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:41:36 1030246 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:41:49 1030278 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:41:49 1030278 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:41:49 1030278 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:41:49 1030278 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:42:00 942108 [Thread-104] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:42:00 942108 [Thread-104] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:42:00 942108 [Thread-104] [INFO ] cmd=detach opts={} vmgroup=T2 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:42:00 942108 [Thread-104] [INFO ] Creating directory /vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355 04/25/17 06:42:00 942108 [Thread-104] [INFO ] Symlink /vmfs/volumes/sharedVmfs-0/dockvols/T2 is created to point to path /vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355 04/25/17 06:42:00 942108 [Thread-104] [INFO ] Created /vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355 04/25/17 06:42:00 942108 [VM_17_SVMFS-sharedVmfs-0.T2.vol1] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355/vol1.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:42:00 942108 [VM_17_SVMFS-sharedVmfs-0.T2.vol1] [WARNING] *** Detach disk=/vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355/vol1.vmdk not found. VM=564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 06:42:00 942108 [VM_17_SVMFS-sharedVmfs-0.T2.vol1] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 06:42:06 942108 [Thread-105] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:42:06 942108 [Thread-105] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:42:06 942108 [Thread-105] [INFO ] cmd=get opts={} vmgroup=T2 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:42:06 942108 [VM_17_SVMFS-sharedVmfs-0.T2.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/62c6b902-4d24-472b-b4ae-a181d1882355/vol1.vmdk)'} 04/25/17 06:42:11 942108 [Thread-106] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:42:11 942108 [Thread-106] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:42:12 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 06:42:29 1030404 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:42:29 1030404 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:42:29 1030404 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:42:29 1030404 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 06:43:14 1030499 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 06:43:14 1030499 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:43:14 1030499 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:43:14 1030499 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d81f7-d886-7c9c-66f9-27c4d05875ba', 'VM_17_SVMFS')] 04/25/17 06:43:14 1030499 [MainThread] [INFO ] backing disk name is photon-VM0.1/photon-VM0.1.vmdk 04/25/17 06:43:14 1030499 [MainThread] [INFO ] backing disk name is dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 06:43:14 1030499 [MainThread] [ERROR ] Cannot complete vmgroup rm. VM 'VM_17_SVMFS' has volumes mounted. 04/25/17 06:45:35 942108 [Thread-107] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:45:35 942108 [Thread-107] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:45:35 942108 [VM_17_SVMFS_1-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}] 04/25/17 06:45:49 942108 [Thread-108] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:45:49 942108 [Thread-108] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:45:49 942108 [Thread-108] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 06:45:49 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_17_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 06:45:57 942108 [Thread-109] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 06:46:02 942108 [Thread-109] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 06:46:02 942108 [Thread-109] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 06:46:02 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_17_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 07:01:05 942108 [Thread-110] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 07:01:05 942108 [Thread-110] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 07:01:06 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 07:01:12 942108 [Thread-111] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 07:01:12 942108 [Thread-111] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 07:01:12 942108 [VM_17_SVMFS_1-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}] 04/25/17 07:01:16 942108 [Thread-112] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 07:01:16 942108 [Thread-112] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 07:01:16 942108 [Thread-112] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 07:01:16 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_17_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 07:03:35 1033596 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 07:03:36 1033596 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 07:03:36 1033596 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 07:03:36 1033596 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 19:10:17 1142003 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:10:19 1142003 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:10:19 1142003 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:10:19 1142003 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 19:10:27 1142030 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:10:27 1142030 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:10:27 1142030 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:10:37 1142054 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:10:37 1142054 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:10:37 1142054 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:10:37 1142054 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d4e04-f778-487a-5e1c-50e6215af0a5', 'VM_8_SVMFS')] 04/25/17 19:10:37 1142054 [MainThread] [ERROR ] Cannot complete vmgroup rm. Cannot find vm 564d4e04-f778-487a-5e1c-50e6215af0a5 04/25/17 19:10:40 1142067 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:10:41 1142067 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:10:41 1142067 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:10:41 1142067 [MainThread] [INFO ] _tenant_rm. VMs in tenant are [('564d81f7-d886-7c9c-66f9-27c4d05875ba', 'VM_17_SVMFS')] 04/25/17 19:10:41 1142067 [MainThread] [INFO ] backing disk name is photon-VM0.1/photon-VM0.1.vmdk 04/25/17 19:10:41 1142067 [MainThread] [INFO ] backing disk name is dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 19:10:41 1142067 [MainThread] [ERROR ] Cannot complete vmgroup rm. VM 'VM_17_SVMFS' has volumes mounted. 04/25/17 19:11:04 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/25/17 19:11:04 942108 [Thread-113] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:06 942108 [Thread-113] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:06 942108 [VM_17_SVMFS-nolock-list] [WARNING] Reconnecting to the local Service Instance 04/25/17 19:11:07 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 19:11:10 942108 [Thread-114] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:10 942108 [Thread-114] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:10 942108 [VM_17_SVMFS_1-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Attributes': {}, 'Name': 'vol6@sharedVmfs-0'}, {'Attributes': {}, 'Name': 'vol1@sharedVmfs-0'}] 04/25/17 19:11:16 942108 [Thread-115] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:18 942108 [Thread-115] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:18 942108 [Thread-115] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:11:19 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'created': 'Tue Apr 25 06:33:46 2017', 'status': 'attached', 'fstype': 'ext4', 'attach-as': 'independent_persistent', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'clone-from': 'None', 'datastore': 'sharedVmfs-0', 'attached to VM': 'VM_17_SVMFS', 'created by VM': 'VM_17_SVMFS', 'diskformat': 'thin', 'access': 'read-write'} 04/25/17 19:11:19 942108 [Thread-116] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:19 942108 [Thread-116] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:19 942108 [Thread-116] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:11:19 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk 04/25/17 19:11:19 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [WARNING] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk already attached to VM=VM_17_SVMFS 04/25/17 19:11:19 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk is in use, VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba ({'Error': 'Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk already attached to VM=VM_17_SVMFS'}) 04/25/17 19:11:19 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk, in use by VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba.'} 04/25/17 19:11:22 942108 [Thread-117] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:22 942108 [Thread-117] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:22 942108 [Thread-117] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk ('NoneType' object is not subscriptable) 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 19:11:22 942108 [Thread-118] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:22 942108 [Thread-118] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:22 942108 [Thread-118] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 19:11:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:26 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:27 942108 [Thread-119] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:11:27 942108 [Thread-119] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:11:28 942108 [Thread-119] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:11:31 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:37 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:42 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:47 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] Failed to clean /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk file: {'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] vmci_reply returned error Broken pipe (errno=32) 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6-a76337ccf32bc0c1.vmfd' 04/25/17 19:11:52 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] *** cleanVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:11:56 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:12:01 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:12:07 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:12:12 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:12:17 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] *** removeVMDK: Retrying removal on error: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk 04/25/17 19:12:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [WARNING] Failed to clean /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk file: {'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 19:12:22 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol6] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume: Error caused by file /vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe/dockvols/11111111-1111-1111-1111-111111111111/vol6.vmdk'} 04/25/17 19:12:51 942108 [Thread-120] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:12:53 942108 [Thread-120] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:12:53 942108 [Thread-120] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 19:12:58 942108 [Thread-121] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:12:58 942108 [Thread-121] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:12:58 942108 [Thread-121] [INFO ] executeRequest 'list' completed with ret=[] 04/25/17 19:13:10 1142455 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:13:10 1142455 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:13:10 1142455 [MainThread] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:13:18 1142476 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:13:28 1142499 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:13:28 1142499 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:13:28 1142499 [MainThread] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:13:42 1142534 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:13:44 1142534 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:13:45 1142534 [MainThread] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:13:57 1142593 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:13:57 1142593 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:13:58 1142593 [MainThread] [ERROR ] Config DB broken link: /etc/vmware/vmdkops/auth-db 04/25/17 19:16:05 1142969 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:16:26 1143018 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:16:32 1143035 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:16:32 942108 [MainThread] [WARNING] Received signal num: 10, restarting. 04/25/17 19:16:32 942108 [MainThread] [WARNING] Operations in flight will be terminated 04/25/17 19:16:32 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/25/17 19:16:32 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/25/17 19:16:32 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:18:19 1143301 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:18:29 1143326 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:18:29 1143326 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:18:29 1143326 [MainThread] [INFO ] Config DB does not exist. mode NotConfigured 04/25/17 19:18:29 1143326 [MainThread] [INFO ] Auth DB /etc/vmware/vmdkops/auth-db is missing, allowing all access 04/25/17 19:18:33 942108 [MainThread] [WARNING] Received signal num: 10, restarting. 04/25/17 19:18:33 942108 [MainThread] [WARNING] Operations in flight will be terminated 04/25/17 19:18:33 942108 [MainThread] [INFO ] ==== Starting vmdkops service pid=942108 ==== 04/25/17 19:18:33 942108 [MainThread] [INFO ] Loading VMCI server lib. 04/25/17 19:18:33 942108 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:26:34 1144509 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:26:34 1144509 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:34 1144509 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:42 942108 [MainThread] [WARNING] Reconnecting to the local Service Instance 04/25/17 19:26:42 942108 [Thread-1] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:26:43 942108 [Thread-1] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:43 942108 [Thread-1] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:43 942108 [Thread-1] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:43 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk)'} 04/25/17 19:26:43 942108 [Thread-2] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:49 942108 [Thread-2] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:49 942108 [Thread-2] [WARNING] Volume size not specified 04/25/17 19:26:49 942108 [Thread-2] [WARNING] Volume size not specified 04/25/17 19:26:49 942108 [Thread-2] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:49 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/25/17 19:26:49 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'create' completed with ret={'Error': 'Failed to create volume: Cannot complete the operation because the file or folder [sharedVmfs-0] dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk already exists'} 04/25/17 19:26:55 942108 [Thread-3] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:55 942108 [Thread-3] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:55 942108 [Thread-3] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:55 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol2 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk)'} 04/25/17 19:26:55 942108 [Thread-4] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:55 942108 [Thread-4] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:55 942108 [Thread-4] [WARNING] Volume size not specified 04/25/17 19:26:55 942108 [Thread-4] [WARNING] Volume size not specified 04/25/17 19:26:55 942108 [Thread-4] [INFO ] cmd=create opts={'fstype': 'ext4'} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:55 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** createVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk opts = {'fstype': 'ext4'} vm_name=VM_17_SVMFS tenant_uuid=11111111-1111-1111-1111-111111111111 datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe 04/25/17 19:26:55 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [WARNING] Volume size not specified 04/25/17 19:26:55 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'create' completed with ret=None 04/25/17 19:26:56 942108 [Thread-5] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:56 942108 [Thread-5] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:56 942108 [Thread-5] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:56 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 19:26:56 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk as independent_persistent 04/25/17 19:26:56 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk successfully attached. controller pci_slot_number=160, disk_slot=1 04/25/17 19:26:56 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '1'} 04/25/17 19:26:56 942108 [Thread-6] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:26:58 942108 [Thread-6] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:26:58 942108 [Thread-6] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=_VM_DS:// is allowed to execute 04/25/17 19:26:58 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 19:26:58 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/25/17 19:26:58 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 19:27:01 942108 [Thread-7] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:27:01 942108 [Thread-7] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:27:01 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Name': 'vol2@sharedVmfs-0', 'Attributes': {}}] 04/25/17 19:28:30 1144795 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:28:32 1144795 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:28:32 1144795 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:28:44 942108 [Thread-8] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:28:46 942108 [Thread-8] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:28:46 942108 [Thread-8] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:28:46 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk)'} 04/25/17 19:28:47 942108 [Thread-9] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:28:47 942108 [Thread-9] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:28:47 942108 [Thread-9] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:28:47 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol1] [INFO ] executeRequest 'get' completed with ret={'Error': 'Volume vol1 not found (file: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol1.vmdk)'} 04/25/17 19:28:49 942108 [Thread-10] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:28:49 942108 [Thread-10] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:28:49 942108 [VM_17_SVMFS_1-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Name': 'vol2@sharedVmfs-0', 'Attributes': {}}] 04/25/17 19:28:59 942108 [Thread-11] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:28:59 942108 [Thread-11] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:28:59 942108 [Thread-11] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:28:59 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'attach-as': 'independent_persistent', 'status': 'detached', 'fstype': 'ext4', 'diskformat': 'thin', 'datastore': 'sharedVmfs-0', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:29:11 942108 [Thread-12] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:29:11 942108 [Thread-12] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:29:12 942108 [Thread-12] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'attach-as': 'independent_persistent', 'status': 'detached', 'fstype': 'ext4', 'diskformat': 'thin', 'datastore': 'sharedVmfs-0', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:29:12 942108 [Thread-13] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:29:12 942108 [Thread-13] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:29:12 942108 [Thread-13] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '13MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'attach-as': 'independent_persistent', 'status': 'detached', 'fstype': 'ext4', 'diskformat': 'thin', 'datastore': 'sharedVmfs-0', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:29:12 942108 [Thread-14] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:29:12 942108 [Thread-14] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:29:12 942108 [Thread-14] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk as independent_persistent 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk successfully attached. controller pci_slot_number=160, disk_slot=1 04/25/17 19:29:12 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '1'} 04/25/17 19:29:25 942108 [Thread-15] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:29:27 942108 [Thread-15] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:29:28 942108 [Thread-15] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:29:28 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'diskformat': 'thin', 'status': 'attached', 'fstype': 'ext4', 'attached to VM': 'VM_17_SVMFS', 'datastore': 'sharedVmfs-0', 'attach-as': 'independent_persistent', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:30:54 942108 [Thread-16] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:30:56 942108 [Thread-16] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:30:57 942108 [Thread-16] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:30:57 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'diskformat': 'thin', 'status': 'attached', 'fstype': 'ext4', 'attached to VM': 'VM_17_SVMFS', 'datastore': 'sharedVmfs-0', 'attach-as': 'independent_persistent', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:30:57 942108 [Thread-17] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:30:57 942108 [Thread-17] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:30:57 942108 [Thread-17] [INFO ] cmd=remove opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:30:57 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/25/17 19:30:57 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [WARNING] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk already attached to VM=VM_17_SVMFS 04/25/17 19:30:57 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** removeVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk is in use, VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba ({'Error': 'Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk already attached to VM=VM_17_SVMFS'}) 04/25/17 19:30:57 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'remove' completed with ret={'Error': 'Failed to remove volume /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk, in use by VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba.'} 04/25/17 19:31:07 942108 [Thread-18] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:31:07 942108 [Thread-18] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:31:08 942108 [VM_17_SVMFS_1-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Name': 'vol2@sharedVmfs-0', 'Attributes': {}}] 04/25/17 19:31:11 942108 [Thread-19] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:31:11 942108 [Thread-19] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:31:11 942108 [Thread-19] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:31:11 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret={'clone-from': 'None', 'capacity': {'size': '100MB', 'allocated': '15MB'}, 'created': 'Tue Apr 25 19:26:55 2017', 'access': 'read-write', 'diskformat': 'thin', 'status': 'attached', 'fstype': 'ext4', 'attached to VM': 'VM_17_SVMFS', 'datastore': 'sharedVmfs-0', 'attach-as': 'independent_persistent', 'created by VM': 'VM_17_SVMFS'} 04/25/17 19:31:21 1145237 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:31:22 1145237 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:31:22 1145237 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:32:07 1145372 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:32:08 1145372 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:32:27 1145415 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:32:28 1145415 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:32:32 1145415 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:32:32 1145415 [MainThread] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2-2204c79fe109d3ae.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2-2204c79fe109d3ae.vmfd' 04/25/17 19:33:18 942108 [Thread-20] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:19 942108 [Thread-20] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:33:19 942108 [Thread-20] [INFO ] cmd=detach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:33:19 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** detachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk from VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 19:33:19 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [ERROR ] Failed to access b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2-2204c79fe109d3ae.vmfd' Traceback (most recent call last): File "/usr/lib/vmware/vmdkops/Python/kvESX.py", line 265, in load with open(meta_file, "r") as fh: FileNotFoundError: [Errno 2] No such file or directory: b'/vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2-2204c79fe109d3ae.vmfd' 04/25/17 19:33:20 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk detached /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk 04/25/17 19:33:20 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'detach' completed with ret=None 04/25/17 19:33:23 942108 [Thread-21] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:23 942108 [Thread-21] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:33:23 942108 [VM_17_SVMFS-nolock-list] [INFO ] executeRequest 'list' completed with ret=[{'Name': 'vol2@sharedVmfs-0', 'Attributes': {}}] 04/25/17 19:33:30 942108 [Thread-22] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:31 942108 [Thread-22] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:33:31 942108 [Thread-22] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:33:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk ('created-by') 04/25/17 19:33:31 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 19:33:31 942108 [Thread-23] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:31 942108 [Thread-23] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:33:32 942108 [Thread-23] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk ('created-by') 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret=None 04/25/17 19:33:32 942108 [Thread-24] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:32 942108 [Thread-24] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:33:32 942108 [Thread-24] [INFO ] cmd=attach opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] *** attachVMDK: /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk to VM_17_SVMFS VM uuid = 564d81f7-d886-7c9c-66f9-27c4d05875ba 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Attaching /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk as independent_persistent 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] Disk /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk successfully attached. controller pci_slot_number=160, disk_slot=1 04/25/17 19:33:32 942108 [VM_17_SVMFS-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'attach' completed with ret={'ControllerPciSlotNumber': '160', 'Unit': '1'} 04/25/17 19:33:47 1145587 [MainThread] [INFO ] Connecting to the local Service Instance as 'dcui' 04/25/17 19:33:48 1145587 [MainThread] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:33:48 1145587 [MainThread] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:34:06 942108 [Thread-25] [INFO ] Checking DB mode for /etc/vmware/vmdkops/auth-db... 04/25/17 19:34:07 942108 [Thread-25] [INFO ] Config DB found. maj_ver=1 min_ver=2 mode MultiNode 04/25/17 19:34:07 942108 [Thread-25] [INFO ] cmd=get opts={} vmgroup=_DEFAULT datastore_url=/vmfs/volumes/58f90ff7-dc27eee6-2501-020035a84afe is allowed to execute 04/25/17 19:34:07 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [ERROR ] Failed to get disk details for /vmfs/volumes/sharedVmfs-0/dockvols/11111111-1111-1111-1111-111111111111/vol2.vmdk ('created-by') 04/25/17 19:34:07 942108 [VM_17_SVMFS_1-sharedVmfs-0._DEFAULT.vol2] [INFO ] executeRequest 'get' completed with ret=None