CloudStack Backup & Recovery Framework by yadvr · Pull Request #3553 · apache/cloudstack

yadvr · 2019-08-13T17:34:10Z

This framework provides CloudStack users the ability to backup their guest VMs for recovery purposes, in case they suffer a hardware or software issue with their instances or the underlying infrastructure. This framework allows CloudStack to be integrated with Backup and Recovery providers, as pluggable solutions. Each provider should implement the backup and recovery methods provided by the framework in their own way.

FS: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Backup+and+Recovery+Framework
Doc: apache/cloudstack-documentation#85
Primate/UI: apache/cloudstack-primate#64

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

svenvogel · 2019-09-11T20:26:29Z

@rhtyd small questions. which provider does this mean? Veeam?

yadvr · 2019-09-11T20:53:12Z

@svenvogel yes Veeam is a supported provider plugin

This introduces a new framework that provides CloudStack users the ability to backup their guest VMs for recovery purposes, in case they suffer a hardware or software issue with their instances or the underlying infrastructure. This framework allows CloudStack to be integrated with Backup and Recovery providers, as pluggable solutions. Each provider must implement the backup and recovery methods provided by the framework in their own way. Two B&R plugins ship with this change: - Veeam B&R: for VMware - Dummy: for testing purposes FS: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Backup+and+Recovery+Framework Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr · 2020-02-26T09:42:35Z

@blueorangutan package

blueorangutan · 2020-02-26T09:43:18Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-26T10:15:50Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-950

yadvr · 2020-02-26T10:27:54Z

@blueorangutan test

blueorangutan · 2020-02-26T10:28:18Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr · 2020-02-26T14:51:11Z

@blueorangutan package

blueorangutan · 2020-02-26T14:51:19Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-26T15:18:44Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-956

yadvr · 2020-02-26T15:27:37Z

@blueorangutan test centos7 vmware-65u3

blueorangutan · 2020-02-26T15:28:19Z

@rhtyd unsupported parameters provided. Supported mgmt server os are: centos6, centos7, ubuntu. Supported hypervisors are: kvm-centos6, kvm-centos7, kvm-ubuntu, xenserver-71, xenserver-65sp1, xenserver-62sp1, vmware-67u3, vmware-65u2, vmware-60u2, vmware-55u3, vmware-51u1, vmware-50u1

yadvr · 2020-02-26T15:30:17Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2020-02-26T15:31:19Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

blueorangutan · 2020-02-26T18:54:56Z

Trillian test result (tid-1129)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28934 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1129-kvm-centos7.zip
Smoke tests completed. 81 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2020-02-27T01:59:40Z

Trillian test result (tid-1135)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36067 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1135-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 76 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

DaanHoogland · 2020-02-27T09:22:17Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2020-02-27T09:22:22Z

@DaanHoogland a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2020-02-27T18:01:33Z

Trillian test result (tid-1141)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29948 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1141-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_nic.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Smoke tests completed. 79 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_nic	`Error`	69.54	test_nic.py
test_01_scale_vm	`Failure`	19.63	test_scale_vm.py

yadvr · 2020-02-28T08:32:08Z

I see a new nic related error but I'm not sure it's due to B&R changes cc @DaanHoogland I'll kick test again
@blueorangutan package

blueorangutan · 2020-02-28T08:32:27Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-02-28T08:56:36Z

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-968

yadvr · 2020-02-28T09:02:31Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2020-02-28T09:03:26Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2020-02-28T18:18:13Z

Trillian test result (tid-1145)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31922 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3553-t1145-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 80 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_scale_vm	`Failure`	18.52	test_scale_vm.py

DaanHoogland · 2020-02-28T18:27:24Z

i saw the nic error in #3847 (comment) as well, and it passed just now. I think we are good to merge, @PaulAngus ?

DaanHoogland

code lgtm (even when this big)
Tested extensively as admin and normal user from UI and with API.
caveat: basic zones not tested because of #3031

yadvr added component:vmware component:primary-storage status:work-in-progress type:new-feature labels Aug 13, 2019

yadvr added this to the 4.14.0.0 milestone Aug 13, 2019

DaanHoogland closed this Nov 7, 2019

DaanHoogland reopened this Nov 7, 2019

yadvr self-assigned this Nov 19, 2019

yadvr force-pushed the bckuprecframework branch 2 times, most recently from 50d084f to 0c1969a Compare November 19, 2019 09:41

yadvr added 3 commits November 20, 2019 13:28

remove id req.

6e8778b

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

apidoc: fix section name

b75f35e

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr force-pushed the bckuprecframework branch from 68ac065 to b75f35e Compare November 20, 2019 08:00

yadvr added 14 commits November 20, 2019 13:50

don't allow duplicates by name in the same zone

21509bd

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

implement the asyncjob based scheduler design in db

3edec49

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework

6646353

fix missing methods

f1b957b

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

schedule apis

cff613d

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

more apis, backend support and refactorings

9f6a2e6

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

add assignment/removal APIs

4e1cf0d

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework

5a0bdb1

Merge remote-tracking branch 'origin/master' into bckuprecframework

97b7b69

Merge remote-tracking branch 'origin/master' into bckuprecframework

e536282

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

list api pagination and searching etc.

a2e6452

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

api layer changes and refactorings

50c44a6

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

minor fixes

33d580d

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

fix deletion corner cases

73f3d58

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr added 3 commits February 26, 2020 20:03

make pipe explicit, guard within parenthesis

9b0afed

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Merge remote-tracking branch 'origin/master' into bckuprecframework

a461606

escape powershell pipe character

b850ba7

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

DaanHoogland mentioned this pull request Feb 29, 2020

VR: Fix Redundant VRouter guest network on wrong interface #3847

Merged

7 tasks

DaanHoogland approved these changes Mar 3, 2020

View reviewed changes

abh1sar mentioned this pull request Jul 25, 2025

Create new Instance from VM backup #10140

Merged

14 tasks

Conversation

yadvr commented Aug 13, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Types of changes

Uh oh!

svenvogel commented Sep 11, 2019

Uh oh!

yadvr commented Sep 11, 2019

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

yadvr commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 26, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

DaanHoogland commented Feb 27, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

blueorangutan commented Feb 27, 2020

Uh oh!

yadvr commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

yadvr commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

blueorangutan commented Feb 28, 2020

Uh oh!

DaanHoogland commented Feb 28, 2020

Uh oh!

DaanHoogland left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

yadvr commented Aug 13, 2019 •

edited

Loading