Automatic Backup of VMs on ODA X5-2

I was looking for the best practice to backup ODA X5-2 guest VMs and found this post on OTN. Got lots of helpful info, but did not find an automatic way to backup the VMs. It's an old post, so I post my solution here.  Credits to many people replied to the above post .


Ref: ODAVP: HowTo backup/restore your VM Guest (Doc ID 1633166.1)


# cat backupGuestVM.sh


#!/bin/bash
# backupGuestVM.sh
# Description: Used to backup guest VM and it's vDisk.
#
# Modification History
#   10/13/2016 jx  Created
#
#-------------------------------------------------------------------------------
if [ ! $# -gt 0 ]; then
    echo "Usage: $0 all"
    echo "   or: $0 [gVM1 | gVM1 gVM2 ...]"
    exit;
fi
# Variables and functions
lpCnt=0
ttlLp=100
secWait=20
arDir=/cloudfs/backup
#arDir=/u02/app/oracle/oradata/datfinmprod
srcDir=u01/app/sharedrepo
logFile=/tmp/backupGuestVM.log
execOakCmd() {
    local oakAct=$1
    local vmList=$2
    local pidList=""
    echo "local cmd: =$oakAct=, vmList: =$vmList=..." | tee -a $logFile
    for aVM in $vmList; do
        cmd="oakcli $oakAct vm $aVM"
        echo "cmd is: =$cmd=..." | tee -a $logFile
        $cmd &
        pidList="$pidList $!"
    done
    echo "oak cmd $oakAct waiting list: =$pidList=..." | tee -a $logFile
    wait $pidList
}
#------------------------------------------------------------------------------
# Create a timestamp in a logfile
echo "backup guest VMs started at `date`..." | tee $logFile
# Create backup directory
todayStr=`date +'%Y%m%d'`
[ ! -d "$arDir/$todayStr" ] && ( mkdir $arDir/$todayStr || exit )
inVMs=$*
echo "passed in these VMs: =$inVMs=..." | tee -a $logFile
# Check if the passed in VMs are valid resources
vmLst=$inVMs
allVMLst=$( oakcli show vm|cut -f 2 -|grep -v NAME|tr -s '\n' ' ' | xargs )
if [ "$inVMs" = "all" ]; then
    vmLst=$allVMLst
else
    for aVM in $inVMs; do
        echo "$allVMLst" | grep -i $aVM
        if [ ! $? -eq 0 ]; then
            vmLst=${vmLst/$aVM/}
        fi
    done
    vmLst=$( echo $vmLst | awk '{$1=$1};1' )
fi
echo "valid VM list =$vmLst=..." | tee -a $logFile

# vm list is not null or empty, continue....
#------------------------------------------------------------------------------
if [ ! -z "$vmLst" -a "$vmLst" != " " ]; then
    # stop all the guest VMs
    echo "stop all the vm start at `date`..." | tee -a $logFile
    execOakCmd "stop" "$vmLst"
    # make sure all the VMs are offline
    vmArr=( $vmLst )
    vmCnt=${#vmArr[@]}
    echo "vmCnt: =$vmCnt=..." | tee -a $logFile
    # to prevent infinite loop, loop only 100 times
    while [[ $vmCnt -gt 0 && $lpCnt -lt $ttlLp ]]; do
        lpCnt=$[$lpCnt+1]
        for aVM in $vmLst; do
            isOffln=$( oakcli show vm | grep $aVM | grep OFFLINE )
            vmStatus=$( echo $? )
            if [ "$vmStatus" = "1" ]; then
                echo "Waiting $secWait seconds for =$aVM= vm goes offline ..." | tee -a $logFile
                sleep $secWait
            else
                vmCnt=$[$vmCnt-1]
            fi
        done
        echo "Waiting loop, current count: =$lpCnt=..." | tee -a $logFile
    done
    echo "All VMs are now offline at `date`...lpCnt: =$lpCnt=, vmCnt: =$vmCnt=..." |tee -a $logFile
# All VMs in the list are offline, do backup now....
#-------------------------------------------------------------------------------
    pidLst=""
    echo "create archives start at `date`..." |tee -a $logFile
    for aVM in $vmLst; do
        vmRepo=$( oakcli show vm | grep -i $aVM | cut -f 7 | awk '{$1=$1};1' )
        echo "vm: =$aVM=, repo: =$vmRepo=..." | tee -a $logFile
        dirLst=$( dir -d /$srcDir/$vmRepo/.ACFS/snaps/*$aVM* )
        for aDir in $dirLst; do
            # tar file name
            arName=${aDir##*"/"}
            arName=${arName#"oakvdk_"}
            arFile="$arDir/$todayStr/$arName.tar.gz"
            # source directory
            inFile=${aDir#"/"}
            tarCmd="tar -czf $arFile -C / $inFile"
            echo "Starting tar command =$tarCmd=... " | tee -a $logFile
            $tarCmd &
            pidLst="$pidLst $!"
        done; # loop thru the directories this vm has, which could be vm itself and vdisks;
    done; # loop thru the vmList
    echo "tar waiting list: =$pidLst=..." | tee -a $logFile
    wait $pidLst
    echo "All backups are done. Time at `date`."  | tee -a $logFile
    # After all backup done, start the VMs again
    execOakCmd "start" "$vmLst"
fi; # vmLst is not null or space
echo "backup succeeded at `date`." | tee -a $logFile

Find the ODA Memory Allocation

To find out the ODA BASE memory allocation, on DOM0, you can use oakcli show oda_base command:

# oakcli show oda_base
ODA base domain
ODA base CPU cores      :8
ODA base domain memory  :64
ODA base template       :/OVS/oda_base_12.1.2.7.gz
ODA base vlans          :['net1', 'net2', 'vlan321', 'vbr1']
ODA base current status :Running

When deploy the ODA, you decide how much memory to allocate to the ODA base and the rest will be used for VMs or set aside for future growth. In the above example, it was allocated 64G for the ODA_BASE.

Use xm info to find out the available memories on the ODA.

# xm info
xm info
host                   :
release                : 2.6.39-400.276.1.el5uek
version                : #1 SMP Wed Jan 27 15:31:57 PST 2016
machine                : x86_64
nr_cpus                : 72
nr_nodes               : 2
cores_per_socket       : 18
threads_per_core       : 2
cpu_mhz                : 2294
hw_caps                : bfebfbff:2c100800:00000000:00007f40:73fefbff:00000000:00000021:000037ab
virt_caps              : hvm hvm_directio
total_memory           : 262010                                // Total physical installed.
free_memory            : 188123                               // Available for VMs, etc.
free_cpus              : 0
xen_major              : 4
xen_minor              : 1
xen_extra              : .3OVM
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : unavailable
xen_commandline        : dom0_mem=4096M crashkernel=256M@64M extra_guest_irqs=64,2048 nr_irqs=2048
cc_compiler            : gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)
cc_compile_by          : mockbuild
cc_compile_domain      : us.oracle.com
cc_compile_date        : Wed Sep 23 23:17:43 PDT 2015
xend_config_format     : 4