o AIdD@s4ddlZddlZddlZddlZddlZeZejZejZej Z ej Z ej Z ejZejZejee jZdde jDZedgdZddZdd Zd d Zd d ZddZd0ddZddZ ddZ!ddZ"ddZ#ddZ$d1ddZ%d d!Z&d"d#Z'd$d%Z(d&d'Z)d(d)Z*d*d+Z+d,d-Z,d.d/Z-dS)2NcCs2g|]}|ddkr|ddtj|dfqS)nameswap mountpoint /dev/{}/{})formatconfigvolgroup).0volumer V/home/thorsten/Data/Arbeit/PerFact/Git/ema-modules/MigrationMonster/bin/create_disk.py s   r )z/boot /dev/nbd0p1)z/dev/z/dev/ptsz/procz/sysc Cs<tdtjddddddttjgddtjd gddd S) zGenerate image fileqemu-imgcreatez-fqcow2-ozpreallocation=metadataTchecksyncN)print subprocessrunimage_filenamer image_sizer r r r make_image-s rc Cstdd}tdtjddddd|gd d d}tjddd|d d d dtjg d d d}tjddd|d d tj|gd d tjddd|ddddgd d tjddd|ddddgd d tdtjddgd d tjgdd tjdtdtjgdd d tjddtjdgd d tdtj D]W}tjddd |d!d"|d#tjgd d |d#d$krtjdd%d& tj|d#gd d tjdd'd(d$d& tj|d#gd d qtjdd)d& tj|d#d(|d#gd tjdqd*S)+z!Create partitions and filesystemszPartition diskmsdossudoparted-s /dev/nbd0mklabelTrmkpartprimaryext4z0%z100%set1booton2lvmzBoot file system partprobe)r mkfs.ext4-Lr(-m0r)rstdoutzMake LVM group)rpvcreate /dev/nbd0p2vgcreater3zCreate volumes and file systemslvcreatez--sizesizez--namerrmkswapr swaplabelr.r-N) rtimesleeprrrboot_partition_sizeDEVNULLrvolumesr) labeltype target_disk full_sizer r r r make_filesystems7s         rAcCs:tdtjgdddtjdddddd tgddd S) zMount image into block device)rmodprobenbdTrrqemu-nbdz--connect=/dev/nbd0z --persistentz--forkz --shared=4N)rrrrr r r r make_blockdevs rEcCs>tdgddgddgg}|D] }tjdg|ddqd S) zRemove loopback devicezRemove the loopback device)rDz --disconnectr!r,rmmodrCrFrN)rrr)cmdscmdr r r destroy_blockdevsrIcCs~tdtddgtddddtjgtD]$\}}tjt | d}tjddd|gd d tjdd ||gd d qd S) zMount file systemsrr,vgchange-ay/mkdir-pTrmountN) rrrrr mountpointsospathjoin mount_pathlstrip)rdevice directoryr r r mount_systems  rYFcCsbtdttD]\}}tjdd|gtjddq|rttdtjdddd tjgdd d S) z=Reverse all setup procedures and return system back to normalzUnmount systemrumountFstderrrzRemove LVM volumesrJrKnrN) rreversedrQrrr<zerofree_systemrr)zerofreerrWr r r unmount_systems  racCs0tdtD]\}}tjddd|gddqdS)zRun zerofree on all partitions.zZerofree file systemsrr`z-vFrN)rrQrr)rrWr r r r_s r_c Csgd}tdt|dtdtjttjgtdtd}tdd|gt|d|dtd tj gd d d tj DvrOtd ddtdgdSdS)z5Unpack archive into freshly created and mounted image)tarz --extractz--preserve-permissionsz--same-permissionsz--numeric-ownerzUnpack archivez --directoryz--filezUnpack database,/vol/postgresql/var/lib/postgresql/migrationrNrOrMpg_workcSsh|]}|dqS)rr )r volr r r sz unpack_system..lnr z /vol/pg_workz*/vol/postgresql/var/lib/postgresql/pg_workN) r_sudorUrRrSrT base_pathrtemplate_archivetemplate_archive_dbr=)rHtargetr r r unpack_systems$  rmcCstdtdgddgdS)z Install grubz&Install grub in the chroot environmentz update-grubz grub-installr!N)r _chroot_cmdsr r r r install_grubs rocCstdtD]}tjt|d}tjdddd||gddqtjdd tjtd tjtd gddtjdd d tjtd gdddS)z.Add mountpoints for chrooting into the system.zMount devices for chrootrMrrPrbindTrmvetc/resolv.confetc/resolv.conf-chrootcpz/etc/resolv.confN) rchroot_mountpointsrRrSrTrUrVrrrrXr r r mount_chroots,     rwcCsptdtjddtjtdtjtdgddttD]}tjt| d}tjdd |gtj dd qd S) zRemove system mount pointszUnmount devices for chrootrrqrsrrFrrMrZr[N) rrrrRrSrTrUr^rurVr<rvr r r unmount_chroots    rxmainc Cs d}tjddtd|dgtjdddj}d}|d|}|d|}z ttd|Wn ty>Ynwt d d St d t d d |gd||gdd|||gdd|g|dkr|d}d|}|d}t d d |gddd|gd||gdd||g|S)z3Move postgresql restore directory into proper placercrcatrMz /PG_VERSIONT)r1universal_newlinesrz"/vol/postgresql/var/lib/postgresqlz'PostgreSQL directory found. Bailing outNzPerform postgresql fixuprNrOrqchownzpostgres:postgreschmod0700ryz/pg_walz /vol/pg_wal/z/maintest!z-drgr ) rrrUPIPEr1striprRstatOSErrorrrn) clustersource pg_versionpg_homerlpg_datapgwalpgwaldirpgwaltgtr r r fixup_postgresql(sL       rcCsBtddD]\}}d|}tddd|gdd||gqd S) z< Create subfolders in /vol/backup. Requires chroot. zCreate folders in /vol/backup))postgres postgresql)rootsystem)zoperz/vol/backup/{}rNr/0770r|z {}:backupN)rrrn)userfolderrlr r r create_backup_foldersUs   rcCsvttdd}|dur dStj|stddStdtd}tjddd|gd d tjdd d |d |gd d dS)z, Unpack source archive into chroot. source_archiveNzWarning: source_archive set but not present. Skipping extraction. Have you forgotten to run fetch-archive for the source system?zUnpacking source dataz+/opt/perfact/custom/migration/source_systemrrNrOTrrbxf-C) getattrrrRrSexistsrrUrr)archiverlr r r unpack_source_datafs    rcCs:d}tddd|gddd|gd}g}td}t|D] }|d kr)d }q|d kr7d}|d q|s>||qd }tjdddtd|gd dtjddtd|dgtjd d |dg}ttdD]}| drd|d}||qrtjddtd|dgtjd d |ddS)a 1. Change permissions to Data.FS so user perfact can use zoperecord/zopeplayback. 2. Create copy of Zope config file that accesses the Data.FS directly (without ZEO). 3. Create copy of zodbsync config file that uses the file from 2. z /var/lib/zope2.13/zeo/emazeo/varchgrp-Rperfactr}zg+wFz,/var/lib/zope2.13/instance/ema/etc/zope.confz Tz z path /var/lib/zope2.13/zeo/emazeo/var/Data.fs z!/opt/perfact/custom/migration/tmprrNrOrMrteez /zope.conf)r1textinputz/etc/perfact/modsync/zodb.pyz conf_path = z conf_path = 'z /zope.conf' z /zodb.confN) rnrUopen readlinesrappendrrr<rT startswith)zeovardroplineszopeconflinetmpdirr r r _prepare_datafs_access|sP           rc Cs`td}d}d}td|d|d|dgd|d||gdd d d d |d dgdS)z>Include Data.FS of source system in target under /PerFact/OLD.z/opt/perfact/custom/migrationz/opt/perfact/dbutils-zoperepoz)/var/lib/zope2.13/instance/ema/Extensionsrqz/source_system/z /__root__z/__root__/PerFact/OLDrz-urzperfact-zopeplaybackz-cz/tmp/zodb.confz /PerFact/OLDN)rrn) migrationrepo extensionsr r r upload_source_datafss" rcCslttdd}|dur dStj|stddStdtddtjdtdgt d d }t d |gdS) z@ Unpack the source db and set it up to serve port 5433. source_archive_dbNzWarning: source_archive_db set but not present. Skipping extraction. Have you forgotten to run fetch-archive for the source system?zUnpacking source databaserbrrrcr)rz8/opt/perfact/migration/src/inchroot/setup-source-cluster) rrrRrSrrrhrrUrrn)rdatadirr r r unpack_source_dbs    rcCs*t}d}d}d}t|}tj|sJdddtjg}dd|g}tj |gddd  }t d d d |d ||gt |dd|gddt |dd||gt |ddgt |ddgt |dd|gt |dd|d|gt |d|gt |dd|gt d d d|gdS) zD Push the current state of this repository into the chroot. z/opt/perfact/migrationzbuild-targetmnttempz&Tool repository not found in template.gitr)z rev-parsez --abbrev-refHEADT)r{rr|r:remotermFraddresetz--hardcleanz-dfcheckoutz-Bpushz--forcezHEAD:branchz-Dzperfact:perfactN) getpassgetuserrUrRrSrenvrir check_outputr_runrn) current_userpath_in_chroot remote_name tmp_branchrSgitsrcgittgtcurrent_branchr r r update_migration_toolss8     rcCs:ttdd}|dur dStjddd|tdgdddS) zH Clone the given custom file repository into the target system. custom_files_repoNrrclonez#/opt/perfact/custom/migration/filesTr)rrrrrU)rr r r clone_custom_filess  rc CsDtjdurdStdtjddddtjttjt tj gdddS) zConvert disk into VM formatNz Exporting image to target formatrconvertrOz-OTr) rimage_file_vm_formatrrrrrRrSrT build_path image_file_vmr r r r convert_disks   r)F)ry).rRr9rrhelpers create_envrrirrU disk_configrrrrrh chroot_cmdsrnrSrT image_filerr=rQrrurrArErIrYrar_rmrorwrxrrrrrrrrrr r r r sN   d     -<)