I’ve been working with the various incarnations of Red Hat Linux, including Fedora, since before the company went public.\u00a0 In that time I’ve done more than just a few upgrades from one release to another.\u00a0 With each upgrade I learn just a little more about administering my own Linux system.\u00a0\u00a0 I’m not always pleased with each release but I learn to live with the quirks introduced and the ones removed.\u00a0 In the end, after having used most of the other popular distributions and even in spite of my constant complaining, I’m still happy with my Fedora.<\/p>\n
The tips and tricks to making an upgrade go smoothly are not hidden masters secrets.\u00a0 They are simply the things we learn by doing.\u00a0 Do them enough, you learn to do things right.\u00a0 There are good ways and bad ways of doing an upgrade.\u00a0 The bad ways are often the clever<\/em> ways.\u00a0 The good ways are usually less glamorous.\u00a0 But they work.\u00a0 And they work well.<\/p>\n Tip #1:\u00a0 be mundane.\u00a0 An upgrade should not be clever.<\/span><\/span><\/span><\/p>\n So how does one go about being mundane with an upgrade?\u00a0 Follow along and I’ll tell you.<\/p>\n Note that the following instructions are well suited for the average user at home using Fedora.\u00a0 They are not necessarily well suited to someone who administers large numbers of computers with lots of users or for other Linux distributions.\u00a0 And if you follow these steps and screw up your systems, don’t blame me.\u00a0 This is just how I do it and it works for me.\u00a0 Caveat reader.<\/em><\/span><\/p>\n Step 1:\u00a0 The Plan<\/strong><\/p>\n The problem with upgrades is the incompatibilities you find between the old version and the new version.\u00a0 Some application depends on some library and the new version changes the library but not the application because the application didn’t come with the distribution you’re using.\u00a0 You got it later from some other repository.\u00a0 This problem isn’t something to blame on the Linux distribution, it’s a systems administration problem. As it turns out, it’s usually not hard to fix for the average home user.<\/p>\n Tip #2:\u00a0 Don’t upgrade.\u00a0 Reinstall<\/span><\/span><\/span><\/p>\n To avoid the problem of incompatible applications and libraries, don’t do an upgrade. Wipe the old installation and install the new version in its place.\u00a0 This isn’t actually hard to do and, if you plan correctly, won’t trash your personal data.\u00a0 But you have to prepare yourself for this process.\u00a0 The first step is to create separate partitions for systems files and your personal files.<\/p>\n Tip #3: Make separate partitions for \/ and \/home.<\/span><\/span><\/span><\/p>\n All your personal data, including your web servers and (if possible) your databases should go under \/home<\/em>.\u00a0 That way the distribution update will only wipe the systems files and won’t touch your personal data.\u00a0 It also means you can remove any rootkits or other nasties that found their way onto your system through system files.<\/p>\n So the plan is:\u00a0 reinstall.\u00a0 But before you can do that you need to save off some important bits and pieces from the system directories.\u00a0 Typically this amounts to configuration files and, as in my case, databases.<\/p>\n Step 2:\u00a0 Backups<\/strong><\/p>\n Before you start, you need to backup configuration files for the system tools you use on a regular basis.\u00a0 This includes such things as the hosts, password and group files from under \/etc<\/em>, along with a slew of others depending on your situation.\u00a0 Since there is no way to know exactly what files are important to you, I created a little shell script that can be edited to grab the files and directories that are important.\u00a0 I call this script configfiles.sh<\/a> and I run it as a cron job so that I’m always backing up those files in case of emergency.<\/p>\n Config files<\/strong><\/span><\/span><\/p>\n Although I backup a number of files and directories with configfiles.sh, I find that on reinstallation I only need a few of them.\u00a0 The rest I keep for reference so I can hand edit files or merge them after the reisntall completes.\u00a0 Of the files I backup, the following are almost always used on the upgraded system either verbatim or merged with the new version:<\/p>\n My printer configurations (\/etc\/cups<\/em>) is also backed up but it seems I always have to redo these after each upgrade because the administrative tools for dealing with printers are evolving faster than other parts of the system and, usually, get easier to reconfigure manually with each upgrade.\u00a0 Then again, I don’t do much printing at home.<\/p>\n Databases<\/strong><\/span><\/span><\/p>\n The default database directories are in the system directories so that could cause some problems.\u00a0 I could back up those directories but I find it easier to make dumps of the databases and then reload them after I reinstall.\u00a0 The dumps are done by a the same shell script that handles all my nightly backups (see next section) which is run by cron.\u00a0 This script rotates the database backups on a weekly basis.\u00a0 So I always have the last 7 days of database dumps.\u00a0 The dumps are stored on the \/home<\/em> partition so they won’t get trashed on the reinstall.<\/p>\n A regular backup plan<\/span><\/span><\/strong><\/p>\n Backups should be part of any home users plans.\u00a0 You can do backups to DVD or CD if you only have a single system.\u00a0 Or if you’re like me and have multiple systems at home you can attach an external USB drive to one of them and backup to that system.\u00a0 This is exactly what I do.\u00a0 For the paranoid you can use two USB drives and duplicate the backups (I do this at work) just in case one drive fails.\u00a0 I use Western Digital MyBook’s, 500GB and 1TB models, both at home and at work.\u00a0 I’ve had zero failures with these and they work right out of the box with Linux (I reformat with Linux filesystems).\u00a0 I’ve had terrible luck with Maxtor USB drives and would highly recommend you not use them.<\/p>\n My backup script is pretty much the same on every system.\u00a0 I actually use one script to prep an outbound email<\/a> using ssmtp<\/a> that then runs the real backup script<\/a>.\u00a0 The backup script is configured for each system it is run on.\u00a0 It requires manual updates for each system but I only need to do this once (or very seldom).\u00a0 All the backups are run via rsync.\u00a0 The trick with rsync, especially now that GNOME has added that nasty GVFS mount point on your users home directory, is to build proper exclude lists.<\/p>\n These scripts will not run on your system without modification.\u00a0 You’ll need to read the scripts and update them for your personal setup.<\/em><\/span><\/p>\n Since the backups are stored on a remote USB drive, which can be moved to another system easily if the server it is connected to fails for some reason, I can easily restore necessary files after an reinstall.\u00a0 This typically just means the database backups unless something catastrophic happens like the disk dies on the system being reinstalled.<\/p>\n Cron jobs<\/span><\/strong><\/span><\/p>\n The backups are run nightly from the root user (so I can grab directories my regular user doesn’t own) using cron.\u00a0 The entry looks like this:<\/p>\n 30 1 * * * \/home\/user\/bin\/configfiles.sh \/home\/user\/backups\/hostname 2>&1 > \/dev\/null The configfiles<\/strong> script is run first and stores the configuration files into a backup directory under my regular user.\u00a0 This makes sure they get backed up when the backups are run.\u00a0 The mail-backup<\/strong> script runs later and mails me the results of the backup process.<\/p>\n Step 3:\u00a0 Installation<\/strong><\/p>\n If you don’t already have your \/home<\/em> directories on a separate partition then backup everything under \/home<\/em> to an external device before proceeding.\u00a0 You can create the separate partitions on this reinstallation and then copy all the files from the backup into \/home<\/em>.\u00a0 You’ll want to backup in archive format, which means maintaining permissions, ownership and timestamps.\u00a0 Check the rsync<\/span><\/span><\/span> and cp<\/span><\/span><\/span> commands for help on that.<\/p>\n Download the boot disk for the latest Fedora<\/a> release and burn it to a CD.\u00a0 You can copy over the DVD installation disk to another system and export it via NFS if you like, or burn it to a DVD and install from it.\u00a0 You can even install from the boot disk alone via a network install across the internet, but this last option can take much longer to complete and is not something I would recommend.<\/p>\n Grub\/Anaconda boot options I’ve already covered the basic installation process for Fedora in my post on migrating a MythTV server to\u00a0 F10<\/a>.\u00a0 I suggest reading that post for details on how to install Fedora if you’re doing it from a remote server with the DVD exported via NFS, as I do.\u00a0 This will cover the plethora of options available to anaconda during installation.\u00a0 If you install directly from the DVD, then you shouldn’t have to worry about any of that.<\/p>\n Partitions and filesystems<\/strong><\/span><\/span><\/p>\n When you get to the disk partitioning section of the installation be sure to do a custom partitioning.\u00a0 You only need about 20GB for the root partition (maximum, if you install absolutely everything known to Fedora and mankind).\u00a0 Leave a swap space equal to twice the size of the total amount of memory you have and then the rest of the disk should be your \/home<\/em> partition.<\/p>\n Once you have the partitions set up like this then you won’t have to remake them on future reinstalls, but you’ll still do a custom partitioning so that the partitions are correctly mapped to their original mount points.<\/p>\n You’ll also want to make certain that the \/home<\/em> partition is NOT reformatted (unless this is the first time you’re creating this partition).\u00a0 You should reformat the root (re: \/) partition and swap space on every reinstall, however.\u00a0 That’s your guarantee of cleaning out everything, plus you can change the root partition filesystem type at this point to use newer, better and faster filesystems.\u00a0 At the moment I’m quite happy with ext3 but I’ve heard about some newer ones (ext4, I think, plus a few others) that may become the default in Fedora.\u00a0 The safe bet it to use the default partition type on the root partition.\u00a0 It’s likely to be the most stable and, as most modern file systems are journaled anyway, reliable and recoverable from the unlikey event of a system crash or power outtage.<\/p>\n Finish up the install and wait for the reboot.\u00a0 I don’t create a user at this point because I create it manually later so it maps to my existing \/home directory using the same userid and groupid.\u00a0 This is easy to do from the command line but, as far as I can tell, impossible to do from the graphical install process.\u00a0 So skip it when doing your reinstallation.\u00a0 Just log in as root later.<\/p>\n Step 4:\u00a0 Post Install Setup<\/strong><\/p>\n Okay, installation has completed and you’ve rebooted and run through the First Time setup screens.\u00a0 Now you’re fully rebooted and ready to use the system.\u00a0 But you need to reconfigure it the way it was before.\u00a0 This amounts to reconfiguring your old user (so you don’t do everything as root), configuring your network and graphics driver and copying or merging old configuration files.<\/p>\n Reconfigure your old user Now it’s time to put some things back in from your previous installation, starting with your non-root user.\u00a0 Look at the backup of \/etc\/password<\/em> and \/etc\/group<\/em> to get the information you need.\u00a0 The important bits are the userid (uid), groupid (gid) and home directory.<\/p>\n Notice that I’ve used the same id for gid and uid.\u00a0 I find it easier to track my files if I always use the same uid and gid.<\/p>\n Once you have the necessary information you simply create a group using the gid for your old user and a new password entry, then add your password for the new login:\n<\/p>\n groupadd -g <gid> userid<\/span><\/span><\/span><\/p>\n useradd -d\/home\/userid -c”Your name” -s\/bin\/bash -u <uid> -g <gid> userid<\/span><\/span><\/span><\/p>\n passwd userid At this point you should do yourself a favor and add yourself to the sudo users.\u00a0 As the root user just type\n<\/p>\n visudo<\/span><\/span><\/span><\/p>\n to edit the users file.\u00a0 If you aren’t familiar with this, read the man page for more details.<\/p>\n Network start up and installing from backups<\/span><\/strong><\/span><\/p>\n Now the network needs to be brought up.\u00a0 Configure the network using the desktop tools – this is typically easier than trying to understand the configuration files, which for wireless configurations can get messy.\u00a0 However, you can simply copy over the hosts and resolv.conf files from you backups into the \/etc<\/em> directory if you use static IP addresses on your networks at home.\u00a0 If your system is connected directly to the internet and uses DHCP to get an IP address from your ISP then don’t copy these in from your backups – just let your ISP set them for you.<\/p>\n <\/strong><\/span><\/p>\n Install meld<\/span><\/strong><\/span><\/p>\n Once the network is back up you can either mount up your remote backups or load the CD\/DVD backups and copy in or merge the files from your backups.\u00a0 Merging is actually pretty easy in most cases.\u00a0 But you need to install meld<\/span><\/span><\/span>.<\/p>\n This package is very useful to non-developers.\u00a0 It’s a graphical program that allows you to see the differences between two files.\u00a0 It’s perfect for viewing the old version of a configuration file and comparing it with the new version.\u00a0 You just find your old configuration options and copy them over.\u00a0 It’s pretty much point and click and works well with most simple configuration files.\u00a0 The only one that took some serious though for me was squid, whose configuration file is a major pain in the butt anyway.<\/p>\n Installation for Fedora just requires yum:<\/p>\n yum install meld<\/span><\/span><\/span><\/p>\n You’re running as root at this point because we’re still reconfiguring and aren’t ready to login as our normal user.<\/p>\n Merge configurations<\/span><\/strong><\/span><\/p>\n With meld installed you can now copy over your old configurations or merge them with the new ones.\u00a0 The ones you can just copy over include:<\/p>\n The format of the \/etc\/hosts.allow<\/em> and \/etc\/hosts.deny<\/em> files has not changed much recently so you’re probably safe copying those over verbatim, but to be safe you can always run them through meld to merge instead.\u00a0 Most of the rest of the saved configuration files you should merge using meld.<\/p>\n In the case of httpd, you should be in the habit of configuring your local web servers as virtual hosts and placing those configurations in \/etc\/httpd\/conf.d\/custom.conf<\/em>, which will allow you to just copy over that configuration without having to merge anything.<\/p>\n Distribution update<\/span><\/strong><\/span><\/p>\n The next step is to make sure the installation is actually up to date with respect to security and bug fix updates from the Fedora repositories.\u00a0 This is easy enough but it might take a little while to complete depending on how old your installation DVD is:<\/p>\n yum update<\/span><\/span><\/span><\/p>\n Run this and sit back for awhile.\u00a0 When it’s done you can move on to the next step.<\/p>\n X Updates<\/span><\/strong><\/span><\/p>\n The latest versions of the X.org server and the associated video drivers no longer require the use of an xorg.conf file.\u00a0 The server is now able to figure out much of what it needs for basic operation given the chipset (aka video cards) your using.\u00a0 However, to get extended features like dual head (re: multiple monitors) or to deal with some of the intricate details that have come up with the Intel drivers (which are newer and utilizing more advanced server features, and thus tend to cause more people confusion than, say, the nVidia drivers) you’ll need to configure an xorg.conf file.\u00a0 Now would be the time to deal with this issue.<\/p>\n <\/strong><\/span><\/p>\n Personal configuration<\/span><\/strong><\/span><\/p>\n The last step in your personal upgrade of Fedora is to set your firewall, selinux and services configurations.\u00a0 These can all be done from the desktop menus.\u00a0 I disable the firewalls on my system because I have a firewall running between them and the outside world that I maintain separately.\u00a0 I also disable SELinux because it tends to require more administrative work than I’m willing to deal with at home.\u00a0 There are a number of services that can be disabled, like ISDN.\u00a0 You should see Mauriat Miranda’s excellent write ups on Fedora services<\/a> for details on these.<\/p>\n Advanced:\u00a0 User Migration<\/strong><\/p>\n If you need to migrate multiple users you can do it just like you did with your personal user or simply write a script that merges the relevant information from \/etc\/password, \/etc\/group and \/etc\/shadow in your backups into your new installation.\u00a0 Note that you can simply copy the relevant lines from \/etc\/shadow over – the passwords will simply work as they did before.\u00a0 However, if you use some other password mechanism (re: you edited your PAM authentication mechanisms) then this won’t work.\u00a0 Most users, however, don’t do this unless they’re connected to something like LDAP, and most home users not connected to such things.<\/p>\n","protected":false},"excerpt":{"rendered":" I’ve been working with the various incarnations of Red Hat Linux, including Fedora, since before the company went public.\u00a0 In that time I’ve done more than just a few upgrades from one release to another.\u00a0 With each upgrade I learn just a little more about administering my own Linux system.\u00a0\u00a0 I’m not always pleased with […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"jetpack_post_was_ever_published":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[35,5,33],"tags":[102,634,620,48,43,88,619,61,621,159,78,120,96,185,141,622,95,79],"class_list":{"0":"post-326","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-fedora","7":"category-linux","8":"category-personal","9":"tag-f10","10":"tag-fedora","11":"tag-gimp","12":"tag-gnome","13":"tag-intel","14":"tag-intel-driver","15":"tag-linux","16":"tag-mysql","17":"tag-mythtv","18":"tag-nfs","19":"tag-nvidia","20":"tag-partition","21":"tag-red-hat","22":"tag-sane","23":"tag-ssmtp","24":"tag-x11","25":"tag-xorg","26":"tag-yum","27":"czr-hentry"},"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pe9t8-5g","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/posts\/326","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=326"}],"version-history":[{"count":21,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/posts\/326\/revisions"}],"predecessor-version":[{"id":511,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=\/wp\/v2\/posts\/326\/revisions\/511"}],"wp:attachment":[{"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=326"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=326"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.graphics-muse.org\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=326"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\n
\n30 3 * * * \/home\/user\/bin\/mail-backup.sh<\/span><\/span><\/span><\/p>\n
\n<\/strong><\/span><\/span><\/p>\n
\n<\/span><\/strong><\/span><\/p>\n\n
\n<\/span><\/span><\/span><\/p>\n\n