{"id":98,"date":"2019-10-27T07:04:40","date_gmt":"2019-10-27T07:04:40","guid":{"rendered":"https:\/\/online.osba.nl\/blog\/?p=98"},"modified":"2019-10-27T07:05:03","modified_gmt":"2019-10-27T07:05:03","slug":"proxmox","status":"publish","type":"post","link":"https:\/\/blog.osba.nl\/en\/2019\/10\/27\/proxmox\/","title":{"rendered":"Proxmox"},"content":{"rendered":"\n<p>Once I decided on visualization and settled on Proxmox as the host platform for the new NAS, I stranded in decisions to make with regard to the installation. <\/p>\n\n\n\n<p>The first problem was the installation medium itself: I wrote the installer to a uSD card, put it in an adapter to regular SD, that into SD2USB and finally in the USB3 port of the NAS. <\/p>\n\n\n\n<p>Booting OK, installer menu OK, but starting the installer: not OK. <\/p>\n\n\n\n<p>I tried a few times, but the image seemed broken. The kernel would halt somewhere between loading the initial ramdisk and actually starting the installer. <\/p>\n\n\n\n<p>I checked the SHA256-checksum, reflashed on another memory card, used another SD-card-reader: all to no avail. In the end I started trying other USB ports; not just USB3 in front, but first USB3 on the back, and in the end USB2 on the backside. <\/p>\n\n\n\n<p>That worked. The card readers are USB3, but maybe the uSD cards get upset at some point. Anyway, on to the installation. <\/p>\n\n\n\n<p>Target harddisk: SSD or HDD? Which file system? Am I happy with automatic partitioning? <\/p>\n\n\n\n<p>System disk: SSD. I want to be able to spin down as many HDD&#8217;s as soon as possible, as long as possible. If I start building the system on one of the spinning disks, it is more difficult to replace it in the future and am I stuck with it. Besides that, the base system should take only tens of GB&#8217;s, so there is enough space left for caching, swap and other things that also benefit from increased I\/O.<\/p>\n\n\n\n<p>Which file system? As long as I can remember, I have used LVM, the last ten years in combination with EXT4 on a md-stacks. It is very flexible and offers live resizing of nearly anything. <\/p>\n\n\n\n<p>Proxmox does not do LVM out of the box, but it does offer ZFS (ZoL, ZFS on Linux). I have been postponing ZFS usage for a couple of years now, and am still hesitant to take the plunge. How many disks? How many pools? What size? Shit, non-ECC-RAM; and how about mirrors with differently sized disks? What about TRIM on the SSD?<\/p>\n\n\n\n<p>I started reading about ZFS on a single device pool, retraced my steps and considered a pool with SSD and spinning disk mirrored. I found one viable option is to combine the 1TB spinning disk with the SSD for some reasons:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>It is the only non-SMR-disk I have available at the moment;<\/li><li>It is similar in size to the 1TB SSD;<\/li><li>I am not committed to keeping either the 4TB disk or the 6TB disk in the machine:<ul><li>I might take one or the other out and use it in a USB case for external back up<\/li><li>I might swap either for a disk the size of the other, to create another mirrored set.<\/li><\/ul><\/li><\/ul>\n\n\n\n<p>I hope that the pool will be smart enough not to spin up the HDD for  read, that would nullify the benefit of the non-spinning SSD. If that is the case, I&#8217;ll investigate how to make a single device pool out of it. <\/p>\n\n\n\n<p>The other option is running the pool on a single device with copies = 2; I&#8217;d use double the space, but there is no spinning disk involved. <\/p>\n\n\n\n<p>Then there&#8217;s the question of partitioning. Just the root partition could do with some 10GB. I&#8217;d put at least \/var on a separate partition, so that log files and temporary files don&#8217;t cause \/ to fill to 100%, some 3GB. ZFS copies = 2 means some 30GB. With swap equal to RAM is another 32GB, and then a couple of GB for ZFS ZIL. That leaves roughly 900GB of unpartitoned space.<\/p>\n\n\n\n<p>It is all a bit theoretical up front; I hesitate to just take the defaults and see down the road. Those times I did that, I regretted it later on. Now in particular, with the quad-level flash disk and less than 400 rewrites per cell (360, according to Samsung), I prefer not to start on the wrong footing. Anyway, it can&#8217;t be helped so I just have to bite the bullet. All things considered, I take the SSD-only way for the initial installation. <\/p>\n\n\n\n<p>Phew, that took just four nights to get through the first screen of the installer! <\/p>\n\n\n\n<p>That was the single choice to make then; from there to installation complete and reboot took about five minutes. <\/p>\n\n\n\n<p><\/p>\n<p class=\"wpf_wrapper\"><a class=\"print_link\" href=\"\" target=\"_blank\">Print this entry<\/a><\/p><!-- .wpf_wrapper -->","protected":false},"excerpt":{"rendered":"<p>Once I decided on visualization and settled on Proxmox as the host platform for the new NAS, I stranded in decisions to make with regard to the installation. The first problem was the installation medium itself: I wrote the installer to a uSD card, put it in an adapter to regular SD, that into SD2USB &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/blog.osba.nl\/en\/2019\/10\/27\/proxmox\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Proxmox&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_locale":"en_US","_original_post":"98","activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[15,17],"tags":[],"class_list":["post-98","post","type-post","status-publish","format-standard","hentry","category-homeserver","category-proxmox","en-US"],"_links":{"self":[{"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/posts\/98","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/comments?post=98"}],"version-history":[{"count":2,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/posts\/98\/revisions"}],"predecessor-version":[{"id":102,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/posts\/98\/revisions\/102"}],"wp:attachment":[{"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/media?parent=98"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/categories?post=98"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.osba.nl\/wp-json\/wp\/v2\/tags?post=98"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}