{"id":5378,"date":"2012-09-12T10:39:01","date_gmt":"2012-09-12T10:39:01","guid":{"rendered":"https:\/\/www.heartinternet.uk\/blog\/?p=5378"},"modified":"2012-09-12T10:39:01","modified_gmt":"2012-09-12T10:39:01","slug":"fuse-filesystem-in-userspace-and-master-ftp","status":"publish","type":"post","link":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/","title":{"rendered":"FUSE – Filesystem in Userspace and Master FTP"},"content":{"rendered":"

Here at Heart Internet we love Linux, we love open source, and we love building things.<\/p>\n

One of the reasons Heart Internet is so successful is that almost 100% of our platform is built in-house: we use technologies we appreciate and understand, and we’re genuine enthusiasts when it comes to our beloved Linux.<\/p>\n

Earlier this year, our Product Ideas team decided that it was time to implement master FTP functionality into our reseller package (and other areas too). It’s a great idea; it allows resellers to easily update some or all of their websites using one master FTP login. It also allows them to hand-down semi-master FTP logins to their staff, so that they can update a limited set of sites.<\/p>\n

It’s a very simple idea (the best ideas always are), but some thought was required for it to fit neatly into two very important areas: our security and monitoring model. I gave the implementation some initial thought, but nothing really excited me, and nothing really felt like “the Heart Internet way”. Then it came to me:<\/p>\n

FUSE!<\/p>\n

What\u2019s FUSE I hear you say? FUSE is a Filesystem in USErspace. Basically, what this means is that, in Linux, you can write a program (I opted for Perl) which will allow me to implement a file and directory structure of my own creation, which works just as if it were local.<\/p>\n

FUSE has been used for many things, and forms the basis of many of the ways of accessing non-local-files-as-if-they-were-local fancyness in the modern Fedora and Ubuntu desktops. You can mount a file from the web (httpfs) with it. You can mount Wikipedia (wikipediafs) and edit articles as if they were real files with it. You can even mount your Amazon S3 space locally (s3fs) with it, and play with your data as if it were right there on your computer!<\/p>\n

\"\"<\/p>\n

So how did we use it?<\/p>\n

We wanted to keep the master FTP idea simple. We didn\u2019t want to force our customers to use separate FTP servers for master FTP. We just wanted a separate master FTP to \u201cjust work\u201d on whichever FTP server you use. Fortunately, our FTP servers all run Linux – which meant that FUSE was available to me.<\/p>\n

The basic idea behind our master FTP is that we would have a virtual filesystem which (after looking all the details from a MySQL database) presents the files from some\/all of a given customer\u2019s websites each in a separate directory. You login using your regular FTP client with your master FTP login and you can see each site\u2019s files right there.<\/p>\n

The problems here are that (a) each website runs as a separate user (for security and monitoring reasons) and (b) the website data can be on any number of backend storage devices (for redundancy and fault tolerance).<\/p>\n

Enter FUSE: it forms a layer of ownership rewriting (for problem a) and locating the data (problem b).<\/p>\n

Obviously, there is a little more complexity to it than that: for example, how do cross-site symlinks work? They remain absolute. Can you accidentally delete a whole site? No! Can you move files between sites? Sure you can. Would it be suitable for moving a site from staging to development? Definitely. Does it allow easy downloads for all your sites in one go? Certainly does – but we already have a tool for that!<\/p>\n

It even allows access to both the Linux and Windows packages (if you\u2019re a reseller).<\/p>\n

The main fuse code is written using perl which binds to the FUSE kernel module using the FUSE CPAN perl module. Each filesystem call is mapped to a subroutine in the perl code, which performs the necessary magic to present answers to the filesystem subsystem of the operating system. Because our FTP server software just sits on top of the filesystem layer, it doesn\u2019t even know that the master FTP files aren\u2019t real – it just works.<\/p>\n

All in all, this allows for a very flexible, secure and elegant way of providing master FTP functionality to our customers without adding any extra complexity to how they use their hosting.<\/p>\n

So I hope that this article has given you an insight into how we at Heart Internet think about and develop our technologies.<\/p>\n

References:<\/p>\n

FUSE – https:\/\/en.wikipedia.org\/wiki\/FUSE_(linux)<\/a><\/p>\n

httpfs – https:\/\/httpfs.sourceforge.net\/<\/a><\/p>\n

wikipediafs – https:\/\/wikipediafs.sourceforge.net\/<\/a><\/p>\n

s3fs – https:\/\/github.com\/tongwang\/s3fs-c<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Here at Heart Internet we love Linux, we love open source, and we love building things. One of the reasons Heart Internet is so successful is that almost 100% of…<\/p>\n","protected":false},"author":2,"featured_media":8209,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[],"class_list":{"0":"post-5378","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-your-website"},"yoast_head":"\nFUSE - Filesystem in Userspace and Master FTP - Heart Internet<\/title>\n<meta name=\"description\" content=\"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"FUSE - Filesystem in Userspace and Master FTP - Heart Internet\" \/>\n<meta property=\"og:description\" content=\"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\" \/>\n<meta property=\"og:site_name\" content=\"Heart Internet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/heartinternet\/\" \/>\n<meta property=\"article:published_time\" content=\"2012-09-12T10:39:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1620\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Eliot Chambers-Ostler\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@heartinternet\" \/>\n<meta name=\"twitter:site\" content=\"@heartinternet\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Eliot Chambers-Ostler\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\"},\"author\":{\"name\":\"Eliot Chambers-Ostler\",\"@id\":\"https:\/\/heartblog.victory.digital\/#\/schema\/person\/58ed7f27cc0f3ab6e69135742a5eee28\"},\"headline\":\"FUSE – Filesystem in Userspace and Master FTP\",\"datePublished\":\"2012-09-12T10:39:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\"},\"wordCount\":759,\"commentCount\":4,\"publisher\":{\"@id\":\"https:\/\/heartblog.victory.digital\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg\",\"articleSection\":[\"Your Website\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\",\"url\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\",\"name\":\"FUSE - Filesystem in Userspace and Master FTP - Heart Internet\",\"isPartOf\":{\"@id\":\"https:\/\/heartblog.victory.digital\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg\",\"datePublished\":\"2012-09-12T10:39:01+00:00\",\"description\":\"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage\",\"url\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg\",\"contentUrl\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg\",\"width\":1620,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.heartinternet.uk\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"FUSE – Filesystem in Userspace and Master FTP\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/heartblog.victory.digital\/#website\",\"url\":\"https:\/\/heartblog.victory.digital\/\",\"name\":\"Heart Internet\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/heartblog.victory.digital\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/heartblog.victory.digital\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/heartblog.victory.digital\/#organization\",\"name\":\"Heart Internet\",\"url\":\"https:\/\/heartblog.victory.digital\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/heartblog.victory.digital\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/02\/HeartInternet_Logo_Colour.webp\",\"contentUrl\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/02\/HeartInternet_Logo_Colour.webp\",\"width\":992,\"height\":252,\"caption\":\"Heart Internet\"},\"image\":{\"@id\":\"https:\/\/heartblog.victory.digital\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/heartinternet\/\",\"https:\/\/x.com\/heartinternet\",\"https:\/\/www.linkedin.com\/company\/heart-internet-ltd\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/heartblog.victory.digital\/#\/schema\/person\/58ed7f27cc0f3ab6e69135742a5eee28\",\"name\":\"Eliot Chambers-Ostler\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/heartblog.victory.digital\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/08\/cropped-Eliot-96x96.jpg\",\"contentUrl\":\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/08\/cropped-Eliot-96x96.jpg\",\"caption\":\"Eliot Chambers-Ostler\"},\"url\":\"https:\/\/www.heartinternet.uk\/blog\/author\/eliot-chambers-ostler\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"FUSE - Filesystem in Userspace and Master FTP - Heart Internet","description":"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/","og_locale":"en_GB","og_type":"article","og_title":"FUSE - Filesystem in Userspace and Master FTP - Heart Internet","og_description":"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.","og_url":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/","og_site_name":"Heart Internet","article_publisher":"https:\/\/www.facebook.com\/heartinternet\/","article_published_time":"2012-09-12T10:39:01+00:00","og_image":[{"width":1620,"height":720,"url":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg","type":"image\/jpeg"}],"author":"Eliot Chambers-Ostler","twitter_card":"summary_large_image","twitter_creator":"@heartinternet","twitter_site":"@heartinternet","twitter_misc":{"Written by":"Eliot Chambers-Ostler","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#article","isPartOf":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/"},"author":{"name":"Eliot Chambers-Ostler","@id":"https:\/\/heartblog.victory.digital\/#\/schema\/person\/58ed7f27cc0f3ab6e69135742a5eee28"},"headline":"FUSE – Filesystem in Userspace and Master FTP","datePublished":"2012-09-12T10:39:01+00:00","mainEntityOfPage":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/"},"wordCount":759,"commentCount":4,"publisher":{"@id":"https:\/\/heartblog.victory.digital\/#organization"},"image":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg","articleSection":["Your Website"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/","url":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/","name":"FUSE - Filesystem in Userspace and Master FTP - Heart Internet","isPartOf":{"@id":"https:\/\/heartblog.victory.digital\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage"},"image":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg","datePublished":"2012-09-12T10:39:01+00:00","description":"FUSE - Filesystem in Userspace and Master FTP - Written by the team at Heart Internet.","breadcrumb":{"@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#primaryimage","url":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg","contentUrl":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2015\/06\/category_your_website1.jpg","width":1620,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/www.heartinternet.uk\/blog\/fuse-filesystem-in-userspace-and-master-ftp\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.heartinternet.uk\/blog\/"},{"@type":"ListItem","position":2,"name":"FUSE – Filesystem in Userspace and Master FTP"}]},{"@type":"WebSite","@id":"https:\/\/heartblog.victory.digital\/#website","url":"https:\/\/heartblog.victory.digital\/","name":"Heart Internet","description":"","publisher":{"@id":"https:\/\/heartblog.victory.digital\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/heartblog.victory.digital\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/heartblog.victory.digital\/#organization","name":"Heart Internet","url":"https:\/\/heartblog.victory.digital\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/heartblog.victory.digital\/#\/schema\/logo\/image\/","url":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/02\/HeartInternet_Logo_Colour.webp","contentUrl":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/02\/HeartInternet_Logo_Colour.webp","width":992,"height":252,"caption":"Heart Internet"},"image":{"@id":"https:\/\/heartblog.victory.digital\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/heartinternet\/","https:\/\/x.com\/heartinternet","https:\/\/www.linkedin.com\/company\/heart-internet-ltd"]},{"@type":"Person","@id":"https:\/\/heartblog.victory.digital\/#\/schema\/person\/58ed7f27cc0f3ab6e69135742a5eee28","name":"Eliot Chambers-Ostler","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/heartblog.victory.digital\/#\/schema\/person\/image\/","url":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/08\/cropped-Eliot-96x96.jpg","contentUrl":"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/2025\/08\/cropped-Eliot-96x96.jpg","caption":"Eliot Chambers-Ostler"},"url":"https:\/\/www.heartinternet.uk\/blog\/author\/eliot-chambers-ostler\/"}]}},"_links":{"self":[{"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/posts\/5378","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/comments?post=5378"}],"version-history":[{"count":0,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/posts\/5378\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/media\/8209"}],"wp:attachment":[{"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/media?parent=5378"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/categories?post=5378"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.heartinternet.uk\/blog\/wp-json\/wp\/v2\/tags?post=5378"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}