The readme explains how to set this up, but it doesn’t really explain what it does. What does this do? I’m guessing it pretends to be a flash drive containing infinite books and then somehow fetches them on the fly from the Internet when the operating system attempts to access them?
There's an associated video on youtube somewhere, but no it doesn't do that. you're close, though.
if you drill down into the right folders, it contains every possible text file up to a certain size. He uses a weird 70 character encoding scheme in order to optimize folder depth and width (he didn't want more than 5k objects in any folder) and to stay within maximum path length limitations.
it generates the text files on demand based on the path you're following and in each folder (along with other folders) is the text file represented by that path so far.
The contents of the file are based on the path used to access it, correct. It uses MTP rather than emulating a normal flash drive though, which makes this kind of project much easier.
They also suggest that you can do other things using the same technique, like hiding a folder unless you know its exact name, only showing files if you navigate to certain other folders first, or because the esp32 stick being used contains a screen it could run a copy of doom controlled by navigating through folders.
So you get a file. Any file. Not necessarily the file you want, unless you already know its contents and how to traverse the folder hierarchy to get to that specific point.
> [..] the inhabitants believe that the books contain every possible ordering of just 25 basic characters (22 letters, the period, the comma, and space). Though the vast majority of the books in this universe are pure gibberish, the laws of probability dictate that the library also must contain, somewhere, every coherent book ever written, or that might ever be written, and every possible permutation or slightly erroneous version of every one of those books.
I like this. Some binary running on a computer serving these up to a FUSE mount would stop a corporate disk scanner in its tracks (at least whatever thread happens upon the location this is mounted.)
I might have a go writing something like this for my Mac.
The readme explains how to set this up, but it doesn’t really explain what it does. What does this do? I’m guessing it pretends to be a flash drive containing infinite books and then somehow fetches them on the fly from the Internet when the operating system attempts to access them?
There's an associated video on youtube somewhere, but no it doesn't do that. you're close, though.
if you drill down into the right folders, it contains every possible text file up to a certain size. He uses a weird 70 character encoding scheme in order to optimize folder depth and width (he didn't want more than 5k objects in any folder) and to stay within maximum path length limitations.
it generates the text files on demand based on the path you're following and in each folder (along with other folders) is the text file represented by that path so far.
Here's the video: https://www.youtube.com/watch?v=w6rkhvdAqHU - This Flash Drive has Literally Every File
The contents of the file are based on the path used to access it, correct. It uses MTP rather than emulating a normal flash drive though, which makes this kind of project much easier.
They also suggest that you can do other things using the same technique, like hiding a folder unless you know its exact name, only showing files if you navigate to certain other folders first, or because the esp32 stick being used contains a screen it could run a copy of doom controlled by navigating through folders.
So in theory you could have War and Peace somewhere.
Each folder represents the file content so far. So how to find a specific file without knowing its contents - by its title for example?
plain .txt files don't have titles, so these files don't have titles, either. unless it's in the text of the file.
you get to any file by following the filesystem path whose bytes match the content you are looking for. There's no searching for the content you want.
if you're crawling the filesystem it will probably take you until the heat death of the universe to complete that crawl.
So you get a file. Any file. Not necessarily the file you want, unless you already know its contents and how to traverse the folder hierarchy to get to that specific point.
Yes. Have you read The Library of Babel? This is sort of the whole point.
Using mtp takes away some of the magic for me
That was my reaction too. Most of what I wanted to know from the video is how it would emulate a filesystem that does that.
If you're unsure what exactly this is supposed to be, just have a look here:
https://en.wikipedia.org/wiki/The_Library_of_Babel
> [..] the inhabitants believe that the books contain every possible ordering of just 25 basic characters (22 letters, the period, the comma, and space). Though the vast majority of the books in this universe are pure gibberish, the laws of probability dictate that the library also must contain, somewhere, every coherent book ever written, or that might ever be written, and every possible permutation or slightly erroneous version of every one of those books.
I like this. Some binary running on a computer serving these up to a FUSE mount would stop a corporate disk scanner in its tracks (at least whatever thread happens upon the location this is mounted.)
I might have a go writing something like this for my Mac.
This is all a reference to the short story ‘Library of Babel’ by Jorge Luis Borges. I feel the page needs to make that a bit more clear!
https://en.wikipedia.org/wiki/The_Library_of_Babel
It's not really clear to be honest, you might really want to improve the explanation of what it IS.
Since I didn't think to post it earlier, here is the related video that explains the project: https://youtube.com/watch?v=w6rkhvdAqHU
[dead]