I used the same concept to build a searchable database of YouTube thumbnails in my watch history. I always end up trying to remember a video I didn't finish from a week or two ago and YouTube's history search plain sucks. So I built an app that tracks all my watch history across all devices, downloads the thumbnails and runs them through a local Gemma model to write a paragraph description and OCR any text in the thumbnail.
Currently at 30,000 thumbnails described, basically 2 years of watch history. Search is via FTS5 in SQLite and works great on an 8 year old MacBook Pro.
This is cool, but I agree name is weird. Kind of wonder if the timeline should be logarithmic because I would assume the distribution of art over the years is far from uniform.
This website likely uses a semantic vector space like CLIP or BERT space. Which is based on co-occurrence of words, it doesn't have a harder logic behind it. Soviets probably had cylinders in some machinery which is why it pulled.
Curious whether the embeddings come off the images or the catalog text, because in my experience museum metadata is wildly uneven (half the Met's older records are basically "Vase, terracotta"). Also, do you dedupe across institutions?
I used the same concept to build a searchable database of YouTube thumbnails in my watch history. I always end up trying to remember a video I didn't finish from a week or two ago and YouTube's history search plain sucks. So I built an app that tracks all my watch history across all devices, downloads the thumbnails and runs them through a local Gemma model to write a paragraph description and OCR any text in the thumbnail.
Currently at 30,000 thumbnails described, basically 2 years of watch history. Search is via FTS5 in SQLite and works great on an 8 year old MacBook Pro.
what kind of storage impact do you have?
Currently at 3.8 GB for the YouTube thumbnails. An additional 800 MB for Crunchyroll thumbnails.
Incredibly off-putting name for a search tool
I agree. When did we, the tech set, become so arrogant?
We? There is no monolith here, this is individual arrogance from people who believe AI is driving us to the end of history
This is cool, but I agree name is weird. Kind of wonder if the timeline should be logarithmic because I would assume the distribution of art over the years is far from uniform.
Completely failed if you search by Artist name
Would make sense to have a copywrite filter so you can specify to see only public domain images.
Interesting concept. Its desperately missing a decent filter function though.
Just dumping a million results on the user to doom-scroll through is a bit problematic in terms of UI/UX.
There's nothing between 1975-2026?
EDIT: Ok, there is, but it needs a query...
I searched for 'soviet' and it matched cylinder seal 3500bc https://lastmuseum.com/art/cylinder-seal-307
soviets were big into seals and govt procedures . maybe?
This website likely uses a semantic vector space like CLIP or BERT space. Which is based on co-occurrence of words, it doesn't have a harder logic behind it. Soviets probably had cylinders in some machinery which is why it pulled.
can you help me, how is your comment different than what i said?
Curious whether the embeddings come off the images or the catalog text, because in my experience museum metadata is wildly uneven (half the Met's older records are basically "Vase, terracotta"). Also, do you dedupe across institutions?