Hey all, a little while ago I set up Openpanel in some of my projects but very quickly hit the limits and was starting to have to pay $50 to keep the events flowing in. I thought this was crazy, as I really wasnt sending that many events.
I was thinking, surely it can't be that expensive to store events. I looked into self hosting Openpanel, and it's even crazier. You need redis, clickhouse, postgres, beefy machine. I realized I am paying a tonne of money for features that are completely irrelevent now. I don't need instant charts. In fact, I would prefer to never even go to your ugly dashboard and figure out how to use it. So i'm paying this extreme premium so these services can compute all these indexes and what not so they can deliver me any chart I want in a second. It's crazy.
I thought about what I really needed as a lot of my work is done with claude/codex now and realized all I really wanted was to get the raw events and have my agent analyze them with duckdb, let me ask questions, and make charts.
I looked at a few ways of doing this but the simplest and cheapest was cloudflare. Literally, just store the events in R2, and then the agent can pull them down when it wants.
What I do instead is I have a 1tb SSD, I pull down my events from r2 when I want and load it into duckdb. Now my agent can do whatever it wants. It's not limited by the capabilities gifted to me by amplitude etc. Heck, it can even write python scripts or anything. You could create Jupyter notebooks to view it, so many options.
I have been using this in prod, but thought i'd open it up if anyone wants to try: https://slurp.run/
It's fully open source, and you can one click to install it. Lmk if you try it and run into any issues.
One cool thing I got working too, is you can literally point your segment/sentry clients at the cloudflare endpoint.
Hey all, a little while ago I set up Openpanel in some of my projects but very quickly hit the limits and was starting to have to pay $50 to keep the events flowing in. I thought this was crazy, as I really wasnt sending that many events. I was thinking, surely it can't be that expensive to store events. I looked into self hosting Openpanel, and it's even crazier. You need redis, clickhouse, postgres, beefy machine. I realized I am paying a tonne of money for features that are completely irrelevent now. I don't need instant charts. In fact, I would prefer to never even go to your ugly dashboard and figure out how to use it. So i'm paying this extreme premium so these services can compute all these indexes and what not so they can deliver me any chart I want in a second. It's crazy.
I thought about what I really needed as a lot of my work is done with claude/codex now and realized all I really wanted was to get the raw events and have my agent analyze them with duckdb, let me ask questions, and make charts.
I looked at a few ways of doing this but the simplest and cheapest was cloudflare. Literally, just store the events in R2, and then the agent can pull them down when it wants.
What I do instead is I have a 1tb SSD, I pull down my events from r2 when I want and load it into duckdb. Now my agent can do whatever it wants. It's not limited by the capabilities gifted to me by amplitude etc. Heck, it can even write python scripts or anything. You could create Jupyter notebooks to view it, so many options.
I have been using this in prod, but thought i'd open it up if anyone wants to try: https://slurp.run/
It's fully open source, and you can one click to install it. Lmk if you try it and run into any issues.
One cool thing I got working too, is you can literally point your segment/sentry clients at the cloudflare endpoint.