Oh man, that is a rough space to be in. Don't get me wrong, I am kinda jelly of your assignment here, but there are bunch of things to keep in mind.
"some sort of entity that keeps the context of what's going on in the company"
This is the killer piece, because I know what it would mean to me, but did CTO give you a clear indicator of what he means? All the meetings, drafts and whathaveyou won't automatically capture those.
- wiki equivalent is good, but it comes with the expectation that it is updated, current and accurate ( with as little as possible not listed -- which can be a pickle for some uses )
- databases - you want to be careful here for obvious reasons esp if your databases hold anything beyond simple purchase orders
- 24x7 agent could cost less long term if you go for local inference ( and accept some speed trade-offs )
- orchestration - there is a lot money sloshing around this one including big boys - I did not see good corporate orchestration suite yet ( though I am sure it exists )
<< is there a better way to accomplish this? Am I over complicating things? Am I over simplifying things?
Maybe. Get the feel whether CTO is actually asking for a prettier dashboard or something more meaningful. I am not joking.
When I recently spoke to their engineers about this, they mentioned graph maintenance is very expensive and would likely be cost prohibitive for most orgs.
Oh man, that is a rough space to be in. Don't get me wrong, I am kinda jelly of your assignment here, but there are bunch of things to keep in mind.
"some sort of entity that keeps the context of what's going on in the company"
This is the killer piece, because I know what it would mean to me, but did CTO give you a clear indicator of what he means? All the meetings, drafts and whathaveyou won't automatically capture those.
- wiki equivalent is good, but it comes with the expectation that it is updated, current and accurate ( with as little as possible not listed -- which can be a pickle for some uses ) - databases - you want to be careful here for obvious reasons esp if your databases hold anything beyond simple purchase orders - 24x7 agent could cost less long term if you go for local inference ( and accept some speed trade-offs ) - orchestration - there is a lot money sloshing around this one including big boys - I did not see good corporate orchestration suite yet ( though I am sure it exists )
<< is there a better way to accomplish this? Am I over complicating things? Am I over simplifying things?
Maybe. Get the feel whether CTO is actually asking for a prettier dashboard or something more meaningful. I am not joking.
I expect frontier labs to solve this. Anthropic has a recipe here: https://platform.claude.com/cookbook/capabilities-knowledge-...
When I recently spoke to their engineers about this, they mentioned graph maintenance is very expensive and would likely be cost prohibitive for most orgs.
[flagged]