I modified the OpenAI Realtime API Console Demo App to add a map to it, and I connected the map events to the Realtime API.
Result... Im able to move around the map and talk to it! Its fascinating how its able to reverse geocode out of memory, Ideally I should add tools to reverse Geocode the locations. Im planning to add more tools to it like internet speed locations and maybe weather
I modified the OpenAI Realtime API Console Demo App to add a map to it, and I connected the map events to the Realtime API.
Result... Im able to move around the map and talk to it! Its fascinating how its able to reverse geocode out of memory, Ideally I should add tools to reverse Geocode the locations. Im planning to add more tools to it like internet speed locations and maybe weather
https://github.com/milind-soni/realtime-map-chat
Check out here if you would like to use the code