A web browsing application can implement a vector database to store session data. A web browsing application can automatically embed loaded web content into an embedded data store that maintains session data for a number of web sessions. A user can query the web browser using simple instructions. The web browser can interpret the instructions and use the embedded data store to quickly search across multiple modalities of embedded data to retrieve relevant results. The web browser can use machine-learned models to answer queries or perform other tasks by performing vector-based queries over the content of visited web data.