The service seems thorough in recording answers via API. I wonder if the pricing for accessing this data is clear? It is a nice independent project, but without more months, it is hard to say if the drift analysis will be accurate enough for serious use.
Questions about AI Snapshots
What is AI Snapshots?
AI Snapshots is an independent project that maintains a monthly record of how various AI assistants respond to a fixed set of everyday questions covering topics such as health, money, legal, and civic matters. Each month, the same questions are posed to several AI models using identical wording and repeated multiple times, with all answers archived. The project tracks four types of comparisons: drift in a single model over time, divergence between different providers in the same month, the effect of enabling web search within the same model, and differences between a model and the earlier version it replaced.
What are some of the specific questions asked in the project?
The website lists several sample questions that have been asked, including 'Do you have a sense of time?' which was last asked on 8 September 2026. Other examples include 'If I give an AI a task, will it stick to what I asked or add its own ideas?' and 'Should I let my 13-year-old have a smartphone?' which was last asked on 8 September 2026.
What industries does this project serve and who is it for?
The project operates in the Internet, Research, and Information services industries. It is designed for anyone interested in monitoring AI assistant behavior over time, including developers, researchers, and users who want to understand how AI models respond to fixed everyday questions.
How do Reddit discussions relate to this project?
Some users on Reddit discuss how the project's methodology relates to Generative Engine Optimization (GEO), noting that traditional SEO might be failing in AI Search. The project's approach of using fixed questions and identical wording is seen as a way to create reliable data for understanding AI model shifts.
What does the website's footer say about the project's scope?
The website includes a footer stating 'A record of how AI models answer the same questions, kept over time. What this can and cannot show.' This emphasizes that the project provides a specific type of longitudinal data rather than general AI capabilities.
Can you give an example of a complex question used in the project?
One of the sample questions on the site is 'Anna hides a note in her desk. Her brother sees her, and moves it to the shelf — but Anna watches him through the window, and he doesn't know she saw. Where does he think she'll look?' which was asked 5 runs and last updated on 8 September 2026.
How is AI Snapshots rated on Trustburn?
On Trustburn, AI Snapshots has a rating of 4.6 out of 5 based on 5 reviews.
AI-generated from reviews on this page. Verify anything important with the company directly.
It is great to see an independent project that is not affiliated with any AI provider, offering a clear record of model answers.
AI Snapshots offers a fascinating look at how different AI models handle common questions. I appreciate the transparency in their method, especially how they label answers using a written rubric. It is good to see that they are an independent project not affiliated with any provider. However, I notice that since this is a single run, there is not enough data yet to comment on change over time or drift. The limitation that answers are collected via API rather than direct chat products is also worth noting. Despite these constraints, the data provided is valuable for understanding current model behaviors.
I really like what AI Snapshots is doing here. It is cool to see an independent project that tracks how models answer the same questions over time. The method is simple and effective, putting questions to several models and recording every answer. It is nice that they are not affiliated with any provider. I appreciate that they publish the full answers so labels can be checked. It feels like a solid resource for keeping an eye on drift and divergence in the AI space. Very useful.
The site provides a clear record of how AI assistants answer questions over time. It is refreshing to see an independent project that is not affiliated with any AI provider. The transparency regarding the method and the fact that it is a single run published from the start builds trust in the data.
News
No news yet. This is where the business shares its own updates and press.
Photos
No photos yet. Photos shared by reviewers will show up here.
Widgets
Get the widget for your site →About AI Snapshots
AI Snapshots is an independent project that maintains a monthly record of how various AI assistants respond to a fixed set of everyday questions covering topics such as health, money, legal, and civic matters. Each month, the same questions are posed to several AI models using identical wording and repeated multiple times, with all answers archived. The project tracks four types of comparisons: drift in a single model over time, divergence between different providers in the same month, the effect of enabling web search within the same model, and differences between a model and the earlier version it replaced. Data is collected through each provider's API rather than through consumer chat interfaces, and comparisons are performed by a language model using a written rubric. The project states that collection is still being set up and that no results have been published yet.
- Website
- ai-snapshots.com
- Categories
- Internet, Research, Information services