Features: Testing [Chat Thing](https://chatthing.ai/) Open main menu - Features - Use Cases - [Pricing](https://chatthing.ai/#pricing) - Resources [Log in](https://app.chatthing.ai/app/auth/login) [ Book a demo](https://chatthing.ai/demo) [Sign up](https://app.chatthing.ai/app/auth/register) Testing # Stop guessing. Know your bot works. Automatically evaluate your assistant's answers for factuality and relevance, so you can change models, tweak prompts and expand data sources with total confidence. - Custom test scenarios - Automated evaluation - Compare models & prompts [Get started for free ](https://app.chatthing.ai/app/auth/register) [Book a demo →](https://chatthing.ai/demo) ![Mal McCallion avatar](https://cdn.senja.io/public/avatar/6d9f5108-1d2a-4871-b6fb-ebf60952d703_Mal_2024_PPW.png?width=60&height=60&format=webp)![Kouki avatar](https://cdn.senja.io/public/avatar/67ab0746-4900-470b-8c9f-c88d03e6156f_fukurou_hiru.png?width=60&height=60&format=webp)![Paul Popus avatar](https://cdn.senja.io/public/media/681740b1-1576-47b4-9ff9-7ec0a8f9ab11_44a0ecad-e6d5-4d6b-bc3a-669ce412e257_Emg36qyx_400x400.jpg?width=60&height=60&format=webp)![ONG YONG XUN avatar](https://cdn.senja.io/public/media/42618761-975a-48b1-b2ff-42e23be9c778_36187d02-14ea-46e7-bf29-75507180c55c_splash.webp?width=60&height=60&format=webp)![kouki avatar](https://cdn.senja.io/public/avatar/e30dd09b-1242-465f-9705-5de830554314_750px.png?width=60&height=60&format=webp) Loved by 10,000+ users [5Product Hunt#5 Product of the Day](https://www.producthunt.com/posts/chat-thing-2?utm_source=badge-top-post-badge&utm_medium=badge) Try it live. Ask about testing Loading the assistant… How does automatic bot testing work? Can I compare different models? How do I know my answers are accurate? ### Say goodbye to manual checks ## Automate your bot evaluation process No more endless hours of vibe checking – now you can be certain your bot is performing at its best. Are you tired of manually checking your AI bot's responses? With Chat Thing's new testing feature, you can stop relying on gut feelings and start making data-driven decisions. Our automated evaluation system allows you to create custom test scenarios, ensuring your bot delivers accurate and relevant responses every time. - Create custom test scenarios - Evaluate responses for factuality and relevance - Save time and resources on manual checks ### ![](https://res.cloudinary.com/djyjvrw5u/image/upload/v1728558481/Testing_1_5507b75d2a.webp) ![Stars](https://chatthing.ai/_marketing/stars-home.D5OhV8q5.svg)![Stars](https://chatthing.ai/_marketing/stars-home.D5OhV8q5.svg) ### Evaluation features to test your bot's performance ## Empower your AI bot with comprehensive testing #### Custom test scenarios Create tailored sets of questions to evaluate your bot's capabilities #### Automated evaluation Assess responses for factuality, relevance, and other crucial factors #### Performance tracking Monitor your bot's improvement over time with detailed analytics #### Model comparison Easily switch between AI models to find the best fit for your needs #### Prompt optimisation Refine your prompts based on test results for better outcomes #### Data source insights Identify gaps in your knowledge base and expand as needed ### Upgrade with confidence ## Make informed decisions about your AI bot With Chat Thing's testing feature, you can now make changes to your bot with complete assurance. Want to try a different AI model? Curious about tweaking your prompts? Need to expand your data sources? Our comprehensive testing suite has got you covered. By providing concrete data on your bot's performance, you can iterate and improve with precision. No more guesswork – just clear, actionable insights that help you create the most effective AI assistant for your business. - Experiment with different AI models - Fine-tune prompts for optimal results - Identify and fill knowledge gaps ### ![](https://res.cloudinary.com/djyjvrw5u/image/upload/v1728558114/Testing_Interface_1_69d3a02e37.webp) ### Testimonials ## Don't take our word for it 10,000+ innovative companies are using Chat Thing to build AI bots more easily and quickly. [View more](https://senja.io/p/chat-thing/iq1tWz) ## Ready to start creating bots? Create a free account today. Create bots that solve all sorts of problems in minutes. Customer support bots, writing buddies, HR bots, API docs bots or what ever Chat Thing you can think of! Join the 9,000+ others [Create a free bot](https://app.chatthing.ai/app/auth/register) Free, no CC required! ## Footer ### Ready to answer every question, day or night? Add an AI support agent to your site in minutes. [Get started free](https://app.chatthing.ai/app/auth/register) [Book a demo](https://chatthing.ai/demo) AI customer support that learns from your content and answers 24/7. ### Features - [Channels: Deploy your bot](https://chatthing.ai/pages/features/channels) - [Data sources: Add knowledge](https://chatthing.ai/pages/features/data-sources) - [Power-ups: Tool calling](https://chatthing.ai/pages/features/power-ups) - [AI Models: GPT-4, Claude, & more](https://chatthing.ai/pages/features/models) - [SDK: Create custom assistants](https://chatthing.ai/pages/features/chatbot-sdk) - [Bot evaluations: Test your bot](https://chatthing.ai/pages/features/testing) - [Analytics: Topics, sentiment & insights](https://chatthing.ai/pages/features/analytics) - [Bot Gallery: Example bots](https://chatthing.ai/gallery) - [All features](https://chatthing.ai/features) ### Use cases - [AI Customer Support Bots](https://chatthing.ai/pages/use-cases/customer-support) - [AI Internal Knowledge Bots](https://chatthing.ai/pages/use-cases/internal-knowledge) - [AI Bots for Marketing](https://chatthing.ai/pages/use-cases/marketing) - [SDK: Create custom assistants](https://chatthing.ai/pages/features/chatbot-sdk) - [All features](https://chatthing.ai/features) ### Channels - [AI support for your website](https://chatthing.ai/pages/features/channels/website) - [AI support for Slack](https://chatthing.ai/pages/features/channels/slack) - [AI support for Discord](https://chatthing.ai/pages/features/channels/discord) - [AI support for WhatsApp](https://chatthing.ai/pages/features/channels/whatsapp) - [AI support for Telegram](https://chatthing.ai/pages/features/channels/telegram) - [AI support API](https://chatthing.ai/pages/features/channels/api) ### Data sources - [Chat with your website](https://chatthing.ai/pages/data-source/web) - [Chat with your files](https://chatthing.ai/pages/data-source/files) - [Notion chatbots](https://chatthing.ai/pages/data-source/notion) - [Chat with your youtube](https://chatthing.ai/pages/data-source/youtube) - [Chat with your RSS feed](https://chatthing.ai/pages/data-source/rss) ### Company - [Discord](https://discord.com/invite/DGCCR34Fsj) - [Docs](https://chatthing.ai/docs/getting-started) - [Blog](https://chatthing.ai/blog) - [FAQ](https://chatthing.ai/faq) - [Status](https://status.chatthing.ai/) - [Testimonials](https://senja.io/p/chat-thing/iq1tWz) - [Custom AI development](https://chatthing.ai/pages/ai-development-services) ### Free tools - [Agent Readiness Checker](https://chatthing.ai/tools/agent-readiness-checker) - [JSON-LD Generator + Checker](https://chatthing.ai/tools/json-ld-generator) - [llms.txt Generator & Validator](https://chatthing.ai/tools/llms-txt-generator) - [Support Ticket Deflection Calculator](https://chatthing.ai/tools/ticket-deflection-calculator) - [Knowledge Base Grader](https://chatthing.ai/tools/knowledge-base-grader) - [AI FAQ Generator](https://chatthing.ai/tools/faq-generator) - [AI Canned Response Generator](https://chatthing.ai/tools/canned-response-generator) - [Support Bot Prompt Generator](https://chatthing.ai/tools/support-bot-prompt-generator) - [All free tools](https://chatthing.ai/tools) ### Compare - [Intercom alternative](https://chatthing.ai/pages/alternatives/intercom) - [Zendesk alternative](https://chatthing.ai/pages/alternatives/zendesk) - [Tidio alternative](https://chatthing.ai/pages/alternatives/tidio) - [Crisp alternative](https://chatthing.ai/pages/alternatives/crisp) - [Chatbase alternative](https://chatthing.ai/pages/alternatives/chatbase) - [DocsBot alternative](https://chatthing.ai/pages/alternatives/docsbot) - [ResolveAI alternative](https://chatthing.ai/pages/alternatives/resolveai) - [ChatBotKit alternative](https://chatthing.ai/pages/alternatives/chatbotkit) - [CustomGPT alternative](https://chatthing.ai/pages/alternatives/customgpt) - [Botsonic alternative](https://chatthing.ai/pages/alternatives/botsonic) - [Ada alternative](https://chatthing.ai/pages/alternatives/ada) ### Join our newsletter Be the first to know about new features and updates. Join [Privacy](https://chatthing.ai/legal/privacy) [Terms](https://chatthing.ai/legal/terms) [DPA](https://chatthing.ai/legal/dpa) [GDPR](https://chatthing.ai/legal/gdpr) [Sub-Processors](https://chatthing.ai/legal/sub-processors) [Twitter](https://twitter.com/pixelhopio) [Discord](https://discord.com/invite/DGCCR34Fsj) [YouTube](https://www.youtube.com/@ChatThingAI) © 2026 Chat Thing. All rights reserved. Company number: 14789358. Built with by [Pixelhop](https://pixelhop.io?utm_source=chat+thing&utm_medium=website) ## Cookies We use cookies to run the site and understand how it's used. You can change your choice anytime. Accept Decline Customise