Manual AI Visibility Testing: DIY Methodology

Why Manual AI Testing Matters for Your Brand

In today’s AI-driven search landscape, manual AI testing has become essential for understanding how your brand appears in AI-generated responses. Recent data shows that 60% of Google searches now feature AI answers, fundamentally changing how visibility is measured and earned. Traditional SEO metrics like organic click-through rates and keyword rankings no longer tell the complete story—your content could rank perfectly on Google while being completely absent from AI responses. Manual testing serves as a cost-effective baseline that helps you understand your current AI visibility before investing in optimization strategies. By conducting DIY testing yourself, you gain immediate insights into how AI systems perceive and cite your content.

Understanding AI Visibility Metrics That Matter

To effectively test AI visibility, you need to understand the key metrics that determine your brand’s presence in AI responses. These metrics go beyond traditional SEO and focus specifically on how AI systems recognize, cite, and present your content. Here’s what you should be tracking:

Each of these metrics reveals different aspects of your AI visibility. Brand mentions show whether AI systems recognize your company at all, while citations demonstrate whether your content is trusted enough to be sourced directly. Share of voice helps you understand your competitive position—are you mentioned as often as competitors in similar queries? Sentiment tracking ensures your brand appears in positive contexts, and citation quality reveals whether AI systems are using your content as a primary source or merely paraphrasing it.

Ready to Monitor Your AI Visibility?

Track how AI chatbots mention your brand across ChatGPT, Perplexity, and other platforms.

Start Free Trial Book a Demo

Setting Your Baseline: Query Categories to Test

Before diving into manual testing, you need to establish a baseline by testing across different query types that matter to your business. Not all queries are created equal, and your visibility will vary significantly depending on what users are asking. Start by categorizing the queries you want to test:

• Informational queries - Users seeking knowledge or explanations (e.g., “what is content marketing”)
• Navigational queries - Users looking for your brand specifically (e.g., “AmICited AI visibility tool”)
• Transactional queries - Users ready to make a purchase or take action (e.g., “best AI monitoring software”)
• Competitor comparison queries - Users comparing you to alternatives (e.g., “AmICited vs competitors”)
• How-to/instructional queries - Users seeking step-by-step guidance (e.g., “how to improve AI visibility”)

Testing across all five categories gives you a comprehensive view of where you’re winning and losing in AI responses. Your visibility will likely be strongest in navigational queries (where your brand is explicitly mentioned) and weakest in broad informational queries where you’re competing against dozens of sources. By establishing this baseline across all query types, you’ll have a clear picture of your starting point before optimization.

The Manual Testing Process: Step-by-Step

Now that you understand what to measure and which queries to test, it’s time to execute your DIY AI visibility testing. The process is straightforward but requires consistency and attention to detail. Here’s how to conduct manual testing across the major AI platforms:

1. Select your test queries (10-20 queries across the five categories)

   • Choose queries relevant to your industry and business goals
   • Include both branded and non-branded variations
   • Mix high-volume and long-tail queries

2. Test on ChatGPT

   • Use the free version or ChatGPT Plus depending on your needs
   • Enter each query and document the response
   • Note whether your brand is mentioned and how it’s cited

3. Test on Perplexity AI

   • Access Perplexity.ai and run the same queries
   • Pay special attention to the sources cited at the bottom
   • Record whether your domain appears in the citations

4. Test on Google AI Overviews

   • Search each query on Google.com
   • Look for the AI Overview box at the top of results
   • Document your brand’s presence and positioning

5. Test on Google AI Mode (if available)

   • Access Google’s experimental AI features
   • Compare results to standard Google AI Overviews
   • Note any differences in how your content is presented

6. Document everything systematically

   • Record exact quotes from AI responses
   • Note the order of citations (first source vs. later sources)
   • Capture screenshots for reference and future comparison

Stay Updated on AI Visibility Trends

Get the latest insights on AI mentions, brand monitoring, and optimization strategies.

Email address

Subscribe

Creating Your AI Visibility Testing Spreadsheet

Organization is critical when conducting manual AI testing across multiple platforms and queries. A well-structured spreadsheet becomes your command center for tracking results and identifying patterns. Here’s the template structure you should use:

| Query | Platform | Brand Mentioned | Citation | Sentiment | Source URL | Notes |
|-------|----------|-----------------|----------|-----------|-----------|-------|
| "content marketing" | ChatGPT | Yes | Direct quote | Positive | amicited.com | Mentioned as authority |
| "content marketing" | Perplexity | No | N/A | N/A | N/A | Not included in response |
| "AI visibility" | Google AI | Yes | Paraphrase | Neutral | amicited.com | Listed 3rd source |

Create columns for the query tested, which platform you tested it on, whether your brand was mentioned, the type of citation (direct quote, paraphrase, or link only), the sentiment of the mention, the source URL cited, and any additional notes. This structure allows you to quickly scan results and spot trends. As you accumulate data across 10-20 queries and 4 platforms, you’ll have 40-80 data points that reveal clear patterns about your AI visibility. Consider using Google Sheets or Excel so you can easily sort, filter, and analyze the data.

Analyzing Your Results: Finding Patterns and Insights

Once you’ve completed your manual testing across all platforms and queries, the real work begins—interpreting what the data tells you. Look for patterns rather than individual data points: Are you consistently cited in certain query categories but absent from others? Do you appear more frequently on some platforms than others? Calculate your share of voice by counting how many times you’re mentioned versus your top three competitors across the same queries. Identify which of your pages or content pieces are being cited most frequently—these are your strongest assets in the AI visibility game. Pay attention to sentiment: are mentions positive, neutral, or occasionally negative? Finally, assess citation quality: are you being quoted directly (highest value) or merely paraphrased (lower value)? These patterns reveal where your content resonates with AI systems and where you need to improve.

Common Mistakes to Avoid in Manual Testing

Even with the best intentions, many teams make critical errors when conducting manual AI testing that skew their results and lead to poor decisions. Avoid these common pitfalls:

• Testing at different times without accounting for AI variability - AI responses change frequently; test all platforms on the same day for consistency
• Using only branded queries - You’ll miss opportunities in non-branded searches where you could gain visibility
• Not documenting exact responses - Screenshots and direct quotes are essential for tracking changes over time
• Testing from different locations or accounts - Geographic and account-based personalization affects results; keep variables constant
• Ignoring long-tail queries - These often have less competition and may show better visibility than broad terms
• Failing to test competitor queries - You need to understand how you stack up when users search for alternatives
• Not repeating tests over time - A single test snapshot is less valuable than tracking changes week-over-week

When to Transition from Manual to Automated Monitoring

Manual testing provides valuable insights, but it’s not scalable for long-term monitoring. After you’ve established your baseline and understand your AI visibility landscape, you’ll want to transition to automated monitoring solutions. AmICited.com is the leading platform for continuous AI visibility monitoring, tracking your brand mentions and citations across ChatGPT, Perplexity, Google AI Overviews, and other major AI systems automatically. While manual testing is perfect for initial discovery and understanding the landscape, automated tools become essential once you’re actively optimizing and need to track changes in real-time. The transition typically happens after 2-4 weeks of manual testing, once you’ve identified your key queries and baseline metrics. At that point, automation saves you hours each week while providing more comprehensive and consistent data. Manual testing gives you the foundation; automation gives you the ongoing intelligence to stay competitive in the AI-driven search era.

Optimizing Your Content Based on Testing Insights

Your manual testing data is only valuable if you act on it. Use your findings to create a prioritized optimization roadmap that focuses on the highest-impact opportunities. If you discovered that you’re completely absent from AI responses for high-value transactional queries, create or optimize content specifically designed to answer those questions comprehensively. When you find that competitors are cited more frequently than you, analyze their content to understand why AI systems prefer their approach—then improve your own content to match or exceed that quality. For queries where you’re mentioned but only paraphrased, consider creating more quotable, distinctive content that AI systems will want to cite directly. Prioritize optimizing pages that already have some AI visibility, as these are easier wins than breaking into completely new query categories. Track your progress by re-testing the same queries monthly to measure whether your optimization efforts are moving the needle. Remember that AI visibility is a long-term game—consistent, data-driven optimization based on your manual testing insights will compound over time, establishing your brand as a trusted source across AI platforms.