Skip to main content

5. How to test your interview agents

Before sharing your interview agent with a large audience, you probably want to test it and ensure that you are happy with its performance and behavior.

Every AI tool by definition is characterized by a bit of uncertainty. This is the power of AI technology - we want the interview agent to react to the answers of our users - but also its weakness.

Let's go through a few aspects that you can test in order to be confident about your interview agent.

Tests 1: Frontend​

  • Will your audience understand what you want from them?
  • The combination of interview title, subtitle and description: Do they give the full picture of what the user's task is? What your goal is? Why they should participate?
  • Did you set up the branding correctly? Did you use your main color from your corporate identity? Do you have your company's logo uploaded?
  • Did you provide all legal links so that data collection through ValueFlow and your processing of interview contents is compliant?

Tests 2: Interview configuration​

  • Start the interview and talk to the AI. Do you like the opening and the questions? If you are not yet happy, go back to the interview configuration under Specification and iterate on each interview aspect.

  • Test some extreme cases where you pretend that the interviewee shows negative behavior. Is the AI responding the way you would like it to respond?

  • Is your entrypoint/frontend activated? If it is deactivated, then no one will be able to use this interview agent. While this function is good for pausing an agent, it can lead to confusion as to why your external link only shows a blank white page.

Tests 3: Interview concept​

  • The maximum duration of an interview is 30 minutes. Is your interview structured such that this time will be enough? If you need more time, we advise breaking one large interview up into multiple smaller interview agents.

Other potential pitfalls:​

  • Browsers and devices: ValueFlow is currently meant to be used through the web browsers Chrome and Firefox. If you expect that your audience will mainly be mobile or on different browsers than Chrome and Firefox, you should test these devices and browsers. While they are not officially supported, it is possible that the experience is fine.

  • Niche languages: While ValueFlow supports > 30 languages, it is possible that you desire a rather niche language, which is not officially supported. Unofficially, the used AI model might be able to speak your language, even though we officially do not advertise it. For these cases, you should simply give it a try.