CanaryFlock synthetic product evaluation

Read this first. These are simulated people, not your customers. Every number below describes what happened inside a simulation, and none of it is a forecast of what real users will do.

What the run can tell you is where people struggled and who struggled there — and each of those is backed by a recording you can check. Synthetic people are more patient, more literate and more single-minded than real ones, so treat the places as findings and the percentages as description.

what we ran

https://canaryflock.com/

Work out what this costs and whether you can try it without talking to a salesperson

This is our own home page, run before we fixed it. The main call to action opened a mail client — which in a browser looks like nothing happening — and there was no price anywhere on the page. Both are fixed now. The run cost $0.24 and took under two minutes.

8people
0finished
8gave up
0ran out of steps

Where people struggled

1

canaryflock.com/

abandon

7 of 8 people (88%) struggled here

  • user gave up here (×7)
  • frustration jumped +0.29 (×3)
  • frustration jumped +0.19 (×2)
  • frustration jumped +0.2
In their wordsI've clicked 'SEND IN THE FLOCK' three times now and nothing is happening — no new page, no form, no information. This website is not loading properly or responding to my clicks. I came here to find out the cost and whether I can try it without talking to sales, but after six attempts I'm still on the homepage with no progress. The page is too slow or broken, and I don't have patience for this.I've clicked 'SEND IN THE FLOCK' three times now and nothing happens — the page doesn't change. This isn't working on mobile, and I've wasted several steps. I'm frustrated and not getting anywhere near pricing or a trial option. I'm done here.I've clicked 'SEND IN THE FLOCK →' multiple times (steps 10, 13, 14) and nothing has changed — I'm still on the same homepage. The page doesn't seem to be responding to my clicks, or these links aren't actually functional. I've also tried 'READ NINE REAL RUNS' and gone back to examples, but I still haven't found any pricing information, trial options, or a way to try the service without contacting sales. After 15 steps of exploring, I'm stuck in a loop. The website isn't giving me the information I came for, and clicking the same buttons repeatedly clearly isn't working.
2

canaryflock.com/

click e3

5 of 8 people (63%) struggled here

  • same control touched 3+ times (×5)
  • frustration jumped +0.19 (×2)
Hit hardestage: 55-64 (20% vs 13% of cohort)age: 45-54 (20% vs 13% of cohort)tech literacy: low (20% vs 13% of cohort)
In their wordsI've clicked this button before but nothing seemed to happen. Let me try again - maybe I need to wait for it to load or perhaps my previous clicks didn't register properly. I want to get past this home page and find the pricing information.I've clicked this link before without success, but I'm persistent and need to find pricing or trial information. Let me try clicking it again more deliberately to see if it leads somewhere new this time.I need to actually get to the product and see the pricing. The 'SEND IN THE FLOCK' button should take me somewhere new, but it didn't work the last two times. Let me try once more — maybe I didn't click it properly on mobile, or the page needs a moment to load.
3

canaryflock.com/examples

click e0

3 of 8 people (38%) struggled here

  • frustration jumped +0.15 (×2)
  • same control touched 3+ times
Hit hardestage: 55-64 (33% vs 13% of cohort)tech literacy: low (33% vs 13% of cohort)device: desktop (33% vs 13% of cohort)
In their wordsI've been clicking around on this examples page but I'm not finding pricing information. Let me go back to the home page to look for cost details or pricing information. I need to understand what this actually costs before I can decide whether to try it.I'm still on the examples page and haven't gotten to pricing or a way to try the service. Let me go back HOME to see the main page properly — maybe there's a clearer path to pricing and a trial option from there.I'm on an examples page showing test runs of a service, but I still haven't found pricing or trial information. Let me go back to the home page to look for a clearer path to pricing, cost details, or a way to try the service. The HOME link should take me back to the main page where there might be better navigation.

Who it happened to

No group of a readable size behaved very differently from the average.

10 groups had fewer than 3 people and are left out: a rate from one or two people is not a rate.

Who we sent

16-24: 3 · 35-44: 3 · 45-54: 1 · 55-64: 1
digital skill — high: 2 · low: 1 · medium: 5
7 of 8 on a phone

Ages and digital skill are drawn from Eurostat — the ICT usage survey and the population register — rather than invented. How those people then behave is a model, and that part is not calibrated against real users yet.

This is a real run, and you can start one on your own product in about a minute — three free, work email, no card.

Start a free run →