How it works, day by day

Sixteen apps test each other for 16 days. This is every step, what is checked and how, what it costs to leave, and the report you get at the end.

How we do it

Four steps from a package name to a finished closed test. Every number below is what the product does today.

  1. Paste the package name and invite our service account in Play Console with one read-only permission. TestersGuild reads your closed testing track through the Play Developer API and cannot change your listing.

    read-only access

    The add-an-app form: a package name field and an Add app button
  2. We confirm our Google Group is on your track, a release is out of draft, and every country on Google’s list is covered (about 177 today). If one is missing we say which, so no tester hits “app not found”.

    group · release · 177 countries

    The app card marked Ready after the setup check passed
  3. A full cohort has an install phase (8 hours). Each member installs the other apps from the Play Store, and everyone sees a count like “11 of 16 ready”, never names. The cohort starts the moment every member has installed at least 13 of the 15 others. Anyone who does not is removed and a reserve is offered the seat.

    installer · version code · 2 devices per app

    Today: the apps this tester has installed, each with an Open button
  4. Every day, open at least 70% of your list for 30 seconds each. Every week, rate and write about 3 apps. The cohort runs 16 days, two more than Google asks, because people install on different days. Everyone locks a $15.00 stake, so leaving costs something.

    16 apps · 16 days · $15.00 stake

    Cohort: sixteen tiles, your app in blue, the day bar and the locked stake

Verify before you commit

Catch common Google Play closed-testing setup problems before your cohort begins. We check what Google’s API lets us read and tell you what to fix, in plain words.

Built

Guided manual setup

  • You follow step-by-step instructions in the app and invite our service account yourself in Play Console, with one read-only permission on one app.
  • We then check the supported settings: your tester group on a testing track, a published release, and the countries it is offered in.
  • Nothing is changed in your Play Console by this check.

Coming

Connected setup

  • Optional. Sign in with Google once and we add the same read-only service account for you, then discard the sign-in token.
  • Saves the manual invite and finds mistakes sooner. It is not required, and the manual route stays.
  • You can remove the service account at any time in Play Console under Users and permissions.

Not every mistake can be detected. The API shows saved settings, including changes still in review, so a pass means configured, not yet visible to testers. The app counts as verified after a first confirmed install. Access is read-only and limited to the app you add.

What you get

Everything below is built and has run against the real Play API in testing. Nothing has run in a public cohort yet.

  • 15 real testers for your app

    The other 15 members of your cohort, 3 more than the 12 Google needs.

  • 16 days of testing

    Two more than Google’s 14, so late installers still finish theirs.

  • A setup check before anyone installs

    Group on your track, release out of draft, every country covered, with the exact fix when something is off.

  • Installs checked against Google Play

    Play Store installer, a version code from your own track, two devices per app.

  • A daily check-in for every tester

    Usage read from the phone: 70% of their list, 30 seconds each.

  • Weekly written feedback

    A rating and a note of at least 20 characters, read by you without names.

  • Forced updates for testers

    New releases must be installed within 24 hours, capped so it stays fair.

  • A closing report

    Who tested, how often, what they wrote and what you shipped, ready to paste into Play Console.

  • A stake that is kept

    $15.00 of credit locked while you test, returned when the cohort finishes.

Your 16 days

What happens, in order. The extra two days are slack, not a guarantee: a tester who opts in on day 4 still finishes after the cohort ends.

  1. Before day 1

    Join, then install

    Lock your $15.00 stake and join a forming cohort. When it is full, the install phase opens (8 hours). You install the others, and you can see how many members are ready.

  2. Day 1

    The clock starts

    The cohort starts the moment every member has installed at least 13 of the 15 others, or at the deadline if at least 13 apps are verified. Day 1 is not counted for the check-in.

  3. Every day

    Open your list

    Open 11 of your 15 apps for 30 seconds each, about 5.5 minutes. A missed day costs $1.00; 3 and you are out.

  4. Every week

    Write about three apps

    A 1 to 5 rating and a note of at least 20 characters on 3 apps. Owners read them, anonymously, and can ship fixes while testing runs.

  5. When you ship

    Testers update within a day

    A new release must be installed within 24 hours, at most once per app every 3 days. Updates you ship go into your report.

  6. Day 14

    Google’s minimum is met

    If your testers have stayed opted in, the 14 continuous days are done. The report is ready to read at any time and always says which day it was written.

  7. Day 16

    Cohort ends

    Stakes are returned to everyone still in. Generate your report, add what you changed because of the feedback, and apply for production in Play Console.

What leaving costs

The cost rises as other people start depending on you. Credit has no cash value: you cannot withdraw it or send it to anyone, it only pays stakes.

PhaseYou loseWhat happens
FormingNothingThe cohort is still filling. Leave and take your whole stake back, up to 3 times in a row. After that, join a cohort and stay until it starts to get 3 more.
Install phaseNothing, or a free leaveLeaving uses 2 of your free leaves and returns the stake. In the last 60 minutes of the window it counts as a no-show. With no free leaves left you cannot leave; you stay and install.
Removed for not installing$3.75 or $1.50$3.75 (25%) and a reputation point if you installed none of the others, $1.50 (10%) if you installed some. A second no-show within 30 days blocks you from joining for 7 days. The line for removal is 13 of 15.
Running: a missed day$1.00Taken from your stake for each day you fall short of the daily check-in, or skip the weekly feedback. 3 misses in total, not in a row, and you are removed.
Running: leaving or removedWhat is left of the stakeNothing is refunded after the start, and there are no free leaves. The stake stays with TestersGuild, a reserve takes over your assignments, and you buy credit again to join another cohort.

Feedback that helps you improve

Live today: each tester rates 3 apps a week with a note of at least 20 characters, and you read them in your closing report. Coming: you pick the features to test, so the notes answer your questions. Activity tracking shows an app was in use, not that a given action was done.

  1. 1You name a feature to test
  2. 2You write the steps
  3. 3You say what should happen
  4. 4Testers follow it and report
  5. 5We group the answers in your report

Sample, invented data. Feature requests are not built yet.

Feature
User registration
Instructions
Create an account using email and complete the verification process.
Expected result
Account creation succeeds and the dashboard opens.
Example feedback
“The code email took about two minutes. After entering it I landed on the dashboard, but the back button returned to the sign-up form.”

How we know it happened

A report is only worth pasting into Play Console if it states what the system recorded. These are the checks behind each line.

How an install is verified

  • The phone reports each assigned app. The server treats every report as untrusted and checks it alone.
  • The installer must be the Play Store. A system app or a sideloaded file is refused.
  • The version code must be one we read from the owner’s own track.
  • An app becomes Ready only when 2 different testers on 2 different phones have a current install on record. An install that is undone stops counting.

How a day of use is verified

  • Android’s usage-access permission gives the foreground time of each app. A day passes at 70% of the list, 30 seconds each (11 of 15 apps).
  • The phone also reports how many separate stretches made up that time and the longest one.
  • A server audit flags patterns real use does not produce: many apps held at the minimum, identical timings across testers, impossible totals, one device behind several accounts.
  • Flags go to a person to review. Nothing is punished automatically.

What we cannot prove

  • Usage is reported by the phone. A modified phone could fake it, and device attestation is not built yet.
  • Google’s API shows saved settings, including changes still in review, so a setup check pass means configured, not visible.
  • We have not asked Google whether it treats tester exchanges differently from other testers. Read its policy.

The report you paste into Play Console

Every cohort ends with one document per app, built from what was recorded: no tester names, no invented numbers. You add what you changed because of the feedback.

The example has the same structure as the real report. The app, the numbers and the quotes are made up for this example.

Sample, invented data

Closed testing report: Ledgerly (com.example.ledgerly)

Generated 6 Nov 2026 from TestersGuild’s records. Day 16 of 16.

How testers were recruited

Testers joined through TestersGuild, a community where groups of apps test each other. Each tester committed credit that is lost if they stop testing, and had to use their assigned apps every day.

Testing activity

  • Testers: 15, assigned to test the app by TestersGuild.
  • Testing started on 21 Oct 2026 and has run for 16 days.
  • On average 83% of tester-days included real use of the app (each tester had to use most of their apps for at least 30 seconds a day).

Feedback received

12 testers wrote feedback. Average rating 4.5 out of 5.

  • 5 stars: 7
  • 4 stars: 4
  • 3 stars: 1

Selected feedback:

Importing a CSV from my bank dropped the last row each time. The totals only matched after I added a blank line at the end.
The budget screen is clear, but I could not tell how to change the month. The arrows are very small on my phone.

Changes made during testing

2 new versions were released during testing:

  • Version code 14, 26 Oct 2026
  • Version code 15, 2 Nov 2026

This report lists what the system recorded. Add what you changed because of the feedback in your own words.

Your apps. Your account. Your control.

Android usage data and Play Console access need trust. Here is what is true today, and what is still to be written down.

What we collect

From your phone: which assigned apps are installed, how long each was in the foreground each day, how many separate stretches made it up and the longest one. From you: your Google sign-in, your app’s package name and your feedback notes.

Why

To count a day of use, to refuse installs that are not from the Play Store, and to flag patterns real use does not produce. Flags go to a person to review.

What we do not read

Android’s usage access reports time per app. It does not give us what is on your screen, and we do not use it that way.

Play Console access

Optional connection. One read-only permission (“View app information”) on one app, for our service account. We cannot edit or publish. Remove it any time in Play Console, under Users and permissions.

What other members see

Owners read feedback anonymously. Exactly what else members can see of each other will be stated in the privacy policy.

Retention, privacy policy and terms

Read the full privacy policy and terms. Both are drafts until they are reviewed before launch.