Why are we making changes? A Letter from the Executive Director
As a nonprofit organization established in 2018 to accelerate online behavioral research, FindingFive’s original plan was to be a niche player: we had (and still have) no intention to be a direct competitor to big names like Qualtrics. Instead, we wanted to make the life of researchers who run the “stimulus-presentation” type of experiments a bit easier. As a researcher user of FindingFive, you probably can feel how this plan has affected many of our design decisions: our unique features such as speech onset detection, and so many odd (but hopefully useful) ways of counterbalancing your stimuli.
COVID-19 has brought big changes to our lives. It also forced the FindingFive team to reassess whether our original plan of being a niche player was feasible. Over the last 12 months, and through interactions with our researcher users, we have realized that FindingFive today is at a rather awkward place. The way we have been running FindingFive, largely as a free service to most researchers, is based on the assumption that we are a niche platform used by only a few researchers. Right now, however, we have over 300 actively engaged researchers running over 2000+ participants per month. While we feel extremely grateful for the trust that researchers have put in us, it is also now much more costly to support this many researchers and participants. Our monthly equipment cost has gone from about $20 USD to several hundreds, and still increasing. A variety of fees, legal, accounting, and so on, running up to several thousands a year. Furthermore, to make FindingFive a sustainable effort, we need to stop relying on volunteers (from yours truly to everyone else at FindingFive, all of us are volunteers without pay!). Instead, we will have to retain a permanent staff to develop and maintain the project. The personnel cost will dwarf the maintenance cost that we have faced so far.
To tell you bluntly, the reason we are implementing these changes is to improve the financial situation of our nonprofit organization, so that FindingFive the research platform can continue to operate and grow, hopefully forever! In making these changes, we have kept the financial burden facing each of our researchers in mind. I hope you can see our painstaking effort in making FindingFive remain as accessible as possible. As a nonprofit, we have no shareholders to answer to, so all of our revenue will go directly to cover the cost of operations, and hopefully personnel at a certain point in the future.
FindingFive is driven by the mission to enable more researchers to conduct online behavioral experiments. On behalf of the FindingFive team, I am forever grateful for your support in helping us getting there.
Ting Qian, Ph.D.
Executive Director, FindingFive Corporation
New Subscription Plans for Researcher Accounts
Starting September 1, 2021, FindingFive will be replacing the current membership structure with three subscription plans: Free, Plus, and Pro. The following table summarizes the primary differences between these three plans.
|Researcher Subscription Plans||Free||Plus||Pro|
|Full access to all FindingFive grammar features||Yes||Yes||Yes|
|Pay zero session fee for the first N participants per month||N=0||N=25||N=100|
|Number of concurrently active sessions||3||10||Unlimited|
|Storage space for stimulus files||200M||500M||1G|
|Create fully-encrypted studies|
(required by law if you collect personally identifiable data)
|Buy additional “Plus 1” slots with the same plan benefits||No||Yes, $8 per slot per month||Yes, $20 per slot per month|
We will explain the details of these plans in the rest of this post.
The Free subscription plan requires no further actions on the part of researchers other than simply signing up for a researcher account on FindingFive. Researchers under the free plan will have full access to all features of the FindingFive Study Grammar.
Importantly, starting 9/1/2021, a major boost for the free plan will be the ability to launch up to 3 concurrently active sessions (of different studies), instead of just 1 session prior to this change. This will enable researchers to launch multiple lists of the same experiment and/or implement a pre- and post-test paradigm easily by using the prerequisite features of FindingFive.
Plus Plan: the Power of Collaboration
The Plus plan is the best fit for researchers who collaborate with colleagues heavily on FindingFive but run their own participants only occasionally. Its key upgrade from the Free plan is the addition of advanced collaboration features (read more about them in the section below). In addition, the Plus Plan comes with 25 free participants per month, for whom you won’t need to pay any Session Fee charges.
Researchers with a Plus Plan can also add your colleagues or students to your account as “Plus 1s” and they will enjoy the same Plus plan benefits as you do! You can purchase Plus 1 slots at a discounted rate of $8/month. The cost of your Plus Plan and all your Plus 1s will be billed to you for billing convenience.
Pro Plan: the Accelerator of Productivity
Researchers with the Pro plan will enjoy a variety of benefits that span from productivity boost to significant monetary savings, including:
More on Advanced Collaboration Features
Advanced collaboration features are available to researchers with a Plus Plan or a Pro Plan. The use of these features, in most cases, require all researchers involved to have one of the two paid plans. For example, to transfer the ownership of a study, both the sender and the recipient must have one of the two plans.
Adding more than 2 collaborators per study
Starting 9/1/2021, only researchers with access to advanced collaboration features can add more than 2 collaborators per study. Researchers being added as your collaborators do not need to have a Plus or Pro plan.
Making a copy of a study created by collaborators
Starting 9/1/2021, only researchers with access to advanced collaboration features can make copies of a study created by collaborators. Making such copies will also carry over stimulus files. This feature does require both you and the study owner to have either a Plus or a Pro plan.
Transferring Study Ownership
Transferring study ownership allows researchers to move a finished study to another account, together with its past participation history and all stimulus files. The original study owner can choose to retain control of the study by remaining as a collaborator once the study is moved.
This is most useful when researchers from the same lab work on their own individual studies, but prefer to launch the study from a centralized “Lab Account” when the study is ready (the lab account could just be another Researcher account set up with a lab email address). As a result, any Session Fees from launching sessions will be deducted from the centralized account instead of the researcher’s personal account. This setup can greatly simplify how research labs pay for session fees.
This feature requires all accounts involved in the transfer to have either a Plus or Pro plan.
Delegate Session Launches
There are also times when a researcher has designed a study in their own account, but the actual running and managing of the study is delegated to a research assistant. In such cases, the researcher can add the researcher assistant as a collaborator with permissions to launch the studies on their behalf. This feature requires all accounts involved to have either a Plus or Pro plan.
Transition from current Premium and Laboratory Memberships
For researchers who have an active “Premium membership” expiring beyond 09/01/2021, with either monthly or annual billing cycles, their accounts will be automatically converted to the Plus plan. There’s no changes in fees as the old Premium membership and new Plus plan are both $10 a month or $108 a year.
For researchers with an active “Laboratory membership” that originally extends beyond 9/1/2021, each researcher in the Laboratory membership will be converted to the new Pro plan, with a free 3-month extension based on the original end date of their lab membership. However, once the converted period passes, they must manually re-enroll in either the Plus or the Pro plan depending on their needs. FindingFive will send out reminders on re-enrollment as the expiration date approaches.
|Active Membership |
originally expiring beyond 09/01/2021
|New Plan on 09/01/2021||Expiration Date||Auto-renewal|
|Premium (annual or monthly)||Plus||No change||Yes|
|Laboratory (annual only)||Pro||+3 extra months||No|
Fee Structure Changes
Starting 9/1/2021, FindingFive will introduce a new Session Fee charge, while significantly reducing the existing Payment Process Fee. The net change for researchers who use our Direct Payment feature to pay participants can be as much as 30% reduction in total fees.
Significantly Reduced Payment Processing Fee
Since 2020, researchers have been able to pay participants directly on FindingFive, should they opt in to use the “Direct Payment” feature when launching a new session. Currently, the payment processing fee for Direct Payment studies is 15% of the actual payment amount or $0.75/€0.75 per participant, whichever is greater. This fee is already significantly lower than almost all other online study platforms.
Starting September 1, 2021, this payment processing fee will be further reduced to 7% of the actual payment amount or $0.35/€0.35 per participant, whichever is greater.
Studies that do not use the “Direct Payment” feature, as usual, will not be charged the payment processing fee.
New Session Fee Charges for Most Studies
Starting September 1, 2021, we will charge a session fee that is based on the number of completed participants in a production session, after researchers download the data of the session. A charge will be generated for the first download only. Subsequent downloads of the data from that session will not result in additional fees. No charges for the Session Fee will be generated before researchers obtain the participant data first.
This fee will apply to all studies, regardless of whether Direct Payment is used or where the session is launched. Only participants who successfully complete the studies will be counted in this fee (i.e., participants who abandon or time out the study will not be counted). In addition, this session fee is tiered and designed to avoid penalizing researchers who collect a large amount of participant data – the more participants you run, the cheaper the rate will be.
Session Fee Rates
The specific rate of the session fee differs for researchers depending on what plan they subscribe to as well as how many participants they have run each month. The details are as follows:
|Session Fee rate||Free Plan||Plus Plan||Pro Plan|
|Participants 1-100||$0.50 per participant||Free for 1-25, then $0.50 pp||Free|
|Participants 101+||$0.30 per participant||$0.30 pp||$0.30 pp|
2. The session fee is calculated based on whether the owner of the study (not the collaborator who may launch a new study session on the owner’s behalf) has an active Plus or Pro plan at the time of launching the session.
Some Session Fee Examples and Cost-saving Tips
The following table lists a few examples illustrating how much the Session Fee charge will be given the number of participants a researcher may run in a single month:
|Monthly Participant #||Free Plan||Plus Plan||Pro Plan|
|25||$0.50 * 25 = $12.50||$0.00||$0.00|
|100||$0.50 * 100 = $50.00||$37.50||$0.00|
|300||$0.50 * 100 + $0.30 * 200 = $110.00||$97.50||$60.00|
As the table shows, for researchers who run more than 25 participants a month, the Plus Plan saves researchers $12.50 compared to the Free plan, which essentially pays for itself (the Plus Plan costs $10 a month). For researchers who routinely run 100 and more participants, the Pro Plan pays for itself as well. For big labs that run hundreds of participants each month, the Pro plan still offers significant savings, or you can sign your whole lab up for Pro plans via the “Plus 1” feature to achieve even greater savings.
Session Fee Will Always Be Post-hoc
A session fee charge will always be generated after a session has finished collecting data and participant data are downloaded from that session. If the researcher’s account carries a balance that is sufficient for covering this fee, FindingFive will automatically deduct this fee from researcher’s account balance. If the researcher’s account balance cannot cover the fee entirely, the charge will be automatically applied to the primary payment method saved in the researcher’s profile.
Partial Teaching Waiver for the Session Fee
FindingFive will partially waive the session fee for a researcher account if the owner of the account is a student enrolled in (or teaching) an experimental design (or similar) course using FindingFive as a pedagogical tool. Once granted the waiver, the researcher will be able to collect data from 25 participants each month for free for the entire duration of the course. Starting with the 26th participant per month, the fee structure as outlined in the above session fee table applies.
Faculty are not eligible for this waiver. A request for this waiver can be submitted either by the instructor of the course to waive the fee for the entire class or by individual students. We will release a form for submitting this request, and registrar records will be required as evidence for this request. The teaching waiver can only be used exactly once per researcher account in a 12-month period.
Net Financial Impact
In this final section, we outline the expected financial impact on researcher users as a result of these changes.
Lower Cost for Researchers Paying Participants Directly via FindingFive
A study paying $10 to each participant currently has a flat payment processing fee of 15%, which is $1.5 per participant. After these changes are in effect, even researchers with a Free plan will pay at most $10 * 7% (the new payment processing fee) + $0.5 (the highest session fee rate) = $1.2. The cost will be even lower as more participants take the study, since the session fee rate decreases over participant counts.
Lower Cost for an Entire Lab to Get Paid Plans
Under the new plans, signing up an entire lab of 5 members (1 PI + 4 students) for the Pro plan, for example, will cost $35 + $20 * 4 = $115 dollars a month. After a 10% off discount for paying annually, the cost will be only $1,242 a year. Each Pro Plan account also comes with 100 free participants per month, for whom the session fee does not apply. This means that the lab of 5 can run 500 participants a month without incurring session fee charges.
Similarly, the cost for a lab of 5 to get Plus Plans for all is $10 + $8 * 4 = $42 a month, or $453.6 a year. A total of 125 free participants are included each month.
Running Course-credit Studies is No Longer 100% Free
When these changes become effective on 09/01/2021, running course-credit studies will result in some session fee charges for most researchers, as detailed in this post. Our fee rate is highly competitive compared to other for-profit online experiment software services. By supporting FindingFive financially via these session fee payments, you will help ensure FindingFive remain as an accessible service to behavioral researchers.
Cost Comparison with other Platforms (Gorilla, MTurk, Prolific)
Under the new fee structure, FindingFive remains the most affordable platform that integrates study creation, recruitment, and payment all in the same place. For example, imagine you are using Gorilla.sc for creating studies and then posting those studies to Prolific or Mechanical Turk to recruit participants. At $10 per participant, you will be paying these platforms a hefty amount to conduct your study (under the best-case scenario by taking advantage of the plans and bundles offered by each platform):
|Annual Participant Count||100 participants||300 participants||1K participants|
(for creating studies only)
(for recruitment & payment only)
(for recruitment & payment only)
(for recruitment & payment only)
Because researchers would need to use Gorilla AND a recruitment platform, the actual total cost would be even higher, compared to doing everything on FindingFive:
|Annual Participant Count||100 participants||300 participants||1K participants|
|Gorilla + Prolific||$448||$1,319||$4,347|
|Gorilla + MTurk mini-batches||$318||$929||$3,047|
|Gorilla + MTurk regular||$518||$1,529||$5,047|
(all-in-one for creating studies, recruiting, and payment)
In other words, excluding participant payments per se, researchers running 100 participants a year can save almost $400 by using FindingFive. Large research labs can save almost $4,000 by using FindingFive. We can offer these competitive prices because of our nonprofit nature – we are not seeking to maximize profit, but just enough revenue to keep operations going.