A UserTesting Review By a Frustrated Applicant
A UserTesting Review By a Frustrated Applicant
Let us start this UserTesting review at the beginning to give you some context what they do.
Basically UserTesting will do a comprehensive review of a company’s website.
UserTesting will have a “Company A” approach them saying, “Hey, we are not sure if our website is very good. Can you help?”
User Testing takes over by asking, “What are you worried about with your website?”
Now the “Company A” could say that they are worried about their navigation or is information is easy to find? These concerns are then transformed into tasks for a website reviewer to try out.
Enter the UserTesting website reviewer, what I was hoping to try out.
Everything done by the website reviewer is recorded by UserTesting’s on their application. This application records what the reviewer is saying as they talk through their actions, thoughts, and process. Also, the application records the screen movements and actions the reviewer performs. I’m not exactly sure what happens after the review is completed. I would assume that the company gets the responses and data after some vetting/cleaning up process. The video below explains the whole process in their words.
My Experience Starting Out
When I first heard about UserTesting.com about a month ago I was excited. I thought to myself, “Man, they are going to pay you a decent amount of money for 20 minutes of work to review websites? I’m in!”
Not only was I excited for the additional income but I was excited to learn.
For me, creating websites is a passion. Being able to review many different sites would have given me the opportunity to see what other people are doing right or wrong. Personally, I was the most excited to learn! Plus, I thought I could make an awesome UserTesting review for the readers of Wallet Squirrel.
Sign Me Up!
Fast forward to this past week. I was finally able to get started on my application to be able to review websites and start the UserTesting review.
My adventure started off with excitement. To begin with, they ask everyone to try out a test review to make sure every applicant can speak clearly and has the right equipment set up. I hopped on their website where I submitted my email address to start the process. Once the email arrived I could click on a link provided to begin the sample test.
Sample Test
This link in the email takes you to a webpage where I could download their application. Once downloaded, I could follow the steps to get it installed. The initial process was super easy and simple. After completing the install, I hit the continue button which took me to the next page. Because most people are not sure what to expect, UserTesting provides a link to a previous applicant’s sample video. This was nice to have so I could get my bearings for my own sample test.
The initial process was super easy and simple. After completing the install, I hit the continue button which took me to the next page. Because most people are not sure what to expect, UserTesting provides a link to a previous applicant’s sample video. This was nice to have so I could get my bearings for my own sample test.
This was nice to have so I could get my bearings for my own sample test.
After taking a peak at the example, I hit “Launch Recorder” to have a go at it for myself. The application opens with a test for your microphone. Annoyingly there are more pop ups to go through before I finally got to where the application is recording. Reading the instructions, the first task is to watch a short two-minute tutorial video. This video is nice as it goes through the process with you and gives you some more tips on how to use the UserTesting Application. Once complete there are three questions to answer. These are simple multiple choice questions, so do worry much about them.
The application opens with a test for your microphone. Annoyingly there are more pop ups to go through before I finally got to record. Reading the instructions, the first task is to watch a short two-minute tutorial video. This video is nice as it goes through the process with you and gives you some more tips on how to use the UserTesting Application. Once complete there are three questions to answer. These are simple multiple choice questions, so do worry much about them.
Reading the instructions, the first task is to watch a short two-minute tutorial video. This video is nice as it goes through the process with you and gives you some more tips on how to use the UserTesting Application. Once complete there are three questions to answer. These are simple multiple choice questions, so do worry much about them.
Actual Tasks
Finally! After clicking through SO many pop-ups and windows, I made it to the actual sample tasks.
I landed on the National Air and Space Museum’s website to review. My first task is to find a map with a layout of the museum in DC. As I explore through the logical places for this layout map I talk through my process and thoughts about the task. Once the map was finally found and my thoughts shared, I get to click next for the second task.
The second task wanted me to find what holiday the Air and Space Museum is closed. With this task, I looked around the website some more. This one was a little more tough to find because of the overall structure of the site is goofy. But at last! I found it! I gave my two cents about the overall site structure and then moved on.
But at last! I found it! I gave my two cents about the overall site structure and then moved on.
Once the last task was complete, I could hit “Done” to stop the recording. Next there were a few written questions to answer such as, “What specifically made it easy or difficult for you to find what you were looking for?” I inputted a detailed answer for each one because of the higher the quality of your review, the more likely you are going to get more reviews.
After answering those questions the UserTesting application starts uploading the review.
Redo Part One
Excluding allpop-ups pop ups, this is where my UserTesting review started to take a turn for the worse.
It was not an hour later after submitting my first video that I got an email saying to redo my submission. As you can see this email is very vague as to why I had to redo my test sample. I thought, “Okay, maybe the room was too loud or I did not talk loud enough.” So, I sat down, made sure the room was shut tight, and cleared my throat. It took me about 15 minutes to finish this submission.
As you can see this email is very vague as to why I had to redo my test sample. I thought, “Okay, maybe the room was too loud or I did not talk loud enough.” So, I sat down, made sure the room was shut tight, and cleared my throat. It took me about 15 minutes to finish this submission.
Redo Part Two
At dinner, I was all excited that I had not received a rejection email yet.
Sadly, this excitement did not last long though. As we were just cleaning the dishes another rejection email came in. I started to get a little more frustrated this time as it was the same vague email.
Determined to get my application approved I sat down, yet again, to do the test sample. This time I focused harder on what I was saying during my exploration. I tried to simplify my review and be more clear. After submitting it this time I got my hopes up. I thought I had it this time.
Redo Part Three
It was not till mid-morning the next day that I heard back with, yet again, another rejection email.
I was kind of angry at this point because I did not know what I was doing wrong. The silly rejection emails do not tell you ANYTHING.
I only wanted some direction as to what was I doing wrong. This would be the fourth time I was to do the test sample.
After looking around some more through the test sample I determined that I might be looking for the wrong map. I kept looking for the location map when they wanted the layout map. Knowing this I started the application all over again, for the fourth time, did I mention that part? Once done, I felt very confident that I would get it. I thought I would have an awesome article to write about making money by reviewing websites.
Sure enough, I was right. I was not completing the task right. If the emails were a little more detailed, the sample test might have only had to redone once instead of three times!
Finally, A Different Email
Later that evening, I was so happy to see a different email come in from UserTesting with the subject line, “UserTesting – Your application to UserTesting.” Thinking to myself, I thought, “Man, this has to be it! I did it! I did it!”
I open the email and all my hopes and dreams were crushed (might be over overdramatizing). The email said they have more applications than they can accept so they couldn’t invite me to join the panel.
Are you kidding me?!?!? I spent two days recording the sample test four times and just now I am hearing that they are not taking any more applicants. Why couldn’t they say this on their website? I couldn’t believe it. I was very angry at the company at this point.
Okay, Adam, breath…it is okay.
Conclusion
To conclude the UserTesting review, this process was very frustrating. Though UserTesting has ironed out most of the experience there are still some major wrinkles that need to be smoothed out. For one, they need to provide better emails as to why something is rejected. I do not see why this would not be hard to do. From my understanding an actual person reviews the sample tests so why can’t they be a little personable.
Secondly, they need to close their application link if they are not accepting anymore applications! This made me upset when they pushed me to keep redoing my sample test just to tell me something they already knew, they weren’t taking anymore applications.
Please fix this UserTesting! For me, it comes off as they do not care about their reviewers even though these people make up half of their business.
For me, it comes off as they do not care about their reviewers even though these people make up half of their business.
To give some positive feedback within this UserTesting review, they do have a very nice website. It makes signing up very easy. The application used to conduct reviews is very slick and simple (though there are a lot of popup windows to click through). They do make the process very easy to perform so anyone could conduct a review. Sadly, they have the smudge marks, listed above, that ruin the program for me.
Other Reviews
Andrew and I are constantly reviewing different methods to earn more money. Head over to the Blog or our How to Earn More Money section to read more reviews. If you have any thoughts on something we should review shoot us a message.
It was too good to be true! Seems pretty dodgy to me. I guess they have so many people signing up that they can afford to treat them badly. Was gonna try it out…. not anymore
Great point Matty. I don’t think they really need to care anymore, which is really sad. I’m glad I could save you a bunch of time. I’m currently working on some other projects for Wallet Squirrel but I plan to loop back here to check if there are any other sites like UserTesting. Let me know if you know of any.
– Adam
Try this guys, seems like a good website, i confirm that it actually pays you.
https://app.whatusersdo.com/apply?referral=205015
You don’t have to use my referral but i’d really appreciate it. Thank you.
Hi Adam, thank you for sharing. Had similar bad experience 2nd of February 2018. Did first time the test and after few hours become an email that have to redo test, same as you was thinking something went wrong with the sound or that I did not find the right map, I concentrated even more for the 2nd time and submitted the test, within 5 minutes I receive reply: ‘ Thanks for applying to become a test participant for UserTesting.
Unfortunately, we’ve determined that you don’t meet the testing requirements of our customers.Thanks for taking the time to apply and we wish you the best of luck in your future endeavors. ‘ Question is, how is possible that you review in 5 minutes time a 25 minutes video? I think there are some automatic messages sent and system is not working anymore, as was in the past. Something is wrong
caluzone, same experience for me. I would simply forget about them. Their way of evaluating applications seems broken.
Yeah, it is very frustrating! I have been trying to use another service but that has not been much better.
– Adam
Sorry you had the same experience as me. It is very frustrating!
– Adam
Ha ha. I just took the test; it would be nothing short of a miracle if I pass it! Adam, had I only known they would give me the same test they gave you, I would’ve studied what you wrote above more closely. (I figured they would change the test every few weeks or so.)
Anyway, from what you’ve stated, I should expect to get another chance to take it. The thing is, I did so terribly, they may well just reject my application outright. I think nervousness about passing the test caused me to fail it! Lol
I’ve gone through the application process twice now and the last time (I got a better microphone and psyched myself up to be clear & concise) they didn’t even give an explanation beyond “Unfortunately, we’ve determined that you don’t meet the testing requirements of our customers. Thanks for taking the time to apply and we wish you the best of luck in your future endeavors.” I reckon maybe it’s because I’m a New Zealander and people can’t understand our accents!!!
It’s been four days since I kept redoing the sample video and didn’t get accepted and today I did it again and waiting them to reply.I keep looking for ways to earn some extra money online.If I don’t get accepted I guess I tried and have to keep searching.
That is very frustrating Sam! I have not tried again since writing this article. If you are looking for other ways to earn money, you should click on the ‘Ways We Make Money’ link in the navigation bar above.
– Adam
Hey, I did this website testing, too. I did it first about mid-April or so. Same website still. I got the same re-do email, with the exact same text. So past weekend, I finally gave it another shot and made sure my mic works and nothing else gets in the way. Concentrated and serious, straight forward.
Just now I received the rejection email giving now apparent reason for the rejection – which is what led me here. I find this highly suspicious.
Since one of you mentioned the accent, I wonder if they are biased towards pronunciation. I am German, but my accent is not that of a German and I use English on a professional basis.
The other thought that came to my mind… What if… What if the “application” is actually the test of the website in question? Think about it, with millions of people accessing the internet and looking for quick options to make some coin, how many people might do the trial test every day? Or just in a month.
And since everything can be automated, not everyone might receive the same website. They might be ascribed to “applicants” at random – and if they redo the application, identified by their email, the previous ascribed website will simply be ascribed again. I wonder if there are other test websites.
***Every application/trial test is a free/unpaid review for this company! ***
Thank you for this article. I decided to do userTesting and saw the rejection email which led me to search up UserTesting reviews. I’m not going to waste my time with this company. I was highly irritated and I’m glad someone else feels the very same way how I feel that they offer no explanation. Nor can you watch the video you created before sending it to the company. There’s better ways to make money. This and TrendSource which also sucks (unless I’m getting it wrong in requesting for certain projects) have not heard anything of having my requests accepted. If it seems too good to be true, 95% of the time it is.
wow so there are others like me! I decided to do userTesting right after I saw a couple youtube videos saying that it is a legit website and sounded so easy to do and good quick money! I signed up, submitted the test and then also got an e-mail to repeat the test. So I did, and this time I really really tried hard to explain everything and really said out loud every single thought loud and clear without pauzing (which I thought that’s why my first review was rejected because I had few pauses). I made a video about 6-7 minutes long. After I submitted the video, not even 2 minutes later, my video was rejected ?! They couldn’t have possibly revieved my 6-7 min long video in 2 minutes and reject it??!! I’m also disappointed and feel like I wasted my time.
so, what was wrong the first few times? were you looking at a different map?
I am so bemused by my rejection from this company. I make very good money doing voiceovers, but have bad insomnia. I thought this would be a fun side gig to help me wile away the hours.
I took the test twice and then received the dreaded ” Unfortunately, we’ve determined that you don’t meet the testing requirements of our customers.
Thanks for taking the time to apply and we wish you the best of luck in your future endeavors.
”
Very strange company.
I’m the United States with a very clear and don’t have regional accent. I have no idea what UserTesting is looking for. I see they have some American women working for them and sorry to say but they sound like complete backwood hicks with a 3rd grade education.
Checking reddit, seems like jerks are in charge at usertesting. Comment from a guy responding to a user who was rejected:
“I dont know what you are talking about. Of course there are enough tests available for the CEO of an enterprise company that uses Slack Desktop and is looking for another CRM with over 1000 employees and I also run the payroll system.
Sometimes the test requirements are the funniest part of my day.”
I started to have the same experience. I failed the first try and got the same exact email with the same exact header. That is how I found this website. Me being me and I can not leave well enough alone, I decided I was going to do a YouTube series on this and how failure rates are common place. I went and recorded myself on the actual Museum website and played through the tasks 1 by 1 and how I would narrate my session and I drank a cup of coffee and decided to go for it. It was at that moment of submit, I knew I blew it! I had my camera out recording everything that was not proprietary to their network/system and ready to rat them out to the virtual world as well along side so many others.
And then ….. I got the email this morning saying of all things, Welcome! I was kind of real shocked. Now I am 100% sure I will never qualify for any “tests” but at least I got on the website and through the troublesome entrance application test. I did their little training modules and scored a 9/9 on 1 and a 11/11 on the other. I have yet to try any tests. Ohh I did click a screener button and was promptly DQ’ed from the test.
Hey there! I know this is an old article, but I wanted to bring to the point that nothing about the site has changed since your experience. I received the same test as you, did what I could to clarify my recordings and keep it simple and straightforward. They asked me to do it again.
I did it again, fixed my microphone settings to make sure they can hear me. I stream on Twitch, and I use that as a guiding tool to how my voice sounds on the other side. Apparently, Usertesting has an issue with recordings, because as clear as I was, the second time they rejected my application saying that I wasn’t a fit for them.
I actually signed up to UserTesting back in 2013 or 2014, and the process was the same, but was given a different site to test and it went smoother. I got accepted off the first recording and that time I used a webcam microphone instead of my streaming mic i use now. However I had a different problem with UserTesting as a tester, where the first video I did, got rewarded with 5 stars and 10$. Then every video afterwards got 1 star and nothing, and no help at all as to why my recordings were being so low rated when my sample was fine.
My biggest gripe is they never give you a way to review your recording, or video, to make sure everything is all right. They have not had this option back then, and they do not now either. It’s a shame, because I liked the testing itself, and it was relatively simple, just too many applicants or not accepting just anybody with a mic nowadays.
How you have completed second task?