A/B Testing Oneself
In the software industry, A/B testing is the practice to show users variations of the same content. The difference can be color, size, layout, text/image/video content, and just about every other aspect of the user experience, including pricing. The idea is to run experiments and find the optimal variation to prescribe as the new default for all users. (This sounds very noble, but it can sometimes be used to just try to extract maximum revenue from users without realistic change in content)
So the question is, can one A/B test themselves? I have two ideas.
The first experiment concerns the artistic medium for fanart creation. As an avid consumer of anime and video games, it has been an adolescent dream to create fanart. Despite the longstanding aspiration, the fear of mediocrity and self-judgement have long prevented me from realizing it. Now unemployed with time and tools at my disposal, the setting is ripe for deliberate practice to create some hopefully-presentable art. The question is what medium? I’ve been interested and learning both 2D drawing and 3D rendering as potential media. It would be very interesting to attempt to realize the same concept through both, and compare the process and results. I’d love to see which one I end up liking better, so I can better focus on them. (Maybe both lol)
The second experiment concerns self-expression. I just finished a very literal test of shaving one of arm and leg while leaving the other in tact: treatment and control. I then compared how they felt from visual to tactile senses. It is unreal how such a simple change can make such a profound difference: With each stroke, it felt like I was casting away a little impurity, a bit of what wasn’t me. It was refreshing, both in the literal sense with a more exposed skin, but also this newfound kindness for myself, that for the first time in my life, I cared for my own body. The conclusion may be premature, but it has motivated me to experiment further. I will certainly share the results.
Thank you for reading.
Addition notes about A/B testing:
A/B testing is hard in the same way scientific experiments are hard. In order to reach a reasonable conclusion and minimize noise and bias, an ideal experiment should include a large sample size in a controlled setting, samples separated randomly into control and treatment groups, and ensure the experiment is conducted in similar environments for each group. (This is an oversimplification) This is simple when there is a large userbase for a web service, but with the sample size of just one, experimenting on oneself is much harder. For example, it is impossible to test the effects of two diets while trying to control for other factors like levels of exercise or the effects of other life events, as the same person can not commit to one diet, then rewind time to repeat the same duration with another diet. This discussion is not meant to dissuade one from experimenting, but rather explaining why I found the previously-mentioned experiments to be particularly fascinating as they allow control and treatment to be conducted almost simultaneously.
In addition to making sure the initial setup is as unbiased as possible, it is also good practice to not draw conclusions until the experiment is completed. The exception is when there is significant evidence pointing in one direction, and that there are significant benefits to drawing an early conclusion. As far as I know (please factcheck), this is the case for CVOID vaccine trials: with overwhelming positive early evidence, it becomes unethical to withhold the control group from the treatment. I considered the effects of each stroke to be quite significant on its own. Thank you again for reading.