I have been busy implementing the user study in a JSP web application. I have been learning a lot and even learned MySQL to store user input so that it will be easier to analyze later on. The goal is to make it as easy to use as possible to make sure the layout and design does not take away from the actual study.
I have been researching and looking into the IRB process, which requires a lot of careful detailed paperwork and training. I have to take a course to become certified to conduct the user study. The paperwork involved a detailed description of the user study and purpose of the project. Also, we have to script out what we will be telling the users to make sure everything is consistent.
Also, I have been spending time picking out questions which will be asked in the user study. I am trying to pick out the ones which have a variety of constructiveness scores.
Yesterday, the 22nd, I got the amazing and nerve-wrecking opportunity to present at the IEE Frontiers in Education (FIE) in El Paso, Texas. This was my first time attending a publication based conference. I learned of many others in the fields and the advances they have been making. The most rewarding aspect was receiving emails and having other professors express interest in my research! I absolutely loved spending the time with Dr. Hsiao and am really grateful to her for this opportunity!
We have come up with a preliminary user study design. We have two groups: a control and experiment. Both groups will have to rate answers to various StackOverflow questions.
Control: In this group, all the answers to a particular question will be presented as they are on StackOverflow. These are usually ordered both by the number of votes and chronologically.
Experiment: In this group, only the answers that have a constructiveness score of three or higher are presented. We hypothesize that the user will still learn as much as from the control groups even though the number of posts has decreased, reducing navigation complexity.
This week I created my presentation which I will be presenting at the IEE Frontiers in Education Conference and rehearsed it in front of the lab group, who ask me questions in preparation for the conference.
I started learning how to create a JSP on Eclipse using online tutorials. I created a very simple JSP which displays a text box, stores the value entered, and then displays it after the submit button is clicked. The actual JSP in the user study will have to store all user input with separate IDs to identity the users.
This week we started designing the user study, which will help validate if constructiveness really is characterized as useful to students. The control would be the posts of StackOverflow that are not constructive, whereas the experiment would only have the answers that have a high constructive score. The user will have to rate each answer. We predict that the experiment answers will have higher scores.