Evaluation I

Today I completed my first evaluation of the paper prototype. It took a bit longer than expected because last monday I did not have the time and because I’m in Leuven during the week I couldn’t test on my target users since I can only meet them in the weekends.

The evaluations went quite well and I received a lot of good feedback. Also all participants thought the application was really nice and usefull. These were the scenario’s I asked them to do:

Scenario’s for the parents:

  1. Login for your child and set that she/he is capable of reading and writing but needs control
  2. Set at the permissions everything that has to do with placing comments on “Hide”
  3. Go to the next screen (not a straightforward way)
  4. Set a password and continue
  5. Change the settings so the child cannot create groups anymore

Scenario’s for persons with a mental disability:

  1. Who was the last one that posted something on your wall?
  2. Update your status (This is set that the person is not allowed to do this so there will be popup to enter a password => What is the reaction?
  3. Start a new Facebook chat
  4. Make a new Facebook group
  5. Make a new Event

Afterwards I asked some questions to them:


  1. Age?
  2. Any experience with a touchscreen? Could be a smartphone,…
  3. Any with the iPad?
  4. Do you have a child with a mental disability or a child that is too young to realise any dangers in the world like abuse?
  5. Do you have any experience with Facebook?
  6. Were the settings clear enough? Any suggestions?
  7. Do you find the information panel handy?

Persons with a disability:

  1. Have you ever used Facebook?
  2. Do you have a Facebook account yourself? If not, interested in one?
  3. Any experience with a touchscreen? Could be a smartphone,…
  4. Any with the iPad?
  5. Do you think it would be handy to have like a button that would read all statusses of your friends aloud or do you prefer choosing the statusses that you want to hear yourself?

The goal of the evaluation was to see whether the application was usable by:

  1. Persons who might not have experience with multitouch devices and/or social networks
  2. People with a mental disability who might think totally different and look different at the world. Things that might seem logic for me could not be logic for then and the other way around!

I told the test users that this was a think aloud test so they had to say what they were thinking so I could understand why they were doubting about something, suggestions,…

For the test for the parents I found 5 parents willing to help me age 30-55. There were some general trends that I will shortly talk about:

  • For scenario 2, 4 out 5 users tapped hide for every place comment type instead of the general button that would hide them all at once. The reason they said was that it was not really clear that they were grouped. Some suggestions were putting the titles in bold, setting the margin for the subtypes more to the right, put them inside lines, in squares,…
  • 2 out of 5 did not find the solution for scenario 3 (they have to swipe to get to the new screen). When I told them what the solution was they said that they just not think of that because it is on paper but that when they see it on the device they might have tried that but they were not sure of it so it is definitely something I still have to check. The interesting here was that the 3 that found it all already had used an iPad and were able to put the link. My coordinator suggested to put a button for the next page permissions or a popup somewhere with some explanation of basic iPad controls for parents who do not have an iPad themselves but want to set the one of their child.
  • 2 out of 5 did not find the settings. Feedback was that the icon wasn’t that clear to them but if it was more a button they would probably have noticed it.

Some suggestions I received (also for the facebook part I showed to them):

  1. Possibility to add standard texts, like for example wishing someone a happy birthday. This way they can be proud they did something on their own AND the parents do not have to worry about it.
  2. In the application child is not really a good word. It is also for a grown-up person with a mental disability…
  3. Setting instead of allowing reactions on a status of a friend => More general on a post of a friend.
  4. Why showing birthdays on the profile of the person? Should it be there?
  5. Maybe it is better to move the application settings like permissions,…  to the general iOS settings => Otherwise child can still see that it does not have access to it. Might concern some children!
  6. Password in settings => Child could think it is the facebook password
  7. Like the standard text for wallposts you could do the same for status updates. You could add standard statusses like I’m happy, sad,… and also an option to type it yourself. This could also be very usefull for the third level (persons who need pictograms)

The test for persons with a disability was a little bit disappointing, the problem was that the paper prototype principle wasn’t really that clear for them but the biggest problem was that my paper prototype wasn’t visual enough for them. It was a lot of the same colors, perhaps not a very nice handwriting,… Seeing the difference between what is a button and text, does that represent a picture? And more like that were difficult for them.

For this reason I just did a test with two children without a disability to see whether basic Facebook functionality was still clear. The children had experience with Facebook. Some conclusions:

  • Tapping the existing status should allow updating the status
  • Sidebar for chat was handy and was immediately used
  • One child found that the sidebar draws more attention and was clearer than the tabs (needs further testing)
  • Pressed 2 times on text instead of the icon (Events and Notifications)

Social media for social inclusion of youth at risk: Conference Day 2

The second day of the conference started with the presentation “Youth work and the use of new media: is it safe? – The legal perspectives”. This presentation was about the legal rules that apply, like for instance social network sites are forbidden for youngsters under 13 years old. This I knew but what I didn’t knew was that this also includes social network sites like Ning which is a closed network site.

After this presentation we had the choice again between two tracks. I chose track 1 because it seemed the most interesting track for my thesis.

  1. The first presentation was “Measuring impact of the use of social software for social inclusion of youth at risk”. This was about developing an instrument that can measure the progress and impact of the social software. The results are in the paper coming online on the incluso website. Now to do this, they say that digital inclusion relates to three things:
    – Better communication skills
    – More active citizenship (following the news,…)
    – Increased social capital
    An interesting discovery that they made was that the use of social software increases skills more than just using a computer.
  2. The second presentation was “Reflections on the new peer to peer news paradigm as exploited by youngsters. The influence of both education level and type on news participation, seeding behavior and attitudes within web 2.0 environments”. This one was really interesting, not for the thesis in particular but in general some interesting insights. The Media Expertise Centre of the KHMechelen found that the youth (~19 years old) doesn’t want serious things on facebook, msn,… these are all about friends and they don’t want to mix fun and serious stuff. For that reason they also do not really like interactivity on serious sites because it makes it less serious… I do not really agree with everything they said but it is true that you want the serious things to come from serious sites. I don’t want people just putting news on there status on facebook because the seriousness of the news is compromised by doing so. What I do like is people who share serious news by posting the articles from a serious website like for example De Standaard. What I also did not understand is that the youth doesn’t like interactivity on serious sites. Indeed it could lead to ridiculous comments, but if it is well moderated then it could lead to interesting information or even point out that the article is not entirely correct (which too badly happens a lot!).
  3. After the coffee break it was time for the “SHARE IT” presentation. This was about extending the classroom to the living environment. Education can take place anywhere… [more on this later]
  4. The fourth presentation was “Taking things beyond the experimental stage. An integrative approach to using online strategies in social services”. This was about JAC, the youth advisory centre in Belgium. They pointed out that the biggest problem is that youngsters are ashamed. So they are always looking for new ways to get in contact with them -> Social network sites. This is also the reason why in my opinion in an application for in the classroom there must be a tool to allow anonymous interaction for those people who are shy and ashamed to say things.
  5. Then it was time for “Where the worlds of e-inclusion and evidence based meet”.
  6. The last presentation before lunch was “Social Inclusion and Digital Engagement: Towards a Measurement Framework” by the European commission. This was about the fact that survey’s are not a good idea for youth at risk since they are mostly not accessible so there is a need for better measurement utilities.

After the lunch there were three more presentations:

  1. The first one was from Bednet, “Inclusion and children with medical needs – the Bednet case”. This was very interesting for my thesis. This organization has an application that makes it possible for youth that has to stay home or in bed can still attend classes and actively participate so it seems they aren’t gone. The application has a “Raise hand” button so the teacher knows the student wants to ask/answer something. This is also something I would like to add in my thesis application. This presentation made me also wondering if this occurs a lot with people with disabilities. That for example for some tests they are absent for a while. If so perhaps this can also be inserted into the application…
  2. The second presentation was “Tackling youth crime: exploring technological solutions to enhance youth engagement and promote social inclusion”. At first this seemed less interesting for my thesis but then they showed a very interesting graph that the biggest target segment focus of cases and projects are the disabled. [graph to be inserted when slides available] They also mentioned Design4all accessibility which might be interesting for the thesis.
  3. The last presentation of the conference was “Youngsters and their mediated bedrooms: a socio-demographic analysis of differences in ownership and use of new information technologies”. This showed some facts and figures on how the situation is in Flanders. Interesting was that 78% of the youngsters in Flanders have an internet connection and 81% has a pc.

To end the conference there was a research and policy note: “A common view point of 5 FP7 projects and Conference participants on future research in the area of ICT driven initiatives for social inclusion of youth at risk. Discussion Panel on questions raised by the researchers, practitioners and the audience”. It started again with the European commission saying how important this research area is. That the youth at risk is at the top of EU importance. There was also a voting with the question “Extending the work of intermediary organizations working with marginalized young people to social network sites and other social media brings nothing but positive effects”

The answer from the participants was clearly positive and so was my answer after this very interesting conference of which I’m really happy I was given the chance to attend it.

Social media for social inclusion of youth at risk: Conference Day 1

Today and tomorrow I have the opportunity to attend the international INCLUSO conference on social media for e-Inclusion of youth at risk organized in Leuven. Youth at risk is of course a very wide term and is used for youngsters who live for example in poverty, came in touch with the law,… But more importantly for my thesis also people with disabilities like dyslexia, autism, Down syndrome,… Therefore my coordinator invited me to go and I also thought it would be really interesting to gather idea’s for my thesis, check out existing applications and thoughts of experts in the field.

For more information on the conference in general you can surf to the incluso website: http://www.incluso.org

Now what have I learned from day 1 at the conference. I must admit I was kind of nervous because it was my first time at a conference and did not really know what to expect. There were at least 120 participants from 14 different countries but everyone was friendly and very social. Had some really nice conversations with interesting people.

The most important part were of course the presentations. Before lunch there were three big topics.

  1. The first one was presented by Miguel Gonzalez Sancho Bodero of the European Commission about the EU views on ICT driven initiatives for youth at risk. This presentation gave a good idea on how important this topic is. They talked about how relevant ICT is for youth. These days the social aspect of ICT is very important and necessary to fully participate in the society.
  2. The second topic was about INCLUSO self (fun side note, the presenter (Wouter Van den Bosch) used the iPad -his notes- in combination with a laptop -the ppt-. Could work for a teacher too perhaps for the thesis…). This presentation was mostly about how important social networks are these days to retrieve information. Instead of searching for information it is now more pushed to you. Again the problem though is that not all of us are on board. Those that could benefit most lack the access, the digital divide. At the end of his presentation the presenter gave a very important tip: Get in touch with the youngster, they will tell you what to do. This is one of the fundamental aspects in CHI, you need to know what the user wants and the only way to find out is to talk and test with them. Another important aspect he talked about is the privacy and ethical issues that come with these social networks. If for example I would integrate a social network in my thesis application, I’ll have to make sure that it is secure enough so others won’t be able to take abuse of the youngster at risk.
  3. The third and last topic before lunch was “Experiences from the INCLUSO pilots Scotland, Belgium, Austria and Poland”. I won’t go into detail for every pilot but some things were really interesting for my thesis. The first thing was not in the presentation itself but more in the way they presented it. They used voting software with voting devices, but the people with an iOS device or BlackBerry were able to download the application “Response” which is also great for in a class environment. It shows you the question and answers on the screen, so you just have to press the answer instead of pressing the number corresponding an answer on the presentation screen. For people with a mental disability this can for example be changed into symbols. After the voting you were able to see a graph with the percentages which you can always view again in the history.

Another useful thing for my thesis was used in both the pilot in Scotland and Poland, it is called Ning and is a software tool that allows you to create your own social network. They used it because facebook for example can be really confusing for some people and with Ning you are able to create a simpler version with just the features you want it to have. For example make more use of symbols instead of just text for the thesis or perhaps make it easy to let the social tool speak words out loud.

Then it was time for lunch, here I had the chance to talk to some people about my thesis and their work. It was really nice to hear that most people really see a lot of potential in the iPad as a device that will change the way people will learn things.

After the lunch the lunch there was first a presentation from Childfocus about the risks and opportunities of social media which is indeed an important aspect to keep in mind. After this presentation there were 4 presentations about the experiences from Replay, ComeIn, Umsic and Hands.

The most interesting one for my thesis was the project Hands. It is a project for autistic youth. The idea is that autistic people feel safe at school and at home but everything else is danger for them. For this reason they created a mobile platform for helping them with taking the bus, shopping, taking medicines,… They used social stories, step by step guides for daily routines. The teacher has an application that is connected to a database. The teacher can then personalize content of the individual devices of the autistic youngsters and register his or hers activities. (more info) The researchers say that thanks to this device the autistic youngster even created friendships.

Then we came to the last part of day 1 of the conference. Here we had to choose which track to follow (both tracks had different topics). I chose track 1 with the first presentation being about “Identifying young people at risk of learning exclusion: evidence from the educational system in England”. This was mostly a presentation with a lot of numbers, interesting but less useful for thesis. The second presentation was “Offline youngsters and the digital divide, or Revisiting the concept of ‘Digital Natives’ “. This one was quite shocking, it showed that 16% of the youth in Europe has (almost) no access to the internet. The strange thing is that it does not necessarily have to be in families living in poverty but sometimes rich families forbid their kids.

So this was my report of day one. Conclusion, it was all really interesting and I found some new idea’s for my thesis. Hopefully tomorrow will be of the same succes!

Inkling – The interactive textbook

Just found a really nice existing application on the iPad that gives interactive textbooks. You are able to click on parts in the images for more detail, watch short movies,… It even makes it possible to collaborate with friends. For example you can put a note with a question about a certain part in the text and your friends will be able to see that note and answer it… The video on http://www.inkling.com/ is definitely worth watching!

More detailed description of thesis

This thesis is about how web 2.0 applications and hardware devices like the iPad can change the way we teach and learn things. For example, a lot of students at the moment are too shy to actively participate in interactive lessons and because of that a lot of perhaps really useful input is lost. With the help of connected iPads (or other mobile devices) it could be possible to give anonymous input in an easy way. This input can then be gathered by the teacher. This can give more confidence to those shy students and motivate them to participate in future interactive lessons when they see that their input wasn’t as bad as they thought. Another aspect is in what way can the iPad replace paper? Wouldn’t it be healthier for the back if students don’t need to bring all those heavy schoolbooks anymore but instead just one device of 500 grams?

Because of the wideness of this subject the thesis will concentrate mostly on how this can be used in the special education. I have noticed that a lot of people with a mental disorder, like my brother, can work better with computers and touchscreen devices than that they can with pen and paper and I’m certain that if he could use such device during math lessons that he would make a lot more progress and be more motivated.

So concretely this means that we must iteratively investigate what the demands would be for such a system. Every device of the students should be able to communicate with the device of the teacher (or maybe also with each other for collaborations). This should go in an efficient way so no time is lost in the beginning of the course. We will also have to investigate which communication channel is the best for this kind of application (bluetooth, WiFi, 3G,…). So this thesis touches a lot of aspects, learning 2.0, developing an application on a touchscreen device, the communication between the devices and human computer interaction.

Hello world!

Welcome to my new blog, this blog will be completely in function of my thesis named “Learning 2.0 with special needs”.

This thesis is about how web 2.0 applications and hardware devices like the iPad can change the way we teach and learn things. More specifically we will study this in the special education. For example is the iPad more productive for a person with a mental disorder than pen and paper?

Updates coming soon!