New Collaborators at the Toronto Open Science Code Sprint

This guest post from Madeleine Bonsma, genomics graduate student at the University of Toronto, and lead on Collaborate’s Phage Parser project.

Mozilla Science Lab’s Toronto Open Science Code Sprint (March 7-8, 2015) was great fun and, in my opinion, a great success. The weekend was packed with collaboration between projects, mutual encouragement and assistance, and a great supportive and productive atmosphere.

I was impressed by how quickly many people jumped into new projects and started producing results; I had the chance to work with Natchar Ratanasirigulchai, a co-op student at the University of British Columbia pursuing a combined honors degree in Biology and Computer Science.  As a first-time code sprint attendee, I thought two days wouldn’t be very much time to get something done with people I’ve never met. I was very wrong about that! I now have a heightened interest in seeking out new collaborations with people from diverse backgrounds.

I participated in the code sprint on the Pathogens and Disease Immunity project. By the end of the weekend we had completed most of our goals and made good progress on others, culminating in a demo visualization of bacteria-phage interactions captured in the CRISPR locus. Find out more about our project and others on the Mozilla Collaborate website.  It’s all open, and contributors are always welcome!

Week in Review: March 9-15, 2015

After a short hiatus, our Week in Review series by Bill Mills has returned! We’re shifting the focus of these posts to the broader community, so if you have goings-on in open science you’d like highlighted that week, make sure to let us know.

Open Education Week

This week marked #openeducationwk, a worldwide effort to promote and advance the discussion around open educational resources, organized by the Open Education Consortium. A few interesting highlights from the event are as follows:

Also for Open Education Week, the lab’s own Bill Mills spoke at Mozilla’s Open Education Working Group call, hosted every two weeks and open to the public. Bill commented on the key role of community and inclusivity in open education, how accessible, welcoming spaces to learn and share skills are crucial to the open science movement, and how the Science Lab is trying to create these spaces with its Study Group initiative.

The Week in Open Science

  • Taking advantage of Apple’s new ResearchKit API for health data, Sage Bionetworks highlighted their work on two new apps leveraging this data to combat Parkinson disease and breast cancer. (Don’t forget – our friends at Sage have two other projects on Collaborate you can jump in an participate on!)
  • Ross Mounce set off a firestorm when he pointed out Elsevier appeared to be charging for an open access article, re-opening the debate around ‘hybrid open access’ publishing, and highlighting the at times nebulous and unintuitive rules at play in this space.
  • Stephen Curry wrote an article on his experience publishing negative results in the life sciences, in which he discussed how open access is helping to make such publications possible, and how this culture shift can empower researchers to move on at their discretion, rather than being trapped hunting for positive results.
  • The Italian research community agreed the founding of a non-profit national organization for the promotion of open science.
  • Nicole Radziwill wrote an illuminating article (with examples!) on the hazards of inferential statistics and the dangers of using the p-value as the arbiter of truth, in the wake of Basic and Applied Social Psychology‘s ban on p-values.
  • re3data.org and Databib have merged to produce a combined registry of data repositories, promoting standardization and discoverability in data distribution. Also, the registry announced a new API to enable machine access to their database.
  • (published January, but popular this week), Isabella Peters et al released a study into correlations between data citations, DOI availability and altmetrics, noting that the availability of a DOI does lead to more data citations, but the current deployment of this and other infrastructure is still very low.
  • The Scientifc Data blog at Nature described the great positive impact generalist data repository services like Dryad and Figshare are having by providing data hosting services to researchers & journals.
  • Open Science ASAP did a Hangout On Air this past weekend, visiting the Bricobio DIY Biology lab in Montreal. Also, checkout ASAP’s collection of markdown templates for open science on GitHub!

Last but not least, happy birthday once again to our friends at the Center for Open Science (two years already last week), and remember to check out the open science round up from our colleague Eva Amsen, over at F1000 Research.

Wrap-Up: Toronto Open Science Code Sprint

Following the success of our global sprint last July we wanted to take look at how we could bring the idea of code sprinting on open research projects to a more localized setting. So … last weekend, March 07-08 2015, Mozilla Science Lab hosted the first Toronto Open Science Code Sprint at the Mozilla offices in Toronto. It was an opportunity for like-minded members of the local open data and research community to come together with developers, designers and other open science enthusiasts to collaborate on tools to help further science on the web. Four open research projects from our Collaborate initiative were featured at the event – Cytoscape.js, Matplotdash, Pathogens & Disease Immunity, WormBase.

It was an amazing two days …

Here are highlights from the incredible weekend of collaboration.

• A prototype for generating a Bokeh.js plot of supercomputer data using a static dataset. The first step in developing the foundation for Matplotdash – Chris Ing (Matplotdash) and Adrian She.

• A visualization of bacteria-phage interactions captured in the CRISPR locus – Madeleine Bonsma (Pathogens & Disease Immunity) and Natchar Ratanasirigulchai

• An extension for Firefox that allows you to visualize your browser history in graph form using active tabs from your current browsing session – Max Franz (Cytoscape.js) and Andrei Papaz.

• Exploration of data visualization tools for WormBase-Mobile using Cytoscape.js through collaboration between Sibyl G (Wormbase), Max Franz and Andrei Papaz.

Many thanks to all our project leads and participants.

If you’d like to get involved in an open science project check out our Collaborate page here to see if there’s a project you’re interested in or if you’d like to organize your own local code sprint event please get in touch at sciencelab@mozillafoundation.org – we’d be happy to talk to you.

Reflections on Mobile World Congress: The Power of an Open Mobile Web

16758903746_60d350f01c_k
The mobile Web is experiencing a watershed moment: over the next few years, billions of first-time users will come online exclusively through their smartphones. Mozilla believes it’s critically important these users find a mobile Web that’s open and invites creativity.
This was our rallying cry last week at Mobile World Congress (MWC) in Barcelona, where mobile technology leaders from around the globe discussed the industry’s future. It was encouraging to hear our rallying cry echoed by others: the GSMA, for example, dedicated significant time and floor space to promoting digital inclusivity.
As a first-timer to MWC, I was really proud of how Mozilla showed up. We unveiled a partnership with French mobile provider Orange, which can equip millions of users across 13 African countries with a Firefox OS smartphone and six months of data and voice service — for just $40. We announced a simple smartphone for first-time users that we’ll release with Verizon in the U.S. next year. And we debuted the beta Webmaker app, a free, open source publishing tool that makes creating local content simple.
Personally, I participated in two panels: One on digital inclusion and one on the power of connected citizens in crisis situations. These sessions gave us a chance to double down on our stance that access alone isn’t the answer — it’s only the first step.
While I disagree with many of their tactics, I was happy to see people like internet.org throwing out a vision for connecting everyone on the planet. But they are really missing the boat on literacy, skills and creativity. Most people will get connected at some point over the next 10 years; the real risk is people not getting the know-how they need to truly unlock the potential of the internet and make their lives better. We were able to effectively get that message across at MWC.
Screen Shot 2015-03-12 at 2.32.27 PM
One of the highlights from the panel discussions was meeting Kartik Sheth from Airtel of India. He talked about Airtel’s onboarding program, which introduces people to the internet by focusing on specific content they really want (a Bollywood music video, for example). Then, they educate users about what services the internet offers and what data costs through that process (e.g. introducing people to YouTube and helping them understand that watching a music video doesn’t cost that much in data). This may sound simple, but it’s actually the kind of “ambient web literacy” that we really need to be thinking about. It has the potential not only to give people very basic internet knowledge, but also to help us avoid what I’m starting to call “the Facebook Effect.”
Of course, Mozilla is committed to web literacy at a much deeper level than just basic onboarding. We spent a good deal of time talking with people at MWC about our growing Learning Networks and Clubs. Our Clubs feature curricula that can be remixed and reimagined, and are held in diverse languages and venues. We met with a ton of people ranging from phone carriers to international agencies aimed at empowering women. And these people expressed interest in helping Mozilla both grow these networks and distribute the Webmaker app.
I left MWC energized by these sort of conversations. Feels like more momentum than ever. If you want to be a part of it, it’s worth checking out Webmaker.org/LocalWeb. This site includes a bunch of the research and partnership opportunities we talked to people about in Barcelona, as well as a link to the Webmaker app beta.

Research Coding Communities: Ask Us Anything, March 24

This post from Noam Ross, organizer of our upcoming Ask Us Anything event.

How do you create and nurture communities of people who teach, learn, and collaborate to build scientific computing skills? That’s a question central to much of MSL’s work, especially as we embark on new long-term training initiatives.

On March 24, 6-8PM EST, we’re hosting an online panel discussion on this topic on our forum. It’s Ask-Us-Anything, MSL-style. We want to spur knowledge-sharing among those who facilitate local learning communities. Are you part of a study group, users’ group, or other community of people who help each other with these skills? Do you want to start one or improve how yours works? Please join us!

Our panelists each work on local initiatives to train computing skills and build learning communities. We’ll be talking about our models, approaches, and challenges, and taking questions and comments about how to build such communities elsewhere and improve them.

The Panel:

We hope that this will be just the first of many discussions of community leaders we can facilitate. To join, just log on to the forum topic at 6 EST and meet our panelists, and start asking questions. We hope to see you there!

Collaborate Open for Submissions

Thanks to Abby Cabunoc’s recent work on the Science Lab’s web offering, I’m very pleased to report Collaborate, our portal for open science projects seeking new participants, is open for submissions following its initial four-month beta period. We’ve learned a lot about the intersection between researchers, coders and students over the past few months, and we’re ready to put these ideas into practice at Collaborate. Here are some early lessons learned from our first steps in this space.

For Researchers

I was stunned at the diversity of projects that approached us for Collaborate’s initial offering; from public health to quantum gravity, the scientific community stepped up with a rich array of projects to capture the imagination; I found myself all of a sudden unable to resist hacking on things from bee ecology to oceanographic data to bacteria genomics. When we were first coming online, there was plenty of speculation (a lot of it from yours truly) on what would make a successful project. Should we tease out lots of really detailed issues, so newcomers have a clear roadmap of how to jump in? Should we focus on brand new blue-sky projects without a lot of technical overhead, or well-established projects with strong code bases and thriving communities? Totally unsurprisingly, the answer turned out to be more nuanced than any first guess.

It turns out, that it wasn’t factorization or domain knowledge or simplicity of engagement that seemed to matter the most; the projects that caught the hottest fire were the ones that were the most aspirational, like Trillian‘s attempts to unify a huge subset of astronomical data, or Phage Parser‘s ambition to uncover how disease immunity works. I think the thing that I admire most about the developer community, is that I’ve never met a coder who was afraid of a big, ambitious idea. The Collaborate projects that offer transformative, impactful science are succeeding by capturing imaginations and speaking to the heart of an engineer by saying: we can do anything we put our minds to, and the bigger the game, the better.

Another key ingredient, is understanding the intense creativity exhibited by people with a passion for code. I fell in love with coding, because I find it a uniquely articulate, precise expression of idea and intent. Part of the joy of coding is exercising that rich palette by imagining solutions for exciting, novel problems. It’s important for researchers to express their goals for their projects clearly, but also crucial to leave plenty of room for coders to experiment and imagine and innovate; the ideas they create will supercharge any research project beyond the limits of our original ambitions.

The opportunities for researchers also go beyond engaging experienced developers, too; there is also an opportunity to interact with students in your field, and build knowledge and technical skill right there at home. Making sure there are clear setup instructions to help newcomers get started goes a long way to including your students; setting up some smaller problems for them to start with is something we strongly encourage, so that Collaborate can help foster student coding experience and familiarity within the sciences, as well as bringing in participation from wider audiences.

Finally, the last and perhaps most important hack on the researcher side is leadership and engagement. There is tremendous talent out there, eager to engage and learn and contribute to research today – the key, then, is to actually engage with them. Projects with research teams most eager to have conversations with their volunteers, meet with them to learn about their interests and answer their questions and take the time to interact with them have had the most success. As such, all research teams should be prepared to spend several hours every week interacting with their volunteers; anything less, and the relationship is too one-sided to be successful.

For Coders

First and foremost, a huge thank-you to everyone who has dropped by Collaborate so far to look into any of our projects; keep checking back, because we are posting new ones regularly. We’re immensely grateful for your contributions, and if there’s a project that looks interesting to you, the best way to start a conversation is by asking questions. We started Collaborate because of the overwhelming excitement and interest the developer community expressed for participating in open science projects as far back as 2013 at LXJS, and because my personal experience has lead me to be completely confident that great impact can be had by coders engaging with the sciences that interest them. The obstacles to doing that aren’t scientific knowledge or experience; they are almost always pure communication issues. By asking questions and starting conversations we can quickly zero in on ways we can work together across personal and professional experience. As always, the Science Lab is happy to help in these conversations; I’m @BillMills on GitHub, feel free to cc me on any issue and I’ll try and help sort things out.

Another thing we saw, was the huge impact that projects from developers could have when interfaced with the right research project. One example of this was the Dat project, Max Ogden’s ‘GitHub for data’ that he and his team have been working on for some time now; turned out, that Dat had an interesting overlap with Trillian, one of Collaborate’s first projects, that led to fruitful discussions and collaboration. If you have a project (side or otherwise) that you think could be impactful in the sciences, feel free to create a listing for it on Collaborate! It may just be exactly what a researcher is looking for, and all that’s needed for a powerful team-up is a little added discoverability.

For Students

Something I’ve been telling students worldwide, is that coding workshops and lessons are fantastic ways to get started building coding skills, but the only thing that will get you the comfort with coding that you want is practice, practice, practice. One great opportunity Collaborate provides to students, is a chance to practice and build their new coding skills on authentic, real-life research projects. Just like coders, I strongly recommend students start conversations with the researchers behind projects they find interesting by asking questions about them, and finding out where they can start to contribute; again, feel free to cc @BillMills on conversations on GitHub if you’d like some help figuring out how to get started.

Also for students, don’t ride alone! If you’re new to coding, make sure to find some friends or colleagues to work on these projects with you. Try and get together once or twice a month to discuss what you’re working on, help each other with your problems, and work together. You’ll find the experience more fun, learn more and make more progress if you do it together.

Conclusions

Collaborate is a forum for ideas, an incubator for ambition and an aspirational space characterized by a curiosity for what’s possible and an enthusiasm to learn more about science and coding; the people who have been having the most success are the ones who treat it as such. I’m looking forward to seeing plenty of new projects and new participants come on-line in the coming weeks; if our first few months of collaboration are any indicator, we’ll do great things if we aim high, make room to innovate, prioritize conversations with each other and work together. As always – I hope you’ll join us.

Image Credit: Adapted from Cytoscape.js, one of the projects participating on Collaborate.

Coding Study Groups Are Great – But How to Start?

 This guest post is by Kathi Unglert, a PhD candidate in Earth, Ocean, and Atmospheric Sciences at UBC. For her PhD project she uses artificial neural networks to study a special type of earthquakes that often happen during volcanic eruptions. When she’s not busy doing that she loves blogging about volcanoes and other science related topics at her blog, Volcano Diaries.

 Last fall we got a bunch of students, postdocs, research assistants and faculty together to have a meeting every two weeks. We talk about software that may be useful for everyone’s research, or discuss coding problems that one or more of us may have encountered. It’s been working really well, so I got approached by the Mozilla Science Lab crew who asked whether I wanted to talk about how we run these meetings during the monthly community call. I thought maybe a blog post might help to give a bit more advice in case you missed the community call. So here we go, steps toward starting a successful software workout group:

1. Commitment: You need at least a few people who are committed to this. That doesn’t mean that everyone needs to show up every single time, but it takes a core group of people to keep pushing and to keep the meetings alive. Set a fixed time, book a room, and make sure to…

2. …plan ahead for a few weeks: We meet a the beginning of the term to make a schedule for the entire semester. We assign topics and speakers, so everybody can put those dates in their schedule. That way you avoid cancelling a meeting because you can’t find a speaker or topic at short notice.

3. Get rid of hierarchies: The topics we talk about all come from within the group. If somebody knows a good software and thinks it might help people with their research – they add it to the list. If somebody would like to learn about a particular command or software – they add it to the list. Everything is driven by the group, not an organizer or teacher. Similarly, all our speakers otherwise sit in the meetings as students. Everybody is in the same boat. Peer-to-peer teaching really works!

4. Stop believing that you have to be a software expert: I was in the same trap in the beginning. I never would have thought that I had something to contribute to a software workout. After all I’m a scientist, not a programmer! But turns out when we’re all scientists in the room that doesn’t matter anymore. I may not know everything about a particular command or programming language from a professional point of view. But I do know how to use it for my scientific purposes, whereas other people in the group may not even realize that it exists. Even more importantly, I can put the commands into a scientific context where everyone else can understand what I’m talking about and can imagine how it may be useful for them. So just believe in yourself and your abilities!

Our meetings started with a group of people who all attended a Software Carpentry bootcamp. Whereas I don’t think this part is crucial it was a nice way to kick start our biweekly meetings: We already had a group of people from different disciplines in one room, and everybody was interested in learning how to deal with their day-to-day data processing more efficiently.

In general it doesn’t matter what topics your group choose or which language you prefer to code in. In our meetings we use a combination of shell scripting, Python, and Matlab. We add on tools and software as needed.

Lastly, I just want to put in a quick word about interdisciplinarity. It’s really a blessing and a curse. In some ways, because we all come from different disciplines, sometimes a particular topic won’t appeal to everybody. That’s fine. If the schedule is known ahead of time, everyone can make a decision whether they want to take this opportunity to learn something new, or maybe skip the meeting and focus on other work. On the other hand, many disciplines have certain software that are “standard”, where knowledge about usage gets passed on from one generation of researchers to the next. However, sometimes it can be great to get a new perspective on things. Even within our Earth Sciences department, sometimes the oceanographers might use a tool that could be useful for seismologists that they don’t know about, and vice versa.

That leaves only one thing: Let the software workouts begin!

Save the Date: Mozilla Science Lab Community Call March 12

Our next community call will take place this Thursday, March 12. The call is open to the public and will start at 11:00 am ET. Call in details can be found on the call etherpad (where you can also find notes and the agenda) and on the wiki. (If you have trouble with the toll-free number, try one of the numbers at the bottom of this post.)

The Science Lab meeting is our community call, taking place each month, highlighting recent developments and work of the community relevant to science and the web. Join us to hear more about current projects, find out how you can get involved, and hear from others about their work in and around open research.

This month, we’ll be hearing from Shauna Gordon-McKeon on Open Science Comes to Campus, a workshop she and Bill Mills are working on spinning out of Open Hatch‘s successful Open Source Comes to Campus series. We’ve lead some community discussions and brainstorms over the past few weeks on how we can introduce the skills and ideas of open science to undergrads, and we’re ready to start drafting curriculum; Shauna will be updating us on the status of the project, and upcoming plans.

Also this month we will be hearing from Jon Udell on his current work to revisit online scientific collaboration, as an update to his seminal work, Internet Groupware for Scientific Collaboration. Jon is looking to speak to researchers in a wide cross-section of fields to better understand how scientists collaborate online today, and will be sharing some details on the project and what he’s looking for on the call on the 12th.

Finally, we’re also going to hear from Ward Cunningham, original inventor of the wiki concept & technology, on Smallest Federated Wiki, his ongoing project to reinvent the wiki platform as a ‘chorus of voices‘, via forkable, distributed and creator-owned content.

Have an update, blog post or event you’d like to share relevant to open science? Add it to the etherpad (see ‘Non Verbal Updates’, line ~90). It’s a great way to share what you’re working on and/or interested in with the community. Don’t be shy. Have a look at last month’s notes for an idea of what others contributed to the conversation.

Mark your calendars, tune in and help us spread the word – everyone is welcome. For call-in details and links to the etherpad, visit our wiki page. We hope you’ll join us.

Note: Having trouble dialing in? Try one of these numbers. (Note that they are toll calls and you’ll be charged by your telephone company if the number is long-distance.)

After you enter the extension, you’ll be asked for the conference ID, which is 7677.

  • US/California/Mountain View: +1 650 903 0800, extension 92
  • US/California/San Francisco: +1 415 762 5700, extension 92
  • US/Oregon/Portland: +1 971 544 8000, extension 92
  • CA/Vancouver: +1 778 785 1540, extension 92
  • CA/Toronto: +1 416 848 3114, extension 92
  • UK/London: +44 (0)207 855 3000, extension 92
  • FR/Paris: +33 1 44 79 34 80, extension 92

It’s 2015, do you know where your data are? The Data Trail Badge

This guest post was written by Tamara Shepherd, collaborator on the “Co-Designing Open Badges for Privacy Education with Canadian Youth” project.

Social network collage image

“Social Network” by Kevin Dooley under CC-BY 2.0

Understanding where personal information goes online is an important dimension to appreciating the importance of digital privacy. The Data Trail Badge seeks to illuminate the everyday ways that personal information can be collected and tracked by communications technologies. The objective of this badge involves not only tracing different data trails, but building up a story about how privacy issues might be involved in typical daily life. Storytelling offers an important way to illustrate just how pervasive data collection is across all kinds of communication activities.

Early Data Trail Timeline Design

Early Data Trail Timeline Design

Online tracking is one of the key concerns of privacy advocates because of the way that almost all online communication results in data collection. When you post a photo on Facebook, send an email through Gmail, or buy a book on Amazon, sensitive personal information is collected by these organizations and might also be further sent on to third-parties – other companies such as advertisers who want to find out what kinds of people are interested in certain products or services. In addition to commercial data collection, governments have long been collecting and storing personal information about their citizens as part of services such as healthcare, border control and education.

Added to these legal kinds of data collection, there is also the possibility with online communication that these data trails could get illegally intercepted. This is because of the way that networked communication involves information transfer through diverse nodes of the network. At each node, there is the potential for data to be copied and stored by intervening actors, meaning that multiple copies of people’s personal information can potentially get intercepted and breached.

Data Trail Timeline Badge Final

Data Trail Timeline Badge Design Final

Yet despite the potential privacy concerns raised by everyday communications activities, most people don’t know or even notice that their information gets collected. This is where the Data Trail Badge, currently in draft form as an activity kit, contributes a new way of thinking about data collection as ubiquitous. By creating a timeline that reflects your data trail for a typical day, and then presenting that timeline audio-visually using Mozilla’s Popcorn Maker or Google Slides. These kinds of timelines will further help other people to understand just how common data collection is, and how they should start to take steps to be aware of where their information might be going.

Prototyping Open Privacy Badges

This blog post was co-authored by Doug Belshaw, collaborator on the “Co-Designing Open Privacy Badges for Privacy Education with Canadian Youth” project.  

The Open Badges Infrastructure [OBI] is a system of exchanging and displaying metadata-infused, web-native credentials. What this means in practice is that any kind of knowledge, skills or dispositions can be recognized — by any sort of organization. Badges have been issued for everything from ‘soft skills’ such as confidence and teamwork, through to the knowledge, skills and understanding of science, technology, engineering and math (STEM).

Hive Toronto decided to prototype a badge system to encourage teens to learn about privacy. The project, funded by The Office of the Privacy Commissioner of Canada, has made use of paper prototyping with teen peer researchers and other participants in the project. Paper prototyping involves using low-fidelity materials like paper, glue, markers and chart paper to convey a design concept. Three kinds of prototyping were utilized in this project. Many of the prototyping methods are demonstrated in our video remix to recap the paper prototyping methods used in the project, with additional details provided here.

1) Protyping badge concepts
When coming up with an idea for a badge, there are many useful resources to help. One of these is the badge canvas, which helps individuals and organizations think through their badge in a systematic way. Sometimes, however, this is a little too high-bar to begin with.

Another approach is to sketch a badge idea, giving it a name and description to help the concept come to life. The “sketch and describe” prototyping method was used extensively in the Hive Toronto project.

2) Prototyping a badge system
Sometimes a “system” of badges need to be designed versus a single badge. For the Hive Toronto privacy badges project, creating 10 badges was the opening goal of the project. At an early stage in the project, the teen peer researchers used paper cut outs of paper badges to brainstorm a system of 10 privacy badges that could be interlinked in an educational setting. The paper cut outs utilized a templated approach, with various colours and sizes of badges, to help convey the relationships between the badges in the system.

Group1_00

3) Prototyping learning pathways
In the Hive Toronto privacy badges project, the 10 prototype badge concepts were arranged thematically under the area of Personal Information, Privacy Policy, Privacy in Everyday Life and Privacy Futures.

BadgeConceptsImg

For this project, the badges will be developed as prototypes (i.e., the curriculum for the badges will be online and presented with badge images and metadata).  Possible implementers of the curriculum in informal learning settings include: legal/civic education organizations, public libraries and after school programs. We are currently developing learning pathways for these settings which may cut across the above described themes.

Although this project strives to create a prototype level badge system, we will strive to stretch a little further.  We utilized draft versions of the teaching activities in the badge system for activities such as the Data Trail Timeline, IP Address Tracer, and Privacy Coach on Feb. 21st, 2015 at an educators’ event.  We are also aiming to make a couple of the badges earnable through Webmaker. We hope that making a couple of the privacy badges in the system earnable, will enhance community-level understandings of the usefulness of building out a fully functional privacy badges system for Canadian teens.