Online Strategies due to COVID-19, Part 2

In this series of posts, the StatTLC blog team describes how we are managing with the abrupt changes to our courses. In this, we share some of our decisions (and the thinking that went into them), the tools we are using, and tips. We are teaching a diverse set of classes this semester at institutions with many different technology tools. We hope that you find this useful as you make some decisions for your classes moving forward in the time of COVID-19.

Adam’s Situation

Calendar: My institution is on trimesters, so instead of switching a class to an online-only format midstream, we are starting our spring term courses online. We hope to be in person for the second half of the spring, but I doubt that will happen.

Classes: Introduction to data science (undergrad, 34 students), Statistical consulting (undergrad elective, 15 students)

Switched to: Synchronous online classes on 3/11/2020

Technology: Institution uses Moodle, Zoom/Google Hangouts Meet, Panopto; I’ll also use GitHub and Slack for data science.

Adam’s Thoughts

With my “extended” spring break I am making changes to my two courses for online delivery. Both courses require students to use R extensively. In consulting, students work on a group project all term. In data science, students are learning a lot of fundamental ideas and solving problems for homework. I’m a bit worried about the tech requirements for these courses, but there is no way around it without devising completely new courses, which is out of the question. Luckily, my institution already has an RStudio server that students can use remotely. The IT department is also working to get all students internet access and equipment, but who knows how that will go in practice.

My consulting course was supposed to meet once a week for two hours. This allows students to meet with their groups and check in with me. I plan to schedule 30-minute weekly check-ins with each group. I’ll also be using Moodle heavily to guide project progress and have students submit weekly journals where they outline their progress and reflect on assigned readings.

To adapt data science for remote delivery, I plan to do the following:

  • I need to set student expectations from the start and make sure that we are all in this together. I plan to be very transparent, and openly admit there will be technical snafus and unforeseen struggles in this new format. I also really need to beef up my syllabus with a lot of new statements about these expectations.
  • I am going to shamelessly use existing content, recording new lectures via Panopto only when necessary. These videos will be viewed asynchronously. 
  • Like Laura Ziegler (Part I), I plan to make weekly videos with a recap of last week and a look ahead to this week.
  • I’ll use Slack for discussion outside of class and to answer questions during office hours for students who would prefer that type of Q&A platform.
  • “Class time” on Mondays and Fridays will be similar to office hours, where I answer questions and clarify concepts. On Wednesdays, I will have students work in groups. To allow asynchronous work, after the first week students don’t need to “attend” class, but the assignment will be due the next day.
  • I’ll use Zoom for office hours.
  • I’m abandoning tests in favor of case studies, where students will either write a blog post or record a presentation (using Panopto or similar) that they submit to me.

Steve’s Situation

Classes: Biostat Methods II (MS, about 20 students), Data Visualization in the Health Sciences (MS elective/service course, 6 students)

Switched to: Synchronous online classes on 3/11/2020

Technology: Institution uses Canvas and Zoom

Steve’s Thoughts

After teaching a total of 10 sessions online sessions, here are my thoughts/comments:

My courses are all transitioning to synchronous online sessions at their regularly scheduled times through my university’s Zoom license. So far, Zoom has included enough functionality to allow a fairly painless switch to the online setting. Some of my comments may be specific to my university, so I apologize if not all functionality works at your institution. Main topic of each comment is in bold for easier scanning.

  • Scheduling all Zoom class sessions through my course Canvas pages (Zoom Conferences app) has made it simple to provide students with the appropriate meeting links. One recurring meeting for Monday’s sessions, and one recurring meeting for Wednesday’s sessions. I believe you can also set a static meeting ID so in theory students could use the same exact link for all sessions. Scheduling through Canvas automatically notifies students of the meeting times and saves me the time of announcing the link before every class session.
  • When scheduling Zoom meetings, there is an option to automatically record the class session to either the local computer, or if your license allows it, to the cloud. Once we received permission to record to the cloud, this option was strongly preferred because you can set it to automatically transcribe the audio. While I expect most of my students to show up for the live session, I like the option to upload a recording just in case a student is without internet access or runs into technology issues during the scheduled class time. 
  • I set my Zoom meetings to automatically mute all students upon entering to avoid having a bunch of open microphones as people connect. Students are allowed to unmute their audio/video at any time if they have a question or comment (which works fine in my small classes, e.g. < 20 students). Otherwise, students can interact by using the “hand raise” button or the “clap” emoji which looks like a small hand raise. I can see these indicators by keeping my “manage participants” box visible at all times on one of my two monitors. Additionally, I keep the “chat” box open and visible at all times as well in case students are more comfortable typing than speaking. I am considering transitioning to requiring students to use their video, as sometimes I will ask a question and get no response at all. Two-way video may be important for engagement. 
  • Most of my class sessions involve a mix of verbal lecture, presentation slides, code examples, writing on the board, and exercises for students. Zoom’s presentation tools make it possible to continue using these methods. The screen sharing option in Zoom allows me to share my computer screen, which includes my slides and my R session. While sharing, I typically click the “Annotation” tab and use the “spotlight” feature to highlight my mouse. This makes it easier to track as I move it around the screen to “point” at certain things. 
  • Finally, for a virtual whiteboard, Zoom has a few different options. If you have an iPhone/iPad that you are comfortable writing on, you can share your device’s screen by clicking screen share in Zoom and choosing the iPhone/iPad option (instructions provided by Zoom from that point). Personally, I use the touchscreen on my Chromebook to create a digital whiteboard. To do this, I join the Zoom conference on my Chromebook and share my note taking app with the conference (I use Squid). This allows me to write on my Chromebook tablet with a nice stylus and have the result appear to my class in real time (the delay is very minimal).

Laura’s (L.) Thoughts

For anyone who knows me, I’m very much a people person. I say this because I was a little bummed when I realized that I was only teaching online for the 2019-2020 school year. However, in the wake of recent events (and especially because I’m taking on additional in-person classroom (my kiddos…so is that 2 additional courses?? 🙂 ), I feel I can offer tips and tricks into delivering an online course.

Tip #1: Communication is key!

While this may come as no surprise, I feel it is even more key in the online environment. Communication includes:

  • Instructions on how to navigate the online course, if they aren’t used to doing so (e.g., course overview and orientation). For example, provide a course structure for the rhythm of each week/unit (see this example from my introductory course). 
  • Updating expectations and (possibly) grading for the alternative mode of instruction. Things to think about are should they post questions in the Q&A or via email? How will you handle requests for extensions? Who should they contact first if they have questions: instructor or TAs?
  • As Laura Ziegler said, once a week (at the minimum, twice at the maximum) announcements about the week, upcoming assignments, upcoming assignments, and other important notes. 
  • Providing clear directions on all learning materials.
  • Offering timely, constructive, and frequent feedback on assessments. 
  • Responding to questions or posts in a timely manner (within 12 hours, minimum, and no more than 24 hours, maximum).

For other tips, see the recent StatTLC post by John Haubrick on instructor presence in the online classroom.

Tip #2: Create collaborative keys via Google Docs for activities.

If you have activities in class, move the activity to a Google Doc and have the students create the answer key as a class (we call them collaborative keys). Then the teaching team (instructors and/or TAs) can monitor the key to make sure the responses are on the right track and pose any additional questions. This offers an asynchronous, but effective, method for delivering active learning materials. 

We have been doing this method for a while in our flipped classrooms and for our online courses. It works better in the online environment than in in-person, and it’s actually a beautiful thing to see. There are discussions among the students, students helping other students out, questions being asked that are beyond the question that is asked, etc. We require students to post at least once (although, many go above and beyond that). Here is a document that includes (1) assignment instructions (that has a link to an example Google Doc collaborative key for our Week 1 activity) and (2) “How to contribute to the collaborative key” details on how to participate on the key. 

So, if you do have in-class activities, consider using Google Docs to create a community of learners.

Conclusion

This concludes our editor series on transitioning to the online environment during the COVID19 times. We hope that some of our thoughts and experiences are useful as we all try new things to adapt to the current situation. Feel free to share your thoughts in the comment section below or contact us to contribute a post of your own.

We hope that you and your families remain safe and healthy.

Online Strategies due to COVID-19, Part 1

In this series of posts, the StatTLC blog team describes how we are managing with the abrupt changes to our courses. In this, we share some of our decisions (and the thinking that went into them), the tools we are using, and tips. We are teaching a diverse set of classes this semester at institutions with many different technology tools. We hope that you find this useful as you make some decisions for your classes moving forward in the time of COVID-19.

Doug’s Situation

Classes: Introductory Statistics (algebra-based, about 80 students), Introductory Probability (calculus-based, about 20 students)

Switched to: Asynchronous classes (with synchronous office hours and review sessions)

Technology: Institution uses Moodle with Collaborate Ultra, videos made with a variety of free and open source software that are posted to YouTube

Doug’s Thoughts

  • The introductory statistics courses I teach have a course coordinator – this has added an unanticipated layer of planning to all changes and discussions. 
  • My campus uses Moodle which has built-in integrations with Collaborate Ultra. There seem to be two paradigms emerging: 
    • Use Collaborate Ultra and teach synchronously with recordings made available.
    • Make videos for asynchronous learning and then use Collaborate Ultra for office hours. 
  • I’ve chosen to go with asynchronous videos and then use Collaborate Ultra for office hours because I’m already comfortable with making videos. For colleagues with less experience teaching online at my institution, the synchronous approach with recordings seems to feel more accessible from what I’ve been seeing in emails.
  • I make videos using OBS Studio and upload them to YouTube. It is very easy to embed them into Moodle – just drop in a link. Students are familiar with YouTube, and the process is basically painless. (If I need to edit videos, I use OpenShot Video Editor, but with the amount of videos I’m making I’m just going for quick right now.)
  • If I’m making a video of anything other than PowerPoint, I use PenAttention to highlight my cursor. Remember to zoom in on text and applications (e.g. I normally use a small font in RStudio but enlarge it for videos).
  • All of my YouTube videos are unlisted (anyone can watch, but only with a link). I don’t have a good reason for this instead of making them all public. I make a playlist for each class that I add every germane video to; I share this playlist link with the class often.
  • Some students have logged into my office hours expecting content delivery – establishing norms for virtual office hours seems to be something I need to proactively do. 
  • In changing to online, we’ve also changed our grading schemes. We decided to use two different weighting systems (with students earning the higher grade) because of all the uncertainty surrounding this transition and the lost opportunities for improving grades by doing well on a heavily-weighted final.
  • For many of my students, this is their first online class. Explaining the different options for submitting assignments needs to be explicit. I find myself intentionally repeating the same information in multiple messages and on different platforms (email and Moodle).
  • I’m also teaching an introductory, calculus-based probability course this semester. Many of the students are not math or stats majors and don’t know LaTeX. Being very flexible in terms of how assignments are submitted is key – I’m fully expecting some students to email me photos of their homework, and I’m okay with that. 
  • I’ve decided to try to use Zulip with my probability course (about 20 students). This is similar to the Discord app that Chris Engledowel talks about in his StatTLC post, but also includes the ability to use LaTeX, syntax highlighting for code, and is open source. Lots of pros, but the cons is that it is less familiar to students than Discord. So far about ¼ of the class has signed up, but there has been very little use so far (only been a day or so). Students seem to be using it mostly for private messaging me rather than for interacting with each other.
  • We were supposed to have a project at the end of the probability course. This is still happening, but recognizing that I will be less able to support some students, I have developed a few “canned projects” for students to do that are essentially some readings and problems on new topics. (I would offer the same thing in a statistics class with a few pre-selected datasets rather than having students find their own data.) I am still encouraging students to pursue a more creative project, but I recognize that that is not likely to happen for everyone this semester.
  • This blog post has been circulating among my colleagues and raises some really interesting points. Since reading it, I’ve resisted calls to poll students about their technology availability (e.g. webcams, scanners, printers, etc.) because a) this was never an expectation for the course and b) I know some don’t have them and I will already have to accommodate that. I’m trying to meet students where they are and be even more flexible than usual right now.

Laura’s (Z.) Situation

Classes: Introductory Statistics course (6 sections with about 60 students each, course coordinator), Advanced Regression course (about 28 students, half upper-level undergrad stat majors/half MS non-stat majors)

Switched to: online classes (asynchronous and synchronous)

Technology: (Introductory Statistics course: StatKey and JMP, Advanced Regression course: R)

Laura’s Thoughts

I am currently teaching 2 courses; an introductory statistics course and an advanced regression course. The student audience for these courses are very different, and therefore will teach them online differently. I have been reading an overwhelming amount of tips for teaching online, and I am sharing what I have decided will be my best approach to teaching “online in a hurry.”

These are my recommendations for any course, which I will use for both of my courses:

  • Keep it simple, not just for the students’ benefit, but for your sanity as well.
  • Make videos to share with students.
    • Videos should be short for two reasons. First, students will lose interest if they are too long. Second, if you make a mistake, you won’t have to redo as much.
    • Videos should be imperfect. No matter how much of a perfectionist you are, you need to focus on the bigger picture. Don’t worry about having perfect sound quality, saying “um” too much, or having your kids or cat run into the room. Just get it done and out there for students.
  • Try to keep things as similar to what we would do in class with the possible exception of being asynchronous. Students are stressed and if we can keep things similar to what they knew before, that may help relieve stress.
  • Send a detailed weekly checklist to students with recommended dates on when to have videos watched, upcoming due dates, etc…
  • Avoid sending too many emails. We are getting a lot of emails, so we should expect students are also getting a lot of emails. Try not to overwhelm them. Try to write one email per week, ideally on Mondays, providing an overview of what is to come with the checklist that is kind, empathetic, and encouraging.
  • Don’t forget about your TA’s, they are nervous too! Have weekly online meetings with them to ask them how they are doing. Give them the opportunity to ask questions not just about the course but also about life in general.

For a large introductory statistics course, I have additional recommendations. For some background information, the introductory statistics course I work with has 6 sections, each with approximately 60 students. I am the coordinator for the course, and therefore have been in charge of getting it ready to be online.

  • Teach asynchronous with videos. Students are across the country, in different time zones, with different access to internet.
  • Provide software output on assignments in case students do not have access to software.

For my advanced regression course, I have 28 students. Approximately half are upper-level undergraduate students and the other half are Masters-level, non-statistics students.

  • Have spent a lot of time talking to myself creating the online videos for my introductory statistics students and am missing the live aspect of teaching. I am planning to do synchronous teaching for students who want to attend. I will record the lecture during that time and will post it for students who choose not to attend. This is going against most of the recommendations I have seen, but I am going to give it a go anyways!

My plans are not perfect, and will likely change after the first week of online teaching, but that is OK! Be honest with your students and they will appreciate the effort you go through to help them through this challenging time.

Adapting Statistics Instruction for an Online Environment in the Wake of COVID-19

Contributing author Christopher Engledowl is an Assistant Professor of Mathematics Education and Quantitative Research Methods at New Mexico State University.

The world is currently experiencing unprecedented forced movement from face-to-face interaction to a completely virtual form of interaction. Higher education institutions have quickly made sweeping policy decisions that have, overnight, overhauled the classroom learning environment. These decisions have resulted in many people questioning the kinds of quality that can be expected—especially from instructors who have never taught an online course Simultaneously, many organizations have expanded the capacity of their digital platforms to accommodate the insurgence of people making use of their products for teaching and learning.

For instance, Discord—an application with free voice and text chat originally designed for gamers to interact in real time with one another, read more here—recently increased the capacity for live streaming for up to 50 people for the sole purpose of making it more amenable to online instruction. They also published a blog post about how to use Discord for instructional purposes, including a special pre-organized setup to help streamline the interface for new users.

Just as many others have recently experienced, my institution has recently dictated the movement of face-to-face courses to an online setting in order to practice social distancing and follow government recommendations designed to slow the spread of COVID-19. I am currently in the process of transitioning my face-to-face courses to online format, and I am making use of Discord. In this article, I will showcase how I made use of Discord in a prior online course, what I observed about student interactions, and what students reported about their experiences. I believe Discord can be an effective, and easy to implement, tool for creating quality discourse.

Some Context: Advanced Statistics in College of Education

In the Summer of 2019, I taught a required doctoral level course for an online-only program in a College of Education called Advanced Statistics. This course is comparable to a typical undergraduate level introductory course in statistics. In the pre-requisite course, students are exposed to basic descriptive statistics and visualizations, leading up to a two-sample t-test. Advanced Statistics extends this learning to include ANOVA, ANCOVA, and simple linear regression. The student population ranges in age from 25 to 50, whose only experience with statistics is the prerequisite course, where I have had students tell me that they had never seen a boxplot before! The course is application-based and ends with a small-scale project where students explore their own research question using either their own data, or data from the 2012 PISA—which is used throughout the course.

Because it was an online course, in addition to including the kinds of instructor presence and interaction that have been discussed by John Haubrick on this blog, I also was asking myself: How do I emulate the important student-to-student interaction that would occur in a synchronous, face-to-face setting, as suggested by the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report?

Using Discord to Promote Quality Interaction

What is Discord?

Discord is an application designed with both text and voice chat “channels” within a “server.” The server is the larger space that only invited members can interact within, and it is composed of channels where members chat. Discord text chat channels are free-flowing chat streams. This was highly appealing to me because threaded comments can have the side-effect of conversations only existing in small groups, without ever making their way into the larger classroom discussion. Moreover, because Discord has integrated tagging (using the @ symbol), it makes it easy for everyone to see who is having side conversations, while also allowing others to enter into that same conversation—thus promoting them to the whole group level.

How Can it Promote Discussion?

In the Advanced Statistics course, because the majority of students were teachers and administrators in K–12 schools, this course was managed largely asynchronously. I used Discord as the central place for managing the classroom environment. I regularly posted links to videos on my YouTube Channel and I also posted announcements for the few times I conducted livestreams using a free application called Twitch. Thus, Discord was used for nearly all student-student and student-instructor interaction. To encourage students to get to know one another more, and make discussions feel more authentic, I set up a #general chat channel for them to discuss anything they wanted to, where I would not be monitoring unless I was tagged. I also created a #current-music-jam and #current-reading-interest channel. Many students made use of these channels at different points, and I also shared my own reading and music interests.

The course-specific channels I created to align with course learning goals were #roller-coaster-tycoon (to discuss assignments related to this dataset), #spss-discussion, #research-interests, and #p-values. Channels are very easy to add at a moment’s notice, but these seem to have sufficed for the course and were meant to work toward the GAISE recommendations to “foster active learning” and to “use technology to explore concepts and analyze data” (p. 3). It also supported students as we worked toward the GAISE goals regarding the investigative process, understanding statistical models, and understanding inference (p. 6). Discord supported these goals by providing a space where students could engage in productive discourse with one another to deepen their knowledge. For instance, as can be seen in the two screenshots below, students frequently inserted screenshots of output they were trying to make sense of in order to crowd source whether their interpretations were correct. I largely stayed out of these conversations, and found that many students would enter into the conversations, resulting in dialogic interactions that everyone learned from. Sometimes these conversations would head in an unproductive direction, but because I could see the entire conversation—unlike if it was occurring outside of class or in a group discussion in a face-to-face class where it might be difficult to hear what occurred—I could point directly back to the conversation using tagging—or even just tagging @everyone—or a screenshot and help steer students in a productive direction. This cannot be overstated: Being able to see entire conversations in this way is an incredible advantage over face-to-face discussions. It allows, in a sense, an omniscient perspective—one that everyone in the entire class also enjoys the benefits of.

How Can it Improve Instruction?

On the administrative side of teaching, to encourage participation, I evaluated both the quantity and quality of contributions using a simple rubric. Searching for a student’s username produces a list of every contribution they have made, along with a timestamp and the place in the chat stream where the comment was made—faded in the background. You can also filter contributions by channel. To see the contributions in the context of where they occurred in the chat, a simple click on the background reveals them. This process was very efficient, taking about 2-3 minutes per student.

What Did Students Say About Discord?

In an anonymous poll, I asked students: How useful did you find Discord? On a scale of 1 (Not At All) to 5 (Very Useful), 54% rated it a 5 and 23% rated it a 4. No one rated it below a 3. A follow up item asked students what they liked about Discord, and many responses were things like, “it is very interactive and we’re free to ask any questions we need at any given time” and “nice interactions that you could follow.” When asked what they did not like about Discord, students described issues that would exist even if the courses were face-to-face (e.g., “I couldn’t work ahead because I had to be involved in discussions”). Other responses were simple complaints (e.g., “Another platform”).

Perhaps even more revealing were the comments students gave when asked to compare ways of interacting in the Canvas learning management platform vs. Discord. Many responses included statements such as “Discord is best for discussion in real time” or “Discord seemed easier to follow than discussions on Canvas (and I teach online using Canvas)….seems less formal and more able to operate like a texting stream.” I will leave with this last revealing comment. When discussion turns into “I’ll do it just for the grade,” we have lost a major opportunity to promote deep learning through social interaction:

Discord is best for discussion in real time. Canvas is ok, more for turning in work and such—Posting discussion board responses and getting feedback, it is more assignment based.