Evaluator Life

Posts about working and living as independent evaluators

One year later…

By Lindsay Lamb

What to Write in a Blog That People Will Want to Read
Image soruce: lifewire.com

We all know the story. One year ago, life as we knew it changed forever. I will never forget it. Andrea and I were in the office on Thursday and were getting ready to leave for the day. We checked in about what projects we had coming up, what meetings we had on Friday to see which ones we both needed to attend, and where we could divide and conquer. We left and said, “See you tomorrow!”

That night, Andrea sent me an email saying there was a case of COVID-19 in Austin.

The next day, everything shut down. I sat outside and listened to the birds while holding my then 18-month-old in my arms and crying.

The next week was Spring Break and Andrea and I decided to work anyway. We had our first conference calls and Zoom meetings. Andrea and I checked in with each other almost daily to see how the other was doing mentally, physically, and emotionally. Some days were hard, and some days were harder. My husband and I set up a schedule to juggle work and childcare. I took the early work shift, getting up at 5 AM so I could work for a few hours before the kids got up. Then my husband would work while I took the kids outside and did some home-schooling activities with them.

In the midst of all of this, Andrea suggested I start writing a blog for our website. Um… what??? What on earth would I talk about???

Andrea is very business savvy, so I trusted her. She figured if we added some trainings and stories on our website someone might read them and seek out our help. At first, we both wrote mostly about what was going on with COVID-19, both in the world and in our homes. Eventually, we branched out and I started writing more and more. Potential clients reached out to us because of our blog posts. My dad, who started his career as a journalist, started a blog of his own!

As someone who takes the time to build relationships with others and collaborate in my work, this year has been hard… but the blog helped. Sure, I couldn’t physically reach out and talk to potential clients, share my experiences with peers or connect with other researchers in the field, but it helped me feel like I had a purpose in a very challenging time.

One year later, I am still writing this blog. I volunteered at a mass vaccination site and helped some of our most vulnerable population get their vaccine. I took my kids to visit my fully vaccinated parents who we had not seen since Christmas 2019. I am feeling hopeful.

Andrea and I weathered the storm (literally and figuratively!) and I honestly feel like our business is stronger than ever. Who knows what one year from now will look like, but I know after going through everything we have gone through this year, I can handle it… and I’ll probably tell you all about it too 🙂

Teaching kids about statistics doesn’t have to be spooky

By Lindsay Lamb

When the pandemic first hit, Andrea and I wrote a few posts about working at home with our kids. I’ll be honest – I thought it was something that would be over sooner rather than later. Now that we are nearly 8 months in to working and learning from home, honestly, not much has changed. If, like me, your child is still at home learning you might find yourself in need of a break from “zoom-school.”

One thing that got my family through a particularly difficult fall was getting excited about Halloween. Traditionally, our neighborhood goes all out for Halloween. Nearly every house has decorations and several streets are shut down to throw a huge block party. Houses on these streets are open for all to enter. Some are turned into haunted houses and others showcase incredible decorations inside the home (and hand out top notch candy). My daughter had the time of her life with two of her closest friends last year… while my son (who was a little over 1 at the time) threw in the towel rather early in a fit of tears. Oh well, I thought, maybe next year!

Oops.

Since our neighborhood block party and traditional trick-or-treating won’t be an option this year, I knew I needed to do something to keep my daughter excited about Halloween (which is her favorite holiday). As we were walking around the neighborhood one evening admiring the decorations, I thought of something fun for us to do instead (reminder: I’m a data nerd, so my idea of fun might be different from yours!): document all of the Halloween decorations in our neighborhood to determine which decorations were most popular. I made all of us (including my husband and Hayes) hypothesize which decoration would win. I also included a few more guiding questions for Hannah including, would we see more Halloween decorations the closer we got to Halloween? Which streets (or blocks) had the most decorations? What was the spookiest house? Which house had the most decorations?

Every day Hannah took off on her bike with lightning speed and I trailed behind her with Hayes and Lola (our dog) in tow. We stopped to take pictures and document all of the decorations we saw (which was a great way to chat with neighbors). Hannah never complained about riding her bike (which she started to do frequently in the summer); she was on a mission. My little scientist had to collect data.

In addition to Hannah truly enjoying the project, Hayes began honing his skills at spying skeletons, spiderwebs, and pumpkins. I was grateful to get us out of the house, forget about all the seriousness going on in the world these days, and see them truly be happy if even for a bit. When we got home, I helped Hannah document all of the decorations we saw. She made a list of each kind of decoration (e.g., skeletons, spiderwebs) and added a check for each time she saw a house with that particular decoration.

Hannah tallied how many houses we saw each day (28 was an all-time max!), and how many of each decoration we saw that day. It was fun! As an added bonus, I was sneakily getting her to practice handwriting, math, reading, and PE! It was great!

On our last day, she was excited to see the results come in – although we had a pretty good guess what the results would be.

I helped her count up the decorations, figured out what we saw the most (and least) of, and then we made a graph.

Hannah’s graph

Then I showed her how to make the graph in excel and talked to her about percentages. As we worked, I talked about how I do this type of thing in my job so I can help people make sense of things they want to count. Like the number of students who are engaged in online learning, the number of students from low-income communities who graduate high school and college, the number of high risk students who experience academic improvements because of a community based support model, and the number of teen parents who believe their relationships have improved as a result of an program designed to strengthen relationships.

Our excel graph using percentages. Hannah helped pick the icons and colors of course 😉

Now she at least some idea why I lock myself in the closet for a couple hours at a time every day… and maybe she thinks it is worth it. Who knows, we might even have a future data nerd in the family.

Virtual learning best practice: Expertly using technology

This is the fourth in our series identifying best practices in online learning. As stated in earlier posts, supporting students’ (as well as educators and their families) social and emotional needs must come first in any learning environment, particularly a virtual one in the midst of a pandemic. Next, educators should foster building relationships with each other, with students and with families. After establishing these foundations – which must be nourished throughout the academic year – educators can begin focusing on creating engaging content. One critical component to build a successful learning environment is to ensure that educators, students, and families know how to use the technology provided to them.

Create a virtual learning “studio.”  Moving learning into an online environment is hard. Instead of using the first few days of class to practice new technology applications, create a space to practice delivering the content before working with students. Doing so will add an air of professionalism and create a smoother transition to online learning on the first day. There are two major components to this aspect of online learning: visual and audio.  Importantly, neither of these require a large investment in equipment.

Visual professionalism includes:

  • Adding a webcam or setting up the internal camera so that the you face is well-framed (you might need to stack some books under your computer).
  • Ensuring good lighting by placing one or more lighting sources (e.g., window, lamp) in front of the camera.
  • Dressing for the occasion.
  • Setting up the background. Some instructors have gotten creative with backgrounds and have held class in different locations in their homes on different days to spark student interest. Some educators have made scavenger hunts with their backgrounds – use this tool to your advantage!

Audio professionalism includes:

  • Having a quiet space for the meeting, free from audio distractions.
  • Ensuring that the microphone is good and does not echo
  • Speaking in a clear, engaging style (you might need to slow down so learners can stay engaged)

Educators should practice video sessions with a friend and/or record a practice session to practice, review, and refine. Over time, this process will become smoother, and taking these initial steps will ensure both educators and students are comfortable with the process.

Get to Know Your Learning Management System (LMS). Additionally, educators should take the time before classes meet to get to know the features of their online LMS and/or group meeting platform. Can participants chat in your platform? Can participants use a chat feature? Can you create breakout sessions? Do students and families know how to use your various platforms? Make sure you take the time to answer these questions and familiarize yourself, as well as students and families, prior to the first day of class. Also, be sure you (and students and families) know where to go, and with whom to contact, for technical support.

For example, use features embedded in Zoom to create polls, break out rooms, share screens, and take quick temperature checks of participants using emojis (e.g., clap, thumbs up, etc.). Doing so helps make learners feel safe to share answers, stories, ideas, and to speak up when experiencing a technical issue and need help. This gives learners a voice when they could have easily fallen through the cracks.

Use the chat function.  Public speaking is a strong fear for many adults and children, and sometimes it can be challenging to get people to speak out – especially when the topic is quite personal.  One of the benefits of virtual meeting programs is the simple text chat feature. Educators who are working with groups of more than 5 participants at a time would be wise to become familiar with the chat feature and to encourage its use. This feature is clearly better suited for older students, and is also useful for family members helping younger students engage in online learning.

Use technology to meet the need – rather than finding the technology first. Most importantly, use technology and platforms that will actually help fill a need rather than finding a technology application and forcing their desired content or need into that application. There are a lot of great educational technology resources out there, and not all of them will be right for you or your students. For example, technology can be used to engage students by sending messages to families (using platforms like GroupMe or Class Dojo), texting students an interesting question for them to respond to during synchronous or asynchronous gatherings, creating individualized assignments with video, and using Google voice/voice memos/videos to provide comments and feedback on students’ assignments. Similarly, students can share their work using video (such as Loom), images or Google voice/voice memos. This creates personalization in the learning and allows students to showcase their work and talk about it without interruption from peers.

As you move forward in an online learning environment, we hope these best practices will help you navigate these challenging times. If you want to learn more, stay tuned for our summative report!

Best practices to create an engaging virtual classroom

By Lindsay Lamb

Source: education.ucon.edu

This is the third in a series of blogs reporting on best practices associated with online learning. As discussed previously, supporting the social and emotional wellbeing of our students, educators, and their families is the highest priority in any learning environment right now. The next important thing for educators to improve online learning is to build relationships with students and families. These two strategies should be ongoing throughout the school year. Once educators address students’ social and emotional needs (as well as their own!) and build relationships, they can begin focusing on academic content. How can they do so? By creating engaging content.

In a virtual environment, engaging and relevant course material is even more critical than for in-person classes. A panelist during an EducationWeek online summit on reopening schools in the pandemic shared research gathered in Spring 2020, noting that synchronous learning cannot replace in-person learning simply by offering the same in-person content and pedagogy in an online format. Educators need to recognize that online learning is different, and we must play to the advantages of online learning. For example, online learning is more effective when students can engage in smaller groups where they can interact more directly with peers and can connect one-on-one with their teacher. These strategies build community within the class and between students and teachers.

Another best practice is to ensure that students have time to deeply engage in work on their own and away from the computer rather than passively listening and taking notes for the entire class period (or school day). Allowing students to work independently – or with a parent – and then come back to either a smaller group or a larger group to go over their learning is an excellent way to incorporate both online and individual work. Including a few synchronous learning opportunities for students coupled with asynchronous learning opportunities is a great balance. Doing so provides students with an opportunity to relate with their teacher and peers online as well as giving them a screen break and foster deep learning away from technology.

One strategy that works for all age groups is inviting guest speakers to attend lessons and share their experiences, stories, and personal reflections. As I’m sure we can all attest, guest speakers is a nice break for learners from the normal school routine. Students will benefit from hearing stories of strength and resilience during these challenging times. During a virtual internship program for high school students we had the privilege to evaluate this summer, we found that students were more engaged in lessons when a guest speaker was invited to participate and share their experiences that related to the course material. Students were able to reflect on the speaker’s story, making the lesson content relevant to their life.

Limit the amount of time students spend in an online learning environment. This is particularly important for younger students. According to the Illinois State Board of Education, the minimum and maximum length of engagement time for remote learning for all students under 2nd grade was 90 minutes, and for high school students, 270 minutes, still short of a typical school day. Schools should not require students to complete a full 6-7 hour school day remotely.

Showcase student work. This is a strategy that effectively works to engage students in person and can easily adapt to the online environment. Simply ask students take a picture of their work, record a video of their work, or share their work during online group meetings. Doing so will keep students engaged, excited and motivated to engage in the lessons.

Finally, continually checking in with students to see if they are engaged in the material is critical as lessons go online. For example, ask students if they liked the lessons, thought the online content was too long, if the course material was relevant to their life, or had any other feedback to improve their experience.  For younger students, checking in with parents is equally, if not more important. During our evaluation of the summer virtual internship program, we created weekly check-ins with interns. We asked questions about interns’ interest in the lessons, relevance of the lessons, and length of the lessons. These survey questions helped Ignite MindShift staff identify which lessons should be shortened, and overall student engagement.

Providing different formats for students to engage in learning, and continuously checking in with students and families to assess engagement with the material will help keep students engaged in the learning.

Building relationships in a virtual classroom

By Lindsay Lamb

Source: chicagoparent.com

As we move to online learning this fall, we are documenting best practices for educators to use in a virtual environment. We gathered insight from interviews with educators, reviewed recent literature, attended virtual summits and webinars, and interviewed students and families.

As we discussed in our previous post, providing students with social and emotional learning is critical at this time. That being said, as important as fostering social and emotional skill development and creating engaging content are, they will fall flat if educators do not build relationships with their students. As all educators know, building relationships is critical to successful student engagement, both in person and virtually. It is also a major challenge for the virtual environment. To build relationships virtually, we urge educators to consider embedding the following practices into their lessons:

  • Share personal stories
  • Set norms
  • Set expectations of the online learning environment
  • Foster small group discussions
  • Routinely check in with students and families

Share personal stories. Sharing experiences and being open and vulnerable was a common theme that ran throughout the internship. During an observation of a mentor circle call, one mentor described how she handled a difficult work situation, showing her vulnerability in order to help her interns relate to the material.

Set norms. Educators can begin to build community by setting norms at the beginning of the school year (or program) to convey clear expectations and promote mutual trust and respect. These norms should include guidance on when cameras should be turned on and off, when and how to mute or unmute yourself, how much participation is required, when emails can be sent, what students can do if they have a question, and how students should communicate with others. It is important to revisit these norms during each class/group meeting to make sure they are still relevant and to check in to see if new norms should be added. To ensure that norms are internalized and adopted, consider co-constructing the norms with students. Doing so will increase buy-in, ensure students’ voices are heard, and help make the norms constructive and positive.

Set expectations for the online learning environment. As part of the norm setting process, it would be wise for educators to spend some time discussing expectations for the online lessons. In particular, younger students will require additional time learning how to engage in online learning. It is unrealistic to begin school online in the way teachers normally would in an in-person setting. Much more time must be spent describing the virtual format and what is expected of students, answering students’ (and families) questions, and providing ample time for students to get used to online learning. Many students do not know how to interact in an online environment and need help learning how to do so (e.g., difficulty for teachers to see all students, when the teacher or another student is talking, do not talk over them; raise your hand if you have a question; know how to mute yourself). Even older students can use guidelines to help set norms to foster positive interactions with each other online.

Foster small group discussions. Only offering Zoom meetings for 20 or more students will not effectively build relationships with students. Instead, educators can use the breakout session feature in Zoom to create small groups for students to engage and connect with each other in a more meaningful way. This allows students to connect with each other and build relationships, talk to each other without the conversation getting lost, and relate to each other outside of the larger group setting. This will be difficult for younger students, so family help will be required. Another option is for educators to meet one-on-one or in small groups with each student as frequently as possible. This could be done weekly, bi-weekly, or monthly and is particularly important for younger students. All students need to know that they matter, that they are cared for, especially now. While this might be more time consuming for some educators, the payoff is far reaching.

Routinely check in with students and families. Finally, we know online learning will have its ups and downs. Not everything educators planned out will work, and some things will work well for some students and families while others will not. The key to navigating this conundrum is constantly checking in with students and families. Our advice is to have daily check ins regarding the technology access, duration of lessons, content of lessons, and how the student is feeling. This will also build relationships with each student and their family allowing them to feel more comfortable advocating for their/their child’s needs.

Online learning is not perfect, particularly for young children. Helping educators identify best practices to use while engaging with children online will help make online learning a more positive experience for everyone. Stay tuned for more best practices and the launch of our report in partnership with Ignite MindShift soon!

Best practices as we prepare for online learning

By Lindsay Lamb

If you are like me and have school age children, you probably spent the summer worrying about everything related to your child, your child’s learning, your child’s social and emotional wellbeing, your child’s teachers, and education in general.

Perhaps as a way of coping with this, and also as part of a larger project we were working on with one of our clients, we have been developing a Best Practices document for online learning (keep your eye out for it, we’ll let you know when it is available!). Our goal was to find answers to the following questions:

  • What are some effective strategies teachers use to engage students in online learning?
  • What strategies from the in-person environment can pivot to an online format?
  • How do teachers build relationships with their students?
  • How can we best support students and families during these challenging times?

To explore these questions, we spent the summer interviewing teachers, participating in webinars, reading timely research articles, and speaking with experts in the field. Based on all of these data, we identified six broad categories we believe will help educators navigate teaching and learning this fall:

  • Supporting students’ social and emotional needs
  • Building relationships
  • Creating engaging content
  • Providing consistent routines and procedures
  • Expertly using technology
  • Knowing when to pivot

Supporting students’ social and emotional needs.

While all of these practices are important, the theme that holds them all together and ran through our interviews, research, and learnings was providing social and emotional support for students, families, and teachers. While evaluating Austin Independent School District’s (AISD) social and emotional learning (SEL) program, I often heard program staff say SEL is not one other thing to add to teachers’ plates, it IS the plate. Now, I feel like SEL is the soil from which all learnings will grow. Without the ability to talk about emotions, build relationships, foster a safe learning community, and share experiences, teachers will be unable to teach, and students will be unable to learn. As one of my daughter’s teachers said in a meeting, we all need to give each other some grace. We all need to be okay with things not being perfect or exactly how we envisioned learning to be this school year. We are in the midst of a pandemic, and what matters most is keeping each other safe, happy, and healthy.

Recently, one of my friends and former colleagues wrote about her experiences teaching music in an online learning environment. The core of her teaching? Social and emotional learning. Was teaching music online perfect? No. Did she and her students experience technology problems? Yes. Did students benefit? Absolutely. Students need the arts, especially now, and social and emotional learning is such a perfect fit for arts instruction. Students need something to help them connect with each other, express their feelings, focus on something outside of the stresses they are experiencing because of the pandemic and political unrest. They need to feel part of something bigger than themselves, and just get the chance to be a kid. Is teaching the arts – or any subject – online an ideal way to experience learning? No, but there are great teachers out there making the best of this situation, and best practices we can learn from them.

I just want to close by reminding everyone that so many educators are going above and beyond to be there for our children while also caring for their own families. I cannot thank them enough. On a personal note, my daughter got through the summer by continuing to participate in her dance class over Zoom. She relished in being able to just be a kid, to wear a costume, to dance with her brother, and be silly. Her teachers always made time to listen to her stories, do a quick check in with everyone and see how they were feeling, and build a community. Rather than bemoaning online learning, let’s embrace it for what it is since we cannot do anything to change the situation. Let’s look for the joy and find ways to connect, reflect, and just help your kid to be a kid.

School Goes Virtual (Again)

by Lindsay Lamb (with a few random comments by Andrea Hutson)

Due to the recent increase in COVID-19 cases nationally, it is likely that if you have a school age child, they will not go back to school in a normal manner (regularly, in person) this fall.

As I have mentioned before, I have two children that I have been doing my best to keep educated, entertained, and healthy while we have all been sheltering in place these past four months. My eldest is slated to start kindergarten this fall, and what should normally be an exciting, happy time is now riddled with fears. Going back to school in person could mean infecting teachers, our entire family getting infected, and a disruption in routine if schools are unexpectedly closed again. Virtual learning provides its own set of challenges, including me continuing to have to juggle work and school time as well as social and emotional trauma that my daughter has experienced during this time of isolation.

I am not alone. The long and short of it is that closing schools has placed an impossible burden upon families, particularly families coming from low-income communities. But given the recent spike in COVID-19 cases, what do we do? School leaders are placed in an impossible position as are teachers and families. This affects the entire community. I do not envy leaders at this time.

[Sidenote from Andrea: I just received this question from a friend – “Would you rather facilitate a PTA meeting around schools reopening in the fall, or do a trust fall into a pit of crocodiles?” The fact that the crocodiles are an appealing option shows how charged this issue is.]

Where does this leave us?

Instead of getting caught in an endless loop of ranting and venting (which is hard), let’s find some positive things we can build on as we begin to navigate virtual student learning in the Fall.

Fortunately, we have some more time to plan than we did in the spring. We can draw on the virtual teaching and learning experiences from the spring and learn from them, because chances are, no matter what our plans are in the fall, we are going to need these best practices in our arsenal until we have a COVID-19 vaccine.

What do we know about virtual learning?

1. Not all virtual learning environments are bad!

Take for example, one of our clients who is helping interns in a summer work program learn essential social and emotional skills necessary for workplace success. These students come from all different backgrounds and are eager to learn. Our client expertly pivoted their course content, creating relevant and timely material that the students are eager to learn. We are working with them to develop a list of best practices to share with other educators in the coming months.

Some research has shown that some children, particularly older children, are thriving in the online environment. Anecdotally, another program that we work with measures the anxiety and depression levels of its teen participants, and their levels of both actually went down after lockdown began.

Online education works best when it is:

  • high quality (obviously)
  • structured, with points for real connection
  • a mix of formats (sorry, but a 7-hour long Zoom meeting is not going to be effective)
  • done with older children & teenagers

2. Teach parents to be co-educators. Parent involvement is even more critical.

Parents in this time know that, even if it is unfair, they have been thrust into the role of co-teacher for their students. To the extent possible, leaning into this can produce benefits that will last long after COVID is over.

One client offers reading tutoring services to at risk students in grades K-2. Although there were many challenges with continuing their program virtually, some tutors reported a strong benefit of having the ability to connect with students’ families in a way that had not been possible before. Parents are able to watch the tutoring sessions and get a better idea of where and how their children are struggling, and are able to learn from the tutors some ways to reach their children.

Schools and organizations can help by:

  • Engaging with parents early in the process
  • Understanding that parents will have different needs and levels of availability
  • Providing materials to teach the parents as well as the students

3. Don’t forget Social Emotional Learning (SEL), and be creative

Virtual learning leaves out the hugs, the high fives, the social and emotional connections and learning students need now more than ever. And who else needs this support? Teachers and other school staff. Andrea recently sat in on a meeting about teacher and student SEL during this time. Some takeaways:

  • SEL makes a meaningful difference for both teachers and students
  • Teachers must fully embrace these concepts before being able to teach them to students
  • Time must be set aside for SEL – it can’t be ‘one more thing’ added to already full plates
  • SEL can fall flat for older children if not approached carefully. Many elementary schools are now teaching SEL skills, and when kids get to middle/high school, they think, “Been there, done that.” When we are teaching SEL skills to our middle and high school students, instead of trying to use the same content aimed at younger children, we need to think of how we’d teach adults SEL concepts and adapt that way.

4. We need a better way to reach students who are disengaged

Raise Your Hand Texas interviewed five Texas teachers about their teaching experiences this Spring. These teachers faced a number of challenges, and hearing their stories is inspiring. The teachers got super creative, conducting zoom dance parties, scavenger hunts, virtual field trips, and more. They show that even in the time of COVID, school can be fun and creative, and that many teachers are doing everything they can think of to engage students.

However – As these teachers described, despite their best efforts, some students just stopped participating. The official tally is about 10% statewide, but we think the ‘real’ number is higher – and it’s not evenly spread across communities. LA, for example, lost about 1/3 of their students in the spring semester [there’s a wonderful NY Times article about this issue] Anecdotally, we’ve seen some organizations talk about losing 1/2, or even 2/3 of their student participants. This is a major issue that cannot be ignored by the local, state and federal governments. If we want true equity in education, districts need a plan now for how to reach out to these families and find and connect them to the resources they need to move forward.

Which students are more likely to drop out?

  • Younger students, particularly in PreK, K, and 1st grade
  • Students from low income families
  • Children with poor internet access
  • Children who do not have an adult in the home who can supervise learning
  • Students with special needs

I can speak to my own experience with younger students. Both of my children (5 and almost 2) were offered short zoom gather times (~30 minutes each) throughout the spring. By the end of my daughter’s meetings, her class of 12 was down to 2-3 participants, as was my son’s. Many parents and children clearly did not feel it was worth it to continue, despite the fact that the meetings were engaging and even involved small, fun crafts. We continued because:

  • it brought a sense of routine to our day
  • it was a nice break for me
  • I had the luxury of a flexible job
  • We had reliable internet
  • We had multiple computers/devices
  • We had resources

And even despite these things, it was sometimes a struggle to make it through one 30-minute zoom meeting daily. Going all virtual this Fall seems like a challenging prospect, to put it mildly.

[Another random note from Andrea: my 4-year old’s Montessori school also did 20 minute virtual meetings daily, and that experience made me thrilled that we can sit out this school year. Good luck, Lindsay, and other parents of kindergarteners.]

What can schools do?

Schools need to gather whatever information they have from the virtual and online learning that happened in the spring as they prepare to help their students in the Fall. Did some teachers try paper packets? Was that helpful or not so much? For all students or some students? What kind of lessons were most engaging? How are students feeling socially and emotionally? How can students connect socially while remaining six feet apart, or on Zoom? How are schools addressing these needs (which likely will be huge in the fall)? What resources do parents need to help engage in their child’s learning?

The best time to get that information would probably have been at the end of the 2019-20 school year, and no doubt many districts did that. But almost all districts were scrambling, and COVID cases started to dwindle at that time, leading to hope we’d be able to operate somewhat normally this fall.

Since that’s not the case, districts and organizations serving students should take time now to conduct parent, teacher, and student focus groups/interviews/surveys and distribute any information about potential pitfalls and/or best practices to their staff members right away. Districts need a plan to involve parents. A plan to support SEL. And most importantly, a plan to reach as many students as possible.

Entering the Evaluation Job Market During a Recession: Advice for Recent Graduates

by Lindsay Lamb

I have been thinking a lot about students graduating lately. Graduating high school, college, graduate school. My daughter is graduating from Pre-K and will start Kindergarten in the fall. I have friends and family with kids graduating high school, excited to celebrate their accomplishments and start off on their adventure. Now, thanks to the pandemic, those dreams have a much different reality. There is no prom, there is no graduation, there is no party to celebrate with friends and family.

As if reading my mind, I was asked to provide recent doctoral graduates with advice they might find helpful as they enter what is sure to be a tough labor market. What could I possibly say to them?

Fortunately (maybe?) I graduated during the 2008-2010 recession. When I first entered the job market, post-doctoral funding was frozen, full-time professor positions were being transitioned into more adjunct faculty positions, the private and public sectors were beginning to enact hiring freezes.

So, back to that advice.

The prompt I got was, Based on your experience in 2008-2010 on the job market:

  1. What strategies or resources helped you get that job offer?

I made connections. I built relationships. I put myself out there and honed some skills. I essentially created my own internship with several educational non-profits in the area. Sure, this didn’t make me money right away, but it paid off big time in the end. This is the only reason why I got my job in AISD.

I was already on the fence about an academic role. With a degree in educational psychology, I wanted to have more of an effect on students, staff, and administrators I was researching. I wanted to make a difference in students’ lives. My experiences during this time reaffirmed my beliefs: I wanted out of academia.

I started contacting educational non-profits in the Austin area to see if they needed help. Surely, I could create a survey, conduct observations, do a quick focus group, anything to help them out. I had a lot of interest, but not any pay. On the plus side, I was still enrolled in graduate school, and was getting paid to be a teaching assistant and was teaching a class at a local university so I could make it work.

Because of this work, I finally got connected with the Director of Research and Evaluation at the Austin Independent School District. Luckily for me, they had a job opening. I spent 10 amazing years there conducting meaningful program evaluations and learning from my colleagues every day.

  1. What was the most challenging aspect of finding a job during the recession?

All of the uncertainty and frustration I faced. Several of the jobs that I applied for suddenly lost funding or were put on a hiring freeze. These unknowns exist today, and unfortunately, there isn’t anything we can do about them, but we can keep applying for jobs, learning new skills, and making new connections. Anything you can do to keep you going one day at a time.

  1. What advice would you share with your younger self and/or graduate students who are just now looking for jobs?

Don’t give up! I know this sounds hokey, but the only way things will not work out is if you stop looking for a job, stop honing your skills, and stop building connections. Find some free (or even not free, but cheap) mini-courses on data visualizations, creating one-pagers, learn R, start a blog! Also remember that you have learned amazing skills during graduate school that can be applied to many fields, not just academic jobs. Businesses are looking for skilled workers who can analyze data, create effective data visualizations, share results in an easy to understand way. If you take a job that is below your skill level, raise it up! Bring in your skills to show that you can do more and be more, maybe you can create an opportunity for yourself by showing all of your skills.

I know this is a challenging time, but we are all in this together. As cliché as it sounds, I truly believe things will work out one way or another. It might not be exactly what you had planned, but it is how we deal with setbacks and adversity that define use. These experiences force us to look inward and grow, and In the end, I truly believe that we will come out stronger than we were before.

Good luck!

Teaching your kids about data

by Lindsay Lamb

Recently, I read a great article in the New York Times, Turn Your Demanding Child Into a Productive Co-Worker. As mentioned in an earlier blog post, I have taken on a majority of childcare responsibilities for my two children during the pandemic. Needless to say, the first few sentences of Michaeleen Doucleff’s article resonated with me: “At 10 a.m. on a Tuesday morning, I lock myself in our bedroom, slide down the back of the door and begin to cry. “But Mama, but Mama,” my 4-year-old daughter screams from the hallway.”

I found a kindred spirit. I had to read on.

After venting about her current situation (which we all need to do, regardless of whether or not we have young children to look over right now), Doucleff went on to describe how in her work she has observed families from cooperative cultures sharing work with children. She suggested that we stop endlessly entertaining our children (which is exhausting), and instead show them our work and share in the process with them.

Easier said than done.

How could I share my work with my kids?

I could teach Hannah (who is 5) to sit calmly next to me and “work,” but I seriously doubt I could get my destructive Godzilla-esque 20-moth old to sit calmly while I write without him a) destroying my computer, b) destroying whatever Hannah was working on, or c) injuring himself.

After pondering a bit, I came up with an idea that would both use data and get the kids outside.

Me: “Hey Hannah, do you want to do a data gathering nature walk? At the end we can make a graph and show Daddy what we found!”

Hannah: “YES!!!”

Hayes: “Mama!!! Outside, outside!!!”

Hannah and I discussed what we would search for on our nature walk. I explained that we would count how many of each thing we saw during our walk and use that information, or data, to make a picture.

Me: “What things do you think we might see on our nature walk?”

Hannah: “Rabbits!”

Me: “That would be really cool if we saw a rabbit! What is something that you know we will see just in case we don’t see a rabbit?”

Hannah: “Birds, maybe a cardinal, and squirrels! Oh, and a blue jay.”

Me: “What would Hayes like to see?”

Hannah and I: “TRAINS!”

Me: “Yes, let’s add trains.”

Hannah: “And butterflies.”

I loaded up the kids in the double-wide stroller, and gathered crayons, a notebook, an envelope in which to carry the crayons and notebook, and snacks (you always need snacks). Ten hours later (well, maybe 20 minutes), we hit the trail for our fun-filled adventure. Since the weather was nice, I decided to run. Because I felt like a pack mule, I was more than happy to stop whenever Hannah excitedly screamed that she saw something from her list.

Like any good scientist conducting an observational field study, Hannah added some animals to her list based on what we saw during our run (and what she wanted me to run by). For example, we saw a parrot fly by, so we added parrot to the list. She also realized that she forgot to add cats, so we added cats. Then she wanted to go by the house with goats in our neighborhood, so we added goats to the list.

To keep a record of what she saw, she created a list of each animal (or train or butterfly) and added a check (also in a box) next to each animal. This way she could not only keep track of what she saw, but also how many of each animal (or train or butterfly) she saw during our walk. Here is her completed check list:

Hannah’s completed nature walk check list.

In case you can’t read her handwriting (though I did help her a bit), we searched for rabbits, cardinals, squirrels, butterflies, trains, blue jays, cats, parrots, and goats.

Hannah had so much fun seeing each item and adding a check box to her list. It turned our daily run on the same streets into a new adventure. We saw things we had never seen before and took the time to really explore our neighborhood.

When we got home, she couldn’t wait to make a graph. She ran upstairs and grabbed some construction paper, crayons, markers, and tape.

We sat down at the dining table and got to work. I got out some paper and showed her what a graph of the data we collected could look like. I explained that you can show data in lots of different ways. In the end, she wanted me to make two different bar graphs. She used one graph that I created and gave the other one to Hayes.

I said that a lot of times I use different colors to indicate that it represents a different category of something. With our data, a different color would represent a different animal (or train or butterfly). She started coloring the bars using a color that represented each animal we saw. We added numbers to the bars so you could easily see how many of each animal we saw. Then she decided to draw a picture of each animal next to each bar. This was music to my ears! We have a data viz pro on our hands!

Hannah working on her graph book.

Me: “What did we see the most of?”

Hayes: “Pink! Pink marker!”

Hannah: “Squirrels
 and butterflies! I wish we would have seen a rabbit.”

Me: “I know, and maybe next time we will! Hannah, I love your graph. Did you know that graphs have a title, like the title of a book? What do you think the title of your graph should be?”

Hannah: “Today I saw a lot of things in nature, but I didn’t see any rabbits.”

In the end, she made a pretty great one-pager


Hannah’s one-pager
Okay, Hannah’s graph book 🙂

Hayes’ creation could use a little help, but he had fun creating it (and seeing TWO TRAINS!) and that is all that matters.

Hayes’ graph.

For me, the best part about our data nature walk was talking – albeit abstractly – about what I do in my job and sharing in that experience with my daughter. Maybe it wasn’t exactly what Michaeleen Doucleff had in mind when she wrote her article, but it got us through another day and we all had fun.

We could all use a little social and emotional learning these days

By Lindsay Lamb



During these trying times, I have been calling on skills I learned in my previous role as the program evaluation coordinator of social and emotional learning in the Austin Independent School District (AISD). Sometimes I need help, sometimes my kids need help, sometimes my husband needs help, sometimes a friend needs help
 sometimes we ALL need help.

As is the case with all of us, these days have been an emotional roller coaster. Some days are great, and some days are not so great.

I take on most of the childcare duties for my 5-year-old and 20-month-old and one thing that has helped me is establishing a routine for each day. We weave in zoom meetings for my two children’s gather times, dance classes, and a children’s time at our church. None of that includes my work! Finding time for phone calls or Zoom meetings outside these limited hours is difficult, but I make it work sometimes requiring a muted call, blocked video, or both. My only alone time is working early in the morning before the family is awake so I can have some solid uninterrupted work time (and sometimes, like today, that only lasts until 6:30 because both kids decide to get up early). I work during nap/quiet time depending on how long the baby naps – sometimes 45 minutes, sometimes 3 hours. Sometimes I still need to finish up something after the kids go to bed at night. This all makes for very long days for me without any breaks. Why do I do this? So that I can continue finding meaning and purpose in my life. Otherwise, everything in my day will be consumed by caring for others and Covid-19.

Generally, I am doing okay, but there are definitely moments when I am at my wits end, when I need to remember to breathe, when I need to take some time for myself (even if it is just to take a shower!). I am not saying this to make you feel bad for me, there are many people in a much worse situation, and things will probably get worse for all of us before they get better. I have it pretty good, all things considered. We are all together, we are all healthy, and we all have a job (except for the kids and dog, but they are off the hook). That isn’t to say that I am not dealing with an unanticipated life change, job security issues, or family stress. This is a time of great anxiety for all of us, regardless of race, class, or gender.

So how do I handle this and try and keep calm? If I’m being honest, many days I don’t! Some days, I have a meltdown. Some days, it is just too much. Some days I am just okay, and all of this is okay. What I do have are skills, tricks, and activities that I have learned from the wonderful AISD SEL team to help keep me grounded (also, check out these resources from CASEL, Panorama and the American Evaluation Association).

Cool tip: All SEL-related activities and tools for kids can be used by adults. Do what works for you! Look over my list and see what speaks to you.

Breathe. I know this sounds silly but breathing helps
 a lot. Find an app and take a mindful moment if you can. Even if it is just for 2 minutes. Some apps have great meditations for kids and adults (like Calm, GoNoodle, or Mind Yeti) which can be helpful for the entire family. Do yoga with your dog, cat, or family! Do whatever you need to do to find some inner peace – if only for a few moments. AEA even offers meditation practices.

Go outside. See the beauty in nature. Walk, run, ride your bike and take a break from the media. Think of things bigger than yourself. [Andrea’s note: And, bonus, Vitamin-D is an important protector against COVID-19.]

Practice self-compassion. Talk about how you are feeling. Call a loved one, a friend, a family member, a colleague, anyone. We are all in this together, and chances are someone else is probably experiencing what you are experiencing and feeling what you are feeling. If you can’t talk to someone on the phone/FaceTime/email, write a letter to yourself as though you were a friend or loved one. What would you say? Treat yourself with the loving kindness with which your friend would treat you.

Get creative! Make something. Bake, cook, build, make or listen to music, create art. Creating something gives us a sense of purpose. Coloring is often meditative and therapeutic. Take some time and color – inside or outside the lines! This can also help if you are out of work or are no longer finding meaning in your work. We all are doers and want to feel like we are contributing, and sometimes that means baking cookies.

Take a break. Sometimes we just need to take a break. Those emails can wait. Ask your partner to watch the kids for a couple minutes. Reschedule a phone call. Take some time for you. Doing so will help you will return to your work, family, or friends in a better place than where you were when you left them. Sometimes this can even mean taking time to be a parent! Stop and look at trains with your kids, go on a scavenger hunt, play baseball, fly a kite. Do whatever you need to do to be present in the moment with them. They will appreciate it, and so will you.

Reflect. Take some time to write down your feelings. It is easy to get caught up in the negative stories and all of the uncertainty right now. Start a gratitude journal and think of positive things to counterbalance the negativity.

If you are experiencing severe anxiety or depression, reach out for help. Most therapists are offering telemedicine, so please do not isolate yourself. Contact 1-800-950-NAMI (6264). Or visit https://www.nami.org/Find-Support/NAMI-HelpLine

What other tips do you have? Let us know and we’ll add them to our list!

One final note, since a majority of us are working from home, the days can begin to bleed together. Do things to distinguish the days from each other. At our house, we have family movie night on Friday which we all look forward to. My daughter has dance on Saturday, and we do a “church” of sorts with my parents on Sunday. Find a routine and keep to it. Find things to look forward to, like movie night. Stay engaged with others in your family and community. This is hard, and will likely get harder for all of us as the weeks progress, but together, we can get through this.