Category Archives: Uncategorized

What are we building? And under what assumptions?

Here’s what I said to a group of doctoral students, the incoming president of SoLAR, and a handful of other researchers and practitioners at the Learning Analytics and Knowledge Conference:
Untitled presentation.jpg
picture of a staircase that is underwater
In the 1970’s a philosopher named Hubert Dreyfus began criticizing some of his colleagues at MIT who were working on early versions of Artificial Intelligence- folks like Marvin Minsky and Seymour Papert. In his seminal “What Computers Can’t Do” Dreyfus challenged what he called biological, psychological, and epistemological assumptions- basically any a priori claim about human consciousness and being-in-the-world. Dreyfus challenged a popular conception of the mind as functioning like a computer, that humans are rational agents in rule-bound systems, and the self-rationalizing ouroboros of instrumentalism.
Ultimately, what he was challenging was a scientific way of thinking about people and the world that was largely formed during the enlightenment, but that was explicitly applied to human behavior by folks like Edward Thorndike, and later B.F. Skinner.
It is important to question the claims and ideologies present in any discourse, as a closer interrogation might reveal internal contradictions as well as broader social and structural forces. Specifically the method of Immanent Critique seeks to probe into discursive claims and how they relate or conflict with other discourses.
Now, I’m not trying to start a philosophical argument. Oh wait, yes I am.
I am researching the discourses (texts, media, and other representations) of learning analytics and how they interplay with the discourses related to the purpose of higher education.
When learning analytics claim that they will provide insight into the learning process, I tend to go, “huh, what is the definition of ‘learning process?'”
When higher education discourses say they will advance knowledge creation, I wonder how that jives with adaptive learning language that will make the acquisition of knowledge more efficient. Especially in that latter statement I wonder if efficiency is necessarily a good thing when it comes to learning, or if it might represent broader economic motivations.
What I like about immanent critique is it’s subtlety. It is not intended to replace claims or value judgements with alternative facts, but it is a method of interrogation and exposure. It makes me think of Matlock: “I’m just a small town country lawyer just trying to discover the truth.”
Using a more theoretical discourse analysis is also useful in analyzing meaning both in terms of local or semantic concepts but also in terms of the structural or paradigmatic concepts.
The goal of learning analytics are to predict the likelihood of success or failure and to turn insight into action. The phases of learning analytics are describe, diagnose, predict and prescribe. IBM is already floating trial balloons about how cognitive computing can predict a child’s “learning styles” and career predilections (they call it learning styles- a term that makes education scholars cringe) and custom tailor a personalized, individualized learning pathway from kindergarten to career! Mo Rocca does the voiceover in the YouTube video, though uncredited. I swear it’s Mo Rocca.
Knewton has a video that describes how to increase or decrease the level of student agency.  . .
It may be problematic to leave assumptions unexamined, especially those that are validated by their own logic system.
The assumption that people are rational agents within formal structures who simply need to be nudged and prodded toward correct actions. Each of these concepts needs to be unpacked.
Not to sound like an alarmist that we’re heading towards some Orwellian or dystopian future, but language matters- it influences our beliefs and social practices. Language represents power and motivation. I don’t have some maxim or platitude to offer here; and, maybe I’m slow, but I’m just hanging out here at the “describe” stage. And rather than confidently diving into the “what” or the “how” of learning and education, I’m still wondering about the “why.”
Gert Biesta in his book “Good Education in an Age of Measurement” challenges notions such as learning outcomes and evidence based practices, as these things are not devoid of power structures.
Suggesting a critical orientation, Biesta proposes freedom as a goal of education:
we should not think of freedom as sovereignty, that is, of freedom as just doing what you want to do [but] rather. . . a ‘difficult’ notion of freedom, one where my freedom to act, that is, to bring my beginnings into the world, is always connected with the freedom of others to take initiative, to bring their beginnings into the world as well so that the impossibility to remain ‘unique masters’ of what we do is the very condition under which our beginnings can come into the world.
Now I have to admit, framing my research from this critical or philosophical orientation has caused me some ambivalence. I’m an IT administrator- a true blue technocrat. I keep systems running and we measure success by numbers of users. I think it has also broadened my perspective to really think like a humanist, and ponder the ineffable qualities of being human.
I grew up in a very small town in northern Wisconsin. We lived in a hand-built log cabin. For a while we didn’t have electricity or plumbing.
My dad was a high school dropout but later earned a college degree.
I’m part Native American but I check the box for white because that’s how I identify.
By high school I took a career inventory test that said I should become a puppeteer. My GPA took a nosedive but I got several scholarships because of my involvement in clubs and organizations.
It took me six years to earn my bachelor’s degree- I changed majors four times from Business, to undeclared, to Philosophy to English, I failed math three times. I took a bunch of music credits after a jazz instructor who saw me drum once asked if I would be the drummer for the college jazz band. I meandered through my undergraduate experience. I changed my mind. I questioned my own motives and identity.
Many university mission statements talk about personal exploration, creativity, freedom, exposure to a broad range of subjects, and critical thinking.
I breezed through a Master’s degree in Educational Technology.
Charles Eliot, the former president of Harvard talked about the idea of “liberalization before professionalization” as he was proposing a new requirement for students to go through a traditional undergraduate experience in the liberal arts tradition before going on to a professional degree track.
I have no regrets about my education– its errancies or pace
I’m not sure what Learning Analytics interventions would have been applied to me or how they would have altered my life. I did not stay on track nor did I finish on time. I left and came back. Now I’m earning a doctorate and taking longer than I had planned, but don’t really feel too bad about it.
I have no regrets about my education– its errancies or pace.
That being said, my wife uses data to reach out to first generation and minority students to engage them in mentorship programs and other support services. I use data to understand tool adoption and trends to target our training interventions and messaging.
I think about dualisms and strive for synthesis.

APT App

We live in an age of data, and–for good or ill– this data may be used for us and by us, or, it may be used by other agencies to influence our behavior. This latter assumption sounds somewhat dystopian, but it is the very model that is increasingly used by both corporations (e.g., targeted ads) and government agencies alike (and partnerships between the two).

In education, “big data” promises to have big potential in improving learning efficacy through adaptive and personalized tools. Yet, students are rarely privy to the algorithms or data points that are employed to improve learning.

I have a neat app that was included on my phone called “S Health.” It tracks my daily steps, it can monitor my heart rate, and it includes tips and advice about how to be more healthy. The nice thing about this app is that I know exactly what data it is tracking, and I have full control over my settings. If I want to start tracking calories and meals, I set the parameters and goals. There is a host of settings at my disposal, but the value that the application adds is a dashboard interface, achievement badges, reminders and notifications, and positive kudos and encouragement (one screen always has the phrase “be more active” at the top).

screenshot of S Health

As I think about academic data, and how students might use it for their benefit, I often consider my S Health app and how learning goals can be just as much about the habits and processes as it is about outcomes and summative measures. In fact, I would argue that the value of learning should be more about habits and processes than about summative data. And, students should not only have access to the formulas and metrics that institutions collect about them, but students should also have control over how these data might be interpreted or displayed to help learning.

This has inspired me to explore the creation of a software application that is modeled after a fitness or health app. The APT (Academic Personal Trainer) app will empower students to set goals, monitor academic progress, and focus on the behaviors and approaches that are conducive to intellectual development.

20150925_155158

I brainstormed a cursory map of inputs, throughputs, and outputs. Institutions collect a variety of demographic data on students. These data can potentially be correlated with academic performance metrics to elucidate the messages, reminders, tips, and interventions that may be most helpful for student success. Some key principles that will underpin the development of this app are as follows:

  • The data that is used will be available to students
  • The structure and strategy of outputs and interventions will be transparent and modifiable to students
  • Positive encouragement is better than negative, “you’re ‘at risk'” type messaging
  • Continuous, iterative research and development (i.e., agile/kanban methodology) will be employed to improve the effectiveness of the application

SPOC Lobster

The MOOC people have heralded “SPOC’s” as the new innovation– the “plateau of productivity” on their hype cycle that peaked (inflated expectations) in 2012. Funny thing is, educators have been doing SPOC’s for decades already- they’ve just been calling them online and blended courses.

As my plane landed at Boston Logan airport and taxied toward the jetway, the B-52’s song, Rock Lobster came on my mp3 player. It reminded me that lobsters were once considered trash food.

Poor people, servants, and prisoners ate lobster in the early years of our country. The odd creatures were edible but not delectable; they were largely ignored by the wealthy. As the railway infrastructure grew in the mid to late 1800’s travelers to and from the northeast would sometimes be served lobster. Many of the passengers from the Midwest found lobster to be exotic and quite tasty. Eventually, due to food rations during World War II, lobster became a more popular dish among all classes of citizens. New preparation methods were experimented with to enhance the flavor of lobster. By the 1950’s, lobster had earned its place as an upscale, gourmet food.

“We were at the beach, everybody had matching towels”

I attended the open EdX conference at Wellesley College, just outside of Boston. Many of the attendees at this conference seemed to be programmers and developers from top-tier colleges and universities; and it seemed an equal number of attendees were CEO’s of small startups or independent consultants who provided technical services and support

* * *

Distance learning has been around for a very long time. Video-based instruction was used to train U.S. troops during World War II. Video conferencing, digital content, and eventually web-based instruction has demonstrated the ways in which distance education has evolved in parallel with evolving technologies.

Providing distance education has not only been a means for public institutions to offer degrees to new and underserved populations like adults who wanted to improve their employability, but it has also been a strategy for public institutions to increase revenue during times of declining high school graduation rates and economic recessions.

“Lots of trouble, lots of bubble”

For-profit institutions like the University of Phoenix, Kaplan, and Devry also recognized the potential of reaching new customers with online delivery- they were hugely profitable for a while, but criticisms of quality and shady financial practices, as well as competition from new entrants in the online space, have largely tempered their growth.

* * *

EdX is considered a MOOC platform. MOOC stands for Massive, Open, Online, Course. The term rose to popularity in (but existed prior to) 2012 when Stanford’s Sebastian Thrun decided to make his Artificial Intelligence course publicly open to online participants. Over 100,000 participants signed up. Thrun later launched the MOOC platform, Udacity. Around the same time, MIT launched “MITx,” a natural progression from its Open Courseware experiment (taking online content from MIT courses and making it freely available to the public).  This marked the beginning of what have been called “xMOOCs” (which also include Coursera).

In contrast, “cMOOC’s” (the “c” stands for “Connectivism”) predated xMOOC’s by a few years, as Canadian researchers George Siemens and Stephen Downes created online experiences around their Connectivist learning theory.  Proponents of cMOOC’s have criticized xMOOC’s because of the latter’s didactic, video-centered, low-on-Bloom’s-taxonomy, content-delivery format as opposed to the more constructivist participatory experiences embraced by cMOOC’s.

Eventually, MIT partnered with Harvard (and later Berkeley and countless others) to launch the EdX consortium. Shortly thereafter, they released the code to their platform (as “open EdX”).

“Somebody went under a dock, and there they saw a rock, it wasn’t a rock, it was a rock lobster!”

As is wont to occur, the “traditional” LMS providers began offering their own MOOC platforms. As this technology is all relatively new, many institutions have become “early adopters” of MOOC’s (mostly of the xMOOC variety) and their platforms in various forms and initiatives. Some of these experiments have failed, as in UC San Jose’s partnership with Udacity, while others have yielded interesting research results. Thus far, generalizations about success or ROI are hard to quantify (especially with the amount of capital that has been funneled into these initiatives).

It’s really interesting that EdX chose a much different path than its competition, namely, Udacity and Coursera. While the latter two sought to monetize, scale, and attract VC funding as quickly as possible, Agarwal chose instead to make EdX a non-profit and to open source the platform. This really sets EdX aside in terms of philosophical orientation.

The other thing that is interesting is that while it is very LMS-like, it was developed in the 2010’s, not the 1990’s or even the early or mid-2000’s. That means their strategic priorities were scalable architecture, minimalistic UI, and a focus on analytics. Add to that the active open source development community and central governance to ensure quality and versioning, and it is a potentially robust platform that can be customized with branding and bolt-ons without all the messiness of them trying to add random bloatware functionality to the core platform for many different customers. Hopefully, that continues to be true.

“Rock lobster!”

What should we measure?

My four-year-old is learning how to write. There is some concern at his preschool that this is not happening fast enough. My first reaction to this concern was one of dismay. Then I realized the complexity of the situation. For one, there is not much modeling happening at home. His mother and I are both highly educated, his sister is high-achieving and academically advanced, and we all spend a lot of time reading and writing, but these activities are performed on glowing electronic rectangles, not with pencils and paper. I wonder if we should be skipping the handwriting and teaching my son how to type (he’s already quite adept at touch screens, on multiple OS’ even- is that important? or measurable?).

I don’t want this to come across as hyperbolic tech evangelism (“books will become obsolete; therefore, ipads for all toddlers!”), nor do I want it to be neo-luddite dismissal (“no glowing rectangles allowed in my home; because they rot your brain!”). And this is certainly not an indictment of my son’s preschool (they’re great). But I wonder if there are different ways to approach measurement and development?

Right now it seems like the unwritten rules of educational institutions are designed to be self-reinforcing:

  • There are right ways to do things and right ways to know things
  • The use of technology shall be strictly monitored and controlled to prevent disruptive or distracted behavior
  • What worked for previous generations works for current generations
  • The memorization of words and symbols shall be the primary objective of most learning activities
  • The categorization of individuals into year-based grades is too entrenched to reconsider
  • The categorization of learning into disciplinary subjects is too entrenched to reconsider
  • Uniformity is equitable
  • Everyone functions in a scheduled, structured environment
  • Introversion is a disorder

I don’t have a fully-developed alternative model, but off the top of my head there are some additional assumptions that could be applied to the incumbent conventions of educational institutions, much like creative commons licenses are layered on top of traditional copyright to reimagine the concepts of ownership. Here’s what a sort of creative commons bolt-on set of rules for education might look like:

  • Behavior and learning should not be conflated
  • Students should have opportunities to demonstrate and to teach each other things they are good at
  • Our bodies and moods have lots to communicate; our environments should be accommodating by providing some freedom and flexibility (e.g., be alone or quiet if we feel like it; not eat if we’re not hungry, etc.)
  • Positive encouragement is good but should not be confused with rewarding apathy or inactivity (which is bad)
  • Creativity should be encouraged
  • Things have a tendency to resolve themselves naturally
  • Anything can be interesting
  • Passion and love are contagious

I know my son will learn how to write. And he will be great at it, if he wants to be.