Category: Skills

  • 7 key questions when designing a learning system

    7 key questions when designing a learning system

    In the design of a learning system for humanitarians, the following questions should be given careful consideration:

    1. Does each component of the system foster cross-cutting analysis and critical thinking competencies that are key to humanitarian leadership?
    2. Is the curriculum standardized across all components, with shared learning objectives and a common competency framework?
    3. Is the curriculum modular so that components may be tailored to focus on context-specific performance gaps?
    4. Does the system provide experiential learning (through scenario-based simulations) and foster collaboration (through social, peer-to-peer knowledge co-construction) in addition to knowledge transmission (instruction)?
    5. How are learning and performance outcomes evaluated?
    6. Are synergies between components of the learning system leveraged to minimized costs?
    7. Have the costs over time been correctly calculated by estimating both development and delivery costs?

    These questions emerged from the development of a learning system for market assessment last year, thinking through how to use learning innovation to achieve efficiency and effectiveness despite limited resources.

    Photo: The Infinity Room (The House on the Rock) (Justin Kern/Flickr)

  • Soufrière

    Soufrière

    “What I like,” whispered my dinner companion, “is that these publishing types have survived the fire of digital transformation, emerging out of the boiling pits of disruption, and all of that. Some were dismembered before, during, and after – acquired and merged, sold and resold. All paid a terrible price, but bear their bruises and scars proudly. They are not only smart but also scrappy, battle-seasoned veterans whose eyes still gleam with the thick knowledge that they produce. The culture (and, yes, the economy) that sustains their work is very much alive, circulating in networks that don’t care whether they are made of silicon or white matter. Blood, sweat and tears, man! And, yes, most if not all are showing a profit!” And then, like a drop of sulfuric acid on the rusty metal plate separating ‘education’ from ‘publishing’ in our fragmented knowledge universe: “Beats babbling on about 70-20-10, eh?” Indeed.

    Photo: Climbing La Soufrière in Saint Vincent (Ian Usher/Flickr).

  • Thick knowledge

    Thick knowledge

    Toby Mundy on books as thick knowledge:

    “[…] Books have a unique place in our civilisation […] because they are the only medium for thick descriptions of the world that human beings possess. By ‘thick’ description, I mean an extended, detailed, evidence-based, written interpretation of a subject. If you want to write a feature or blog or wikipedia entry, be it about the origins of the first world war; the authoritarian turn in Russia; or the causes and effects of the 2008 financial crisis, in the end you will have to refer to a book. Or at least refer to other people who have referred to books. Even the best magazine pieces and TV documentaries — and the best of these are very good indeed — are only puddle-deep compared with the thick descriptions laid out in books. They are ‘thin’ descriptions and the creators and authors of them will have referred extensively to books to produce their work.”

    I’ve found myself going back to searching for well-written, comprehensive, in-depth books for sourcing both foundational and most-current knowledge. This notion of ‘thick knowledge’ makes a lot of sense.

    Photo: Rainbow (Katey/flickr).

  • Unified Knowledge Universe

    Unified Knowledge Universe

    “Knowledge is the economy. What used to be the means has today become the end. Knowledge is a river, not a reservoir. A process, not a product. It’s the pipes that matter, because learning is in the network.” – George Siemens  in Knowing Knowledge (2006)

    Harnessing the proliferation of knowledge systems and the rapid pace of technological change is a key problem for 21st century organizations. When knowledge is more of a deluge than a trickle, old command-control methods of creating, controlling, and distributing knowledge encased in a container view do little to crack how we can tame this flood. How do you scaffold continual improvement in learning and knowledge production to maximize depth, dissemination and impact? A new approach is needed to apply multiple lenses to a specific organizational context.

    What the organization wants to enable, improve and accelerate:

    1. Give decision makers instant, ubiquitous and predictive access to all the knowledge in its universe – and connect it to everywhere.
    2. Rapidly curate, collate and circulate most-current content as a publication (print on demand, ebooks, etc.) when it is thick knowledge, and for everything else as a set of web pages (micro-site or blog), or individual, granular bits of content suitable for embed anywhere.
    3. Accelerate co-construction of new, most-current knowledge using peer review to deliver high-quality case studies, strategies, implementation plans, etc.

    How do you crack this? Here are some of the steps:

    1. Benchmark existing knowledge production workflows and identify bottlenecks, using multiple lenses and mixed methods.
    2. In the short term, fix publishing bottlenecks by improving existing systems (software) and performance support (people).
    3. In the longer view, adopt a total quality management (TQM) approach to build ‘scaffolding’ and ‘pipes’ that maximize production, capture, flow, and impact of high-quality, most-current knowledge production, with everything replicated in a centralized, unstructured repository.

    Multiple lenses are needed as no single way of seeing can unravel the complexity of knowledge flows:

    • The lens of complexity: Systems thinking recognizes that we do not need a full understanding of the constituent objects in order to benchmark, analyze, or make decisions to improve processes, outcomes, and quality.
    • The lens of learning: Learning theory provides the framework to map knowledge flows beyond production to dissemination to impact. The co-construction of knowledge provides a ‘deeper’, less fleeting perspective than conventional social media approaches. More pragmatically, a number of tools from learning and development and education research can be used to benchmark.
    • The lens of talent: Staff lose precious time and experience frustration due to duplication of effort, repetitive tasks, and anxiety due to the risk of errors. They may feel overwhelmed by the complexity and intricacies of multiple systems, as well as by the requirement to learn and adapt to each one. Informal learning communities can bring together in the workflow to identify potential, develop competencies, and drive performance. Hiring, on boarding and handover can be used to identify gaps and improve fitness for purpose.
    • The lens of culture: Determinants of quality through print-centric publishing processes are grounded in a rich cultural legacy, for example. Other specialists (IT, comms, etc.) also have their own, overlapping universes. Correct analysis of these and how they interact is indispensable.
    • The lens of total quality management (TQM): This lens includes quality development, business process improvement (BPI), and risk management. It can help both in the initial diagnosis (process maps) and in designing systems and procedures for continual improvement.
    • The lens of IT: Information technology management includes both agile methods as well as traditional requirements-and-specifications. Although such approaches on their own are unlikely to achieve the desired outcomes, their familiarity may facilitate acceptance and usage of the other lenses.

    The remaining pieces of the puzzle involve standards, mixed methods, and deliverables.

    Unified Knowledge Universe
    Unified Knowledge Universe

    Photo: Lenses rainbow (csaveanu/flickr).

  • Practicum

    Practicum

    Individually, team members continually learn in their respective area of work, by both formal and informal means. Most learning today happens by accretion, as a continual, networked (‘know-where’), and embedded process. However, occasions to share and reflect on best practice are rare, and may be felt to be interruptions or distractions from the ‘real work’ in one’s silo. Furthermore, online learning events (“webinars”) tend to be long (one hour is typical), require professionals to take “time out” from their work in order to learn, and do not provide the necessary linkage between knowledge acquired and its application to work (the “applicability problem”).

    To further continual learning, the practicum offers a 15-minute online presentation from a global thought leader on a topic directly relevant to the business. Participants are invited to watch the presentation together, and to stay together for face-to-face discussion (beyond 15 minutes) to determine practical ways in which the concepts and ideas may be applied (collaborative, collective, and creative) through facilitated discussion. This provides the opportunity to learn with respect to real challenges rather than from generic content and cases, reducing the tensions and tradeoffs felt when having to choose between attending a learning program and getting the work done. The recording of each presentation will be made available one week after the live event (captured and codified), adding incentive to participate in the live event.

    Presenters will share a short list of key resources and links so that participants may independently investigate the topic and its application to their context, encouraging needs-based learning (“acquisition”) and learning as cognition and reflection (“emergence”).

  • Convergence and cross-fertilisation between publishing and learning: an interview with Toby Green and Reda Sadki

    Convergence and cross-fertilisation between publishing and learning: an interview with Toby Green and Reda Sadki

    By John Helmer

    We’re in a world where people don’t really understand what they want until you put it in front of them,’ says Toby Green Head of Publishing at OECD. He’s talking about the challenge of creating new digital products in a technology landscape that is changing very quickly (with no end to the ‘technology treadmill’ in sight) and where market research is of limited value; where what happened in the past in educational publishing is a poor guide to what will happen in the future.

    This reflection comes from looking at OECD’s markets, which span both higher education and the workplace, and a remit that embraces not only information dissemination but, to a degree, instruction. We’re talking convergence.

    Toby Green will chair the plenary session on ‘Cross-fertilisation’ at the ALPSP International Conference. The convergence of the education and workplace learning markets is likely to be a theme for this session, so we took the opportunity to convene a three-way discussion involving Reda Sadki, a learning innovation strategist who is working with OECD on precisely this area.

    We discussed drivers for convergence, some of its effects, and also opportunities and threats for publishers.

    Moving beyond a dissemination mindset

    Reda’s vantage point on this phenomenon of convergence is informed by his time at the International Federation of Red Cross and Red Crescent Societies (the IFRC), where he pivoted from managing publishing to ‘learning systems’. The IFRC, he says, was an organization that published massive amounts of information (750 information products, 12 million printed pages in 2009), with “little measurable impact”. ‘Ultimately I came to the realisation that the value in what was being published by the world’s largest humanitarian network could be found in the instructional and training materials, with a global audience of 17 million Red Cross and Red Crescent volunteers. Where you could find impact was in the publications that teach people in a humanitarian emergency how to do very basic things such as putting up a tent and providing first aid care.’

    He characterises the transition this realisation prompted as being from a concern over maximising dissemination – counting eyeballs and downloads – to looking at a deeper kind of impact in terms of what was happening behind the eyeballs. It is a shift that he implies publishers need to make themselves if they are to capitalise on the opportunities offered by this convergence.

    Drivers of convergence

    Reda sees two fundamental shifts driving convergence.

    One is about changes in the economy of effort to do certain things. Publishing starts with dissemination and under the traditional model would tend to stop at that. It doesn’t necessary look at look at what people are doing with what it disseminates – largely because, pre-internet, it would have been uneconomic to do so. Technology has lowered the cost of, for instance, collecting rich data about what people are doing with a particular piece of knowledge.

    The other is about the changing nature of knowledge itself. The book gave us a ‘container’ view of knowledge, where now – with knowledge flows getting faster all the time – it looks more like a process than a product. Attempts to capture and compartmentalise knowledge are doomed to fail, in his view, as they do not provide the answers that we need to be able to provide it in any useful way. Being an expert today is much more about knowing where and knowing how than it is about the individual accumulating large amounts of knowledge.

    Echoing Reda’s first point, but framing it in a perhaps broader context, Toby sees the appearance of new possibilities for action with the advent of digital as the decisive factor. ‘If you think of the offline world, on both the publishing side and the education/training side, there were some natural constraints to what you could do …’

    The book (or textbook, or journal) was bound. It had a finite number of pages and could be shipped to only so many people. The classroom could only have a finite number of people in it, and was very difficult to scale without massive expense in both infrastructure and people (i.e. teachers). Online removes a lot of those scaling constraints; so a class that could previously only reach 30 people can now reach hundreds of thousands.

    Online has also massively lowered the cost of updating published information. A new print edition of a textbook, for example, is a major undertaking. In the offline world updates to knowledge would happen in batches, because it wasn’t feasible to do it in any other way. Online allows you to have a rolling update – giving us the concept of a living book – or, equally, a course that is constantly being tweaked and kept up to date.

    These changes allow new ways of thinking. There are significant changes to the old paradigms – but they are changes that a lot of people are still trying to get used to, both on the education side and on the publishing side.

    One area that publishing has been very successful in, Toby feels is integrating technology with content, and he gave several examples of workflow tools such as Mendeley that bear this out, and the work of other players in the wider information industry such as Bloomberg and Reuters.

    However going beyond these essentially resource-based models and becoming more instrumental in the process of learning is another matter, and considering this led us to look at the different cultures these converging (or colliding) industries have.

    Culture and authority

    One of the most beautiful things about publishing, in Reda’s view, is the way in which culture, in both the specific and the wider senses of that word, is embedded in its fabric. This gives a different feel for the value of the content, and its importance in terms of the emotional relationship we have with works of the mind and aspects such as cultural diversity in what is published. While e-learning taps into a rich history of learning theories and education, it still has something to learn, he feels, from the culture of publishing in this respect.

    Knowledge management, by contrast – which he feels to have failed – seems obsessed with putting pieces of data into pigeonholes, without proper regards to the more important activity of building a culture to make sense of the vast amounts of information and data that organisations receive and generate.

    From the publishing side, Toby observed that the linkage of education and training has always been weak. Textbook sales were seen as by-product of publishing activity, where existing titles were picked up on by educators – or else the preserve of a highly specialised branch of publishing that knew how to do them.

    Now, with the collapse of barriers that limited thinking in the offline world, and with digital reducing costs and lowering barriers to entry, the idea of publishers working with partners to adapt their content to create courses is far more achievable. And here is a further cultural change: the idea of working with partners. ‘Before, companies did everything themselves; they didn’t really use networks of freelancers and partners in the way we do now’.

    My own reflection on the different cultures, having worked in e-learning and digital publishing, is that there is less concern about provenance of knowledge on the training side of the fence. Academic publishing has a culture of sources, citation and reference that is currently in the process of automating in a characteristically rigorous way (CrossRef, ORCID, etc.). In e-learning, on the other hand, where content is often produced using an organisation’s internal SME knowledge, individual authorship tends to be more submerged, and it is often possible to wonder: where is this point of view coming from; who is telling me this?

    As somebody who works for a ‘who’ (the OECD) Toby can’t help but believe that at the point of convergence, this difference offers an opportunity for organisations like his own whose content carries the stamp of accepted and established authority in their particular field. This could also apply to the learned societies, but doesn’t necessarily hold true for larger, more generalist commercial publishers.

    Effects of convergence, chilling and otherwise

    Given the way that internet power laws operate in any online space – tending to favour one or a very few brands and condemn everyone else to place on the ‘long tail’, these questions of identity and authority are critical online. Certainly their effects have been seen in the case of MOOCs.

    Arguably, it is the presence of educational ‘super-brands’ such as Harvard and Stanford that has allowed online education to break through to public consciousness in the way it now has, under the banner of MOOCs. Interestingly however, other HE institutions in this rarified upper strata that have chosen not to participate in this gold-rush so far – notably Oxford and Cambridge in the UK – don’t seem to be especially troubled by the phenomenon.

    It is the ‘squeezed middle’ of second tier universities who see MOOCs as a threat to their livelihood, and the opinion of many is that solution in future will be for institutions to find or build specialisms in particular unique areas. Get ‘niche’.

    Reda locates a particular opportunity here in the troubled issue of ‘the fit in today’s world of the capacity of universities to prepare people for the workforce or for the demands of society’. Sub-degree, competency-based qualifications represent, in his view, ‘a huge gaping hole’ that knowledge-producing institutions are in a privileged position to address.

    He cites a client he worked with who had seen an Oxford University course on the area they worked in, but believed they could themselves build one ‘a hundred times better’. This sparked for him the idea that an organisation that has the practice – that actually does the job – could now, through the affordances of technology, build an educational offering of high quality.

    An organisation that in addition starts with a strong publishing function is particularly well placed since they will already have the quality development processes that will make it much easier to build educational experiences around that content.

    Playing the long game

    Of course, underlying all this talk of opportunities is the necessity for publishers to make their digital investments pay, and while moving into creating educational experiences around content might represent an opportunity for some organisations, there usually has to be some threat element in play to compel action.

    Reda pointed to the scrabble for data around MOOCs, which as early as 2013 prompted publishers to offer access to their textbooks within MOOCs in return for the user data. In a data-driven world, he would consider not having some such access to this type of data as a risk.

    This has to be see in the context of attempts by publishers to use digital to bring textbooks to life, not all of which have proved wildly successful with users, and the idea, argued by some, that MOOCs themselves are textbooks: that, ‘MOOCs perhaps represent the first form of digital textbook to reach a mass audience’.

    Given factors like these, organisations can’t afford to not experiment and try new things if their businesses are to grow and survive.

    In Toby’s view, publishers still largely think they’re in the business of selling content. He sees very few examples of textbook publishers migrating online in a way that works. ‘Part of the challenge is that since individuals are so reluctant to spend any money for content online – and bearing in mind that the offline textbook market was largely an individual-purchase model – it is very hard to see how a textbook publisher is going to get a return if they simply put their textbook online’.

    Data driven-models mean that money is made elsewhere than in the same transaction, so the challenge is to look at your publishing business in the round. A publisher such as Wiley, whose acquisitions in the learning space follow a strategy around the lifetime value of a customer – from education through to their professional life – might (notionally) balance losses in one part of the business by larger gains in another. This would involve looking at the value of the individual rather than the value of the training.

    ‘That’s what makes the web so hard, but at the same time so interesting: you have to consider where the value is, and the lifetime value could be very long … it’s very difficult to look individually at each particular piece: you have to look at it holistically.’

  • From communication to education

    From communication to education

    There is of course an intimate relationship between communication and education. In many universities, both sit under the discipline of psychology.

    However, in most international organizations, these tend to be siloed functions. Communication often focuses on external media relations and, in the last few years, has expanded to take on the role of organizing social media presence. Education is reduced to ‘training’ or subsumed under staff (or talent) development, sometimes (but not always) inside of human resources. Worst-case scenario: an organization may not even have a centralized learning function, even though a quick survey would probably reveal that learning, education and training are at the core of its knowledge production and dissemination.

    Communication counts eyeballs, downloads, or retweets.

    Education tracks what is happening behind the eyeballs – and changes it, in measurable ways. This is equally true of the industrial-age classroom (and its organizational corollary, the training workshop) as it is of online learning environments that maximize technology’s amazing economy of effort.

    In a knowledge-driven economy, impact matters more than perception.

    In addition to being ephemeral (especially social media), this is why communication-based approaches feel increasingly superficial.

    Photo: Philadelphia sunrise, 21 April 2013.

  • Four billion

    Four billion

    A few months ago, a malaria guy showed me the $20 dumb Nokia phones he buys in a Geneva convenience store and then gives out to trainees who then use it to collect data via SMS text messages. ARM says that the US$20 smart phone (read: Android with an ARM chip) will arrive this year. At stake: how to get the next four billion people online.

    The $20 dollar smart phone
    The $20 dollar smart phone

    Source: ARM says $20 smartphones coming this year, shows off 64-bit Cortex-A53 and A57 performance. Photo: Fr3d.org/Flickr

  • Accreditation in higher education is based primarily on inputs rather than outcomes

    Accreditation in higher education is based primarily on inputs rather than outcomes

    Burck Smith describes how accreditation is based primarily on a higher education institution’s inputs rather than its outcomes, and creates an “iron triangle” to maintain high prices, keep out new entrants, and resist change.

    To be accredited, a college must meet a variety of criteria, but most of these deal with a college’s inputs rather than its outcomes [emphasis mine]. Furthermore, only providers of entire degree programs (rather than individual courses) can be accredited. And even though they are accredited by the same organizations, colleges have complete discretion over their “articulation” policies—the agreements that stipulate the credits that they will honor or deny when transferred from somewhere else. This inherent conflict of interest between the provision of courses and the certification of other’s courses is a powerful tool to keep competition out. Articulation agreements, like API’s for computer operating systems, are the standards that enable or deny integration. In short, by controlling the flow of funding, accreditation insures a number of things: All colleges look reasonably similar to each other, the college can’t easily be “disaggregated” into individual courses, and coursework provided by those outside of accreditation can’t easily be counted as credible.

    Lastly, to further tip the scales toward incumbent providers, accreditation bodies are funded by member colleges, and accreditation reviews are conducted by representatives from the colleges themselves. The “iron triangle” of input-focused accreditation, taxpayer subsidies tied to accreditation, and subjective course articulation ensures that almost all of the taxpayer funds set aside for higher education flows to providers that look the same. And by keeping innovations out, colleges can maintain their pricing structures [emphasis mine].

    This explains why most online courses are priced the same or higher than face-to-face courses despite massive cost efficiencies. Such enormous profit margins available to the delivery of accredited online learning explains the quick growth of for-profit colleges, nonprofit colleges offering online degree programs in conjunction with private-sector providers who share in tuition revenue, and colleges running separate online divisions that subsidize face-to-face operations.

    A more accurate characterization of today’s higher education is that individual colleges offer online learning as a “feature,” but use their regulatory clout as a group to resist disruption.

    Source: Young, J.R., McCormick, T., Smith, B. (Eds.), 2012. Disrupting College: Lessons from iTunes, in: Rebooting the Academy: 12 Tech Innovators Who Are Transforming Campuses. The Chronicle of Higher Education, Washington D.C.

    See also: Kaufmann Foundation report, College 2.0: An Entrepreneurial Approach to Reforming Higher Education and Burck Smith’s blog post similar to the quoted article.

  • Masooda Bano: the impact of international aid on volunteering and development

    The negative impact of aid on development has been a recurring and controversial subject in recent years. Drawing on her extensive research in this field, Masooda Bano asserts that there is a strong negative correlation between foreign aid, and voluntary organisations’ ability to mobilise communities.

    Masooda Bano is a Research Fellow at the Oxford Department of International Development & Wolfson College, University of Oxford, with a DPhil from Oxford and MPhil from Cambridge. Her work focuses on real life development puzzles with a focus on mapping the micro-level behaviour and incentive structures drawing on rich empirical data especially ethnographic studies.

    Dangerous Correlations: Aid’s Impact on NGOs’ Performance and Ability to Mobilize Members in Pakistan