Showing posts with label RAT. Show all posts
Showing posts with label RAT. Show all posts

02 February 2019

An Undistinguished Educator: Why I'm not an ADE

Why after over twenty years working to integrate digital technology in classroom K-12, I'm still not an Apple Distinguished Educator, or a Google Certified Educator. I'm happy to remain an undistinguished educator. 




So having an Apple logo appended to my signature makes me 'distinguished'? Passing a multiple choice test means Google will 'certify' my teaching efficacy? 

These ‘certifications’ have more to do with huge corporations influencing educators into a form of brand loyalty and in turn using those educators as 'influencers' than it does about genuine continuing professional development.

Now it could be said that it’s okay for me to take this position as I am fortunate to be working in an amazing school; if I was seeking employment I might have to swallow my pride and get me 'some o dat certification', just to satisfy the naive expectations of administrators and schools who should know better. And that may be true, however I’d also have to seriously question whether that the kind of school that values that kind of certification is the kind of environment I would like to work in.

Many moons ago, at the beginning of this branding exercise, I kept an open mind and attended sessions at tech conferences dedicated to both of these qualifications and was absolutely appalled at the focus they outlined; clearly designed by both parties to foster an exclusive focus on their tools to the exclusion of any others, no matter what they might say. Because creating a video and writing a letter is the gold standard in determining educator efficacy?

That sounds like the kind of process that would be dreamt up by a corporate marketing team than anyone serious about improving education to me.  


When I attended the Google certified educator session it was even worse, the admission criteria included taking and passing a multiple-choice test, one where the questions didn’t even match the current iteration of the Google Apps suite that was being used!  So candidates were informed that they would need to answer the multiple choice questions (yet another ludicrous way to determine teaching talent) in a way that aligned with the way the tools used to work... even then what precedent does this set? Based on sample questions we were shown, the sign of a skilled educator is that they have memorised the locations of commands in the menus of the tools they use? That’s not how I operate, if you were to ask me where to find a certain command in Google docs I couldn’t tell you from memory, I haven’t memorised them,  but I know where to look for them when I need them. The criteria for appraising the efficacy of educators in Google is fundamentally flawed, not built on skilful pedagogy but on a naive surface level assumption that memorising the location of functions in software is of paramount importance?

I can tell you that when the institution where I work seeks to recruit coaches/teachers, whether or not they have one of these superficial qualifications is not a consideration.  I’ve encountered many educators who are clearly very poorly skilled and have a very dubious understanding about how tech can be integrated effectively (nouns over verbs, tech viewed more like toys than tools), and their naive display of their certification just served to further undermine their credibility.

The aspect I find most difficult to accept is the way these titles facilitate a kind of exclusivity or 'club', how do people expect to effectively engage in effective professional development if their first criteria is exclusion? Even more ridiculous, you could, like me, be a teacher who has many many years of experience working with tech integration, or/and have a Masters degree in this area, but that will still not permit inclusion to this inner sanctum. When a community values a superficial label over a rigorous professional qualification that takes years to acquire you know there must be something wrong.

So, if you were considering pursuing this certification, my advice is to forget it. Use the time to focus on designing better lessons for your students, and if you’re seeking a qualification, pursue something like a degree, or masters degree instead.



04 October 2014

The 3rd Barrier to Tech Integration




There are barriers to effective integration, that's probably not a surprise.

The amount of barriers described varies, but probably the most useful summary that made was by Ertmer back in 1999, who helpfully simplified these kinds of barriers by categorising them into two types:

1st order barriers

External (first-order) barriers to technology integration are described as being extrinsic to teachers and include, “lack of access to computers and software, insufficient time to plan instruction, and inadequate technical and administrative support” (Ibid).

2nd order barriers

In contrast, internal, (second-order) barriers are intrinsic to teachers and teaching, and include, “beliefs about teaching, beliefs about computers, established classroom practices, and unwillingness to change” (Ibid.)


It is generally acknowledged that first-order barriers can be significant obstacles to achieving technology integration, yet the relative strength of second-order barriers may reduce or magnify their effects (Ertmer et al., 1999, Miller & Olson, 1994). Since different barriers are likely to appear at different points in the integration process, teachers will need effective strategies for dealing with both kinds of barriers – but perhaps most critically it is the barrier of belief that is most important. As Ertmer wrote subsequently (2005), “If educators are to achieve fundamental, or second- order changes in classroom teaching practices, we need to examine teachers themselves and the beliefs they hold about teaching, learning, and technology.”

Marcinkiewicz (1993) noted, “Full integration of computers into the educational system is a distant goal unless there is reconciliation between teachers and computers.” (p234). Cuban’s observation (1997) supports this: “It’s not a problem of resources, but a struggle over core values”.

So, here we are, in our 5th year of our iLearn, the TEL (technology enhanced learning) revolution that began at UWCSEA in 2010/11, and I'm wondering, how far have we come?

I'd say a long way, in fact I'd go so far as to say that the process has been kind of linear, it's been a process of working through the barriers:

First overcoming first-order challenges associated with learning how to use the actual hardware and software, distribution of devices, sharing, managing, distributing et cetera.

Then, the most significant challenge of building belief moving from, OK, now I know how to use it, but am I convinced that I really need to? And how often? Who with? Why?

I say 'kind of linear' because, clearly, achieving technology integration is a multifaceted challenge that entails more than simply acquiring and distributing computers. Although different types of barriers require different types of strategies to overcome (Ertmer, 1999) we should not try to eliminate one barrier before addressing another, like Scrimshaw (2004), any barrier can be addressed by more than one strategy, and some strategies are likely to effectively address more than one barrier.

But I'd say in our 5th year, we have largely overcome these two barriers, so, job done? No. You see there are critical, third order (and hopefully final) barriers.


Really? Yes.

3rd order barriers

Tsai & Chai (2012) describe a third type of barrier, a lack of problem solving capacity when using digital technologies, they describe these powerfully in terms of ‘design thinking’ where the ability to “re-organise or create learning materials and activities” and adapt these accordingly (ibid, p1058) is seen as necessary to overcome a ‘third-order’ barrier of a lack of ‘design thinking’.  

Design is my background, and I immediately see its relevance in this context. Any designer of any worth knows that the tools are merely a means to an end, they are tools for solving problems in unique ways. If you'll permit me to remix Wikipedia's definition of design thinking a little:

"Teachers who use digital tools seamlessly to accomplish goals and enhance learning environments, by using digital tools as a set of primitive components, to satisfy curricular requirements, subject to constraints. They have a strategic approach with digital tools that allow them (and their students) to achieve unique expectations. These tools frame their specifications, plans, parameters, costs, activities, processes and how and what to do within legal, political, social, environmental, safety and economic constraints, in achieving learning objectives."

In other words, the affordances, the transformative qualities of digital tools become a natural aspect of their practice, losing their initial opacity, and becoming transparent/invisible as tools for meaning making, as transparent as the tools that preceded them, tools like pens, and paper, and protractors. 


Design thinking breakthrough

Teachers who have overcome the 3rd barrier effortlessly accommodate digital tools as and when needed, who use the elements that make these tools unique, elements I describe using the acronym 'SAMMS'. Elements like the situated nature of digital technology, the ability to leverage access to processing power and information, the mutability, and multi-modality of these tools, and the power of working with them within social networks, networks as small as that of the classroom, to that of a grade, a school, a region, or even the globe—the world wide web. All of this, as regularly and as seamlessly and as naturally as breathing.

In this context the creative repurposing of tools to transform learning is ubiquitous, viewed through the lens of frameworks like RAT and SAMR, replacement is rare, amplification is common, and transformation is so common, it is often taken for granted, that is when it is invisible, assumed, the new 'normal'.

Design thinking

'Design thinking' results in practitioners who regularly synthesise the current state of technological knowledge, incorporating new findings, and delineating new dilemmas. A high degree of technological pedagogical knowledge (TPK) (Koehler & Mishra, 2009) is foundational to this final stage—a profound understanding of how teaching and learning can change, when digital technologies are used effectively. This knowledge of the ‘pedagogical affordances and constraints’ of a range of technological tools as they relate to various disciplines with “developmentally appropriate pedagogical designs and strategies (ibid)”, is precisely what gives the 'designers of learning experiences' a capacity to succeed where others have failed.

Sandholtz et al (1997) foreshadowed this decades ago, when describing 'levels of integration', from entry to adoption, adaptation, to appropriation, where the teacher is fully confident in the use of computers and integrates the technology regularly into daily routines. But the highest level, the level where 'design thinking' is required is the level of invention, where teachers, "experiment with new ways of networking students and colleagues and use project-based instruction and interdisciplinary approaches." (p53).

We need to creating a culture of "design thinking" where teachers not only use technology but become creative at repurposing it to better cope with the unique requirements of their various curricular areas. This is the 'RAT challenge'—finding ways for teachers to regularly, naturally, habitually use digital technologies to create learning experiences that would be inconceivable with traditional technologies. 



References 

Cuban L (1997). High-tech schools and low- tech teaching. Education Week on the Web. Online. Retrieved 10 February, 2004, from http://www.edweek.org/ew/vol-16/34cuban.h16 

Ertmer P A (1999). Addressing first-and second-order barriers to change: Strategies for technology integration. Educational Technology Research and Development.

Ertmer P A (2005). Teacher Pedagogical Beliefs: The Final Frontier in Our Quest for Technology Integration? ETRandD, Vol. 53, No. 4, 2005, pp. 25–39 ISSN 1042–1629.

Koehler M J and Mishra P (2009). What is technological pedagogical content knowledge? Contemporary Issues in Technology and Teacher Education, 9(1), 60-70.

Marcinkiewicz H R (1993). Computers and teachers: Factors influencing computer use in the classroom. Journal of Research on Computing in Education, 26, 220–237.

Miller L & Olson J (1994). Putting the computer in its place: A study of teaching with technology. Journal of Curriculum Studies, 26(2), 121-141.


Sandholtz J, Ringstaff C, & Dwyer D (1997). Teaching with technology. Creating Student Centered Classrooms.

Scrimshaw P (2004). Enabling teachers to make successful use of ICT. Becta. Retrieved 6 March, 2006 from http://www.becta.org.uk/page_documents/research/enablers.pdf   

Tsai C & Chai C S (2012). The “third”-order barrier for technology integration instruction: Implications for teacher education. Australasian Journal of Educational Technology, 28(6), 1057-1060.

09 April 2014

Transforming Assessment for/and/of Learning

Stop Marking and Start Giving Feedback


Here's a magnificent example of how assessment can be transformed by the effective use of digital technologies.

Replace, Amplify or Transform - RAT

It is so easy for even powerful applications of ICT to be little more than replacement for traditional tools and methods, maybe amplified—by that I mean, maybe there are benefits in terms of amplification, like speed, or efficacy, maybe the activity is more motivating, maybe it uses less paper, but is it really changing learning; or the kinds of teaching you can do?

If not, then it's not transformative, and it's not what I am aiming to see in the classrooms of the teachers I 'coach'.

So, one of our Grade 5 teachers is transforming formative assessment, and he's doing it by cleverly combining two powerful tools, in a synergetic way that amplifies the potential and possibilities of both, here using Google Doc comments and QuickTime screen recording.

Now he's been using screen recording for some time to give feedback to his students, and then he started experimenting with getting his students to use the same method to create a 'learning talk' to explain the rational behind their writing choices for him, great, but the problem with that is you now have 22 x 2-3 minute videos to 'mark' and the problem with video compared to text, is you can really 'skim' it, and annotating it? Not easy, certainly not as easy as paper.

In short video is great for pushing content to kids, but it sucks for pulling content from kids.

Unless… you get the kids to use each other as resources, what I call P2P (peer to peer), what Dylan William calls 'Students as resources for one another'.

So, have a look at this video, by an 'ordinary' student, on an 'ordinary' day in an 'ordinary' classroom at UWCSEA, but one who is transforming learning of her peers.




SAMMS

It's worth pointing out exactly why this is transformative, because it leverages 4 out of the 5 unique affordances of ICTs, that I call 'SAMMS'; this work is:

Situated - This student can start the work at school, continue at home, and seamlessly return to at school no problem, any space, any place, any time, that suits her.

Multimodal - Text and speech = win win.

Mutable - the workload implications of acting on feedback are minimised compared to paper. Feedback annotation on paper would effectively require the student to start again and rewrite the entire thing from scratch - the my ability of the screen mean edits and revisions can be made quickly and simply, and supported by supportive proof-reading tools.

Social - This document has effectively become a micro-community, two students and one teacher, but it's not one way. Following the feedback, any of the 3 parties involved can pitch in with comments to clarify, redirect, reinforce, resolve… Invite others to join in? the possibilities are endless!



01 August 2013

A Framework for Transformational Technology - SAMMS



Five Transformational Triggers for the Integration of Digital Technology


Transformative applications of digital technology are the holy grail of educators spanning the globe, and yet it is far from easy to achieve...



Moving from the Mundane to the Magnificent

Frameworks like SAMR and RAT are incredibly helpful here, but we still need a framework to assist with the top levels of redefinition/transformation of learning through effective uses of digital technologies. SAMMS is a framework that attempts assist with this, by determining exactly what the 'magic ingredients' are that move tech use from the mundane to the magnificent.

Determining these 'ingredients' starts from a position of describing what it is about digital technologies that make them unique, transformative—what is it they facilitate that cannot be replicated with traditional tools? Exactly how do pixels out perform paper? I've been reading a LOT about ICT integration over the last four years in my pursuit of a Master's degree, and throughout my readings I noticed a pattern forming—certain aspects of ICTs that were deemed to make a significant difference in teaching and learning, or to use the academic vernacular, 'unique affordances' ...

So what are the transformative, unique affordances of digital technologies?


Five features or facets of pixels that out perform paper -  (SAMMS):

Situated practice (work anywhere)
Accessibility (access to information)
Multi-modality (screen centred creations)
Mutability (provisionality/fluidity/malleability)
Social networking (syncronous/asyncronous people power) 



I've expanded on these categories in another post, here I want to consider what happens when you cross reference these with what I believe are the 5 core digital domains of ICT:



Text | Image | Audio | Video | Data

By all means consume, but the exciting stuff happens when creating‚ of course you can't have one without the other, you can't connect the dots, unless you have dots to connect... But if you work in any of these domains and also exploit as many of the aspects of ICT that are unique as you can, you create transformative experiences—the more you of these you exploit, the more transformational it becomes. And when you start merging these elements it gets really exciting, eg situated use, means you can access multimodal content anywhere, sharing with others, collaborate, and even revise your content as you go, on your own or with others.


Take the domain of text, most likely this means word processing, (although many typographers and graphic designers might argue with you about that one) but what does working with text look like when it is...

Situated Text

Everywhere is here. Exploiting the ability for ICTs to make the boundaries between school and home permeable, means that your students don't need 'homework' they just continue with their classwork—well that's what we do in the 'real world' right? I take my work home but it's not 'homework', it's work, some of which I am doing at home, and will continue at work tomorrow. If you're using mobile devices this kind of 'situated practice' becomes even more transformative, with kids adding/editing/tweaking on the bus/train as inspiration occurs, or as research based revelations are revealed.

Accessible Text

Reading and researching the world of the written world has always been more than a little overwhelming (if you've forgotten how overwhelming mountains of data can look, you need to visit a bigger library). Thank to the advent of super fast search, all of that data has become more accessible, accessible in a way that is transformative. Teach your kids some basic search skills and they can leverage the unprecedented level of global access to expertise that is unique in history that we now take for granted.

MultiModal Text

Now at first glance this might seem a little contradictory, like, if it's multimodal (image, video, audio), it's not just text, but leveraging other modes of media in conjunction with text is again transforming the ways we consume and create with text. As an example, I now regularly 'consume' media I have not got time to read on paper/screen by listening to podcasts as I commute. Students can use text to speech features to hear how their writing sounds, or to motivate reluctant readers, who may well be more inclined to listen than decode. Taking snapshots of passages in books, posters, flyers, and of course screen shots of inspirational material—quotes, slogans, titles.

What this is really about is a new kind of literacy as the multimedia devices that now are ubiquitous in our worlds mean that speech and writing are already being pushed to the margins of and replaced by image and others. The once dominant page, especially in terms of the newspaper and the book, is giving way to the screen (Kress, 2005). Let's encourage our kids to illustrate, accentuate, emphasise and embellish their text with image, with sound, with moving images and even video. Generally, I assume that when someone makes the claim that an 'artefact' is 'multimodal', that it's 'multimedia' ie, combining text, image and video, although technically using text and image together is multimodal, I would argue this is only true if the images are illustrations, not just decorations, that's a critical distinction. The imagery should be being used to communicate, to add more meaning, not just make the things look pretty.

Mutable Text

This is no brainer—even the most tech phobic will have to concede that the mutability of screen text is revolutionary compared to paper. Although, it is depressing how little this incredible capability is embraced by teachers—editing and revision can be transformational, creative experiences thanks to the provisionality of pixels.

Many teachers may yearn nostalgically for the 'good old days' of handwriting & cursive; and while that skill has it's place, it's hard to argue its benefits if the goal is improved writing in terms of making meaning. Revising text that is restricted to (often barely legible) handwritten annotations squeezed into margins or between lines is clearly inferior when entire paragraphs need moving, adjusting, inserting; with edits of this kind the student in question would need to literally rewrite the entire piece. Hardly motivating or conducive to reflective practice.

Cutting/pasting looking up meanings and synonyms, proofreading, all amplify what we can do with text, but transforming means exploiting things like undo button to encourage kids to take more risks; the save as, revert or history options to manage multiple versions of documents; the effective use of styles so that formatting changes can be made to an entire document with one click; smarter uses of (well designed) templates; grab snippets of text from multiple sources and from multiple perspectives, and mash, mix, mend, and remix them into something unique.

Social Text

We are social and of course nothing beats the power of social connection in the classroom face to face and the powerful synergy that creates. But with the advent of web 2.0 this conversation can continue beyond the classroom and more importantly beyond the strictures of the 45 minute period lesson where you will inevitably struggle to converse with every student on a meaningful level. Now, instead of "setting homework" students can continue with their classwork at home, only now they can collaborate online with you/with their peers who can comment/reply/respond facilitating a virtual conversation through the medium of digital text.

Since students can express their thoughts without interruption, they have more time to reflect and respond (Shea, 2003). This ‘peer-based learning’ is characterised by “a context of reciprocity”, (Ito et al, 2008, p 39) where participants don't just contribute, but also comment on, and contribute to the content of others. This transformational practice is already becoming seamlessly integrated into the fabric of the classroom so that dialogue and pupil collaboration can be enhanced and extended, (Garrison, 2004) a cooperative combination of multiple interactions, which is indicative of a new, collaborative pedagogical practice.


Triggers + Domains = Transformation

So, there you have it, transformational practice and here I have only described how this could apply in just one of the five domains. A similar level of transformation can be experienced by the judicious application of effective technology in transformational ways within each of the five domains, across domains and combining several if not all of the triggers.

How do the five transformational tech triggers transform the use of image? audio? video? data? How does this change when we work within and across these domains in ways that are social, accessible, multi-modal, exploiting mutability and situated (can be done almost anywhere)?

How transformational can our use of ICTs be when we work across domains? Merging text, with image; image with audio; video with data; all of them with all of the others?

Aiming for transformative applications of technology can be daunting, if so, it's a good idea to start with amplified practice and add the 5 elements and 5 domains gradually, like ingredients to a cake mixture, the more you add, the more amplified it gets until it becomes transformative. In my experience you will often find that your students will move from amplified into transformative practice quite naturally.


Let your students show how transformative technology can be. I think you'll find that—regardless of your own expertise—the synergy of a teacher's pedagogical expertise, content knowledge, and experience, combined with the natural confidence of 'digital natives' is intrinsically transformative. 


5 Tech Triggers + 5 Tech Domains = 
Transformed edTech

14 July 2013

The RAT, SAMr, Transformative Technology, & Occam's Razor


Digital technologies are all well and good, but if we're going to use these, can we at least make sure we are actually changing what it is possible to achieve? For our students to learn?

Probably the single greatest chalenge in my role is to encourage ICT use that does not make the mistake of just replacing or substituting pixels for pages. There are two frameworks, SAMR and RAT, I prefer RAT, but for some reason SAMR seems to get a lot more attention, which is crazy in my opinion, it's far too complex to be of any really practical use, and it's often misinterpreted.



Replace, Amplify, Transform*—that's it. 


SAMR is impossible to pronounce, in English anyway, and while it's simpler than most, it can be simpler, without, I believe, losing anything that is crucial. I don't need to wrestle with the distinction between Augmentation and Modification, seriously—is it that important? What I do see on a really bad day, is tech that is not just replacement, but worse; allow me to reiterate, people using computers in ways that are actually WORSE than not using tech at all—like the person who insists on printing out name labels for each kid, I mean, really? Just get a pen and a write the name on a sticker. I'll tell you what level of integration that is— Retrograde.

But don't take my word, take Michael Fullan's,
Many of the innovations, particularly those that provide online content and learning materials, use basic pedagogy – most often in the form of introducing concepts by video instruction and following up with a series of progression exercises and tests. Other digital innovations are simply tools that allow teachers to do the same age-old practices but in a digital format. Examples include blog entries instead of written journals and worksheets in online form. While these innovations may be an incremental improvement such that there is less cost, minor classroom efficiency and general modernisation, they do not, by themselves, change the pedagogical practice of the teachers or the schools. (Fullan M & Donnelly K, 2013, p25)

Less is More*

So, while I love and cherish SAM(r) I have new friend, its name is RAT (Hughes et al, 2006), and it is remarkably non existent on the 'Interweb'—I'm not sure why, but when I couldn't find any graphics to illustrate it for some upcoming PD I'm prepping I realised that I would have to ... *takes deep breath, yes it's hard to admit* make my own—so, here they are (CC free, just help yourself),  mash - mend - make your own, but please lets put some life back into the RAT framework, it was published in 2006, and from what I can see, it has been sleeping in obscurity ever since.




I'd describe what RAT means, except that, well, there's no need—that's the beauty of it, it's obvious (if you speak English).



R :: replacement | redundant | retrograde
A :: augmented | average | acceptable
T :: transformed | terrific | tremendous


Now all we need to do is wrestle with the holy grail of tech integration—defining the nature of transformative tech, I like these attempts, from the RAT paper:

Technology as Transformation

The Technology as Transformation Category involves technology use that transforms the instructional method, the students' learning processes, and/or the actual subject matter.

  1. The actual mental work is changed or expanded 
  2. The number of variables involved in the mental processes are expanded
  3. The tool changes the organisation in which it had been used 
  4. New players become involved with the tool's use (or expanded use of the tool). 
  5. New opportunities for different forms and types of learning through problem solving, unavailable in traditional approaches, are developed.
... it [transformative use of ICTs] improves the process of bringing thought into communicable expressions in such significant ways that, once the tool is understood and used regularly, the user feels wanting if it is not available because it has opened up new possibilities of thought and action without which one comes to feel at a disadvantage. It's become an indispensable instrument of mentality, and not merely a tool. (Pea, 1985, p 175)

… we will be best served by setting our imaginations free from seeing a computer as a machine that lacks the warmth and security of a book, seeing it instead as a technological alternative providing almost unlimited potential to operationalise the humanistic values that fuel our noblest conceptions... (Reinking, 1997, p 642)




The more important question (that the bucket load of people who blog about SAMR rarely seem to address) is how do you move ICT use from one end to the other, from replacement to transformation (RAT), or from substitution, to redefinition (SAMR)?

There are few answers:
  1. Maybe you don't need to, sometimes good old-fashioned traditional tools are more effective than using a screen, hard for me to admit that it is true… Sometimes. But not as often as Technophobes would have you believe… but if all you are doing is replacing with technology then there really is no point.
  2. Maybe amplification (or augmentation/ modification in the SAMR model) is perfectly okay for the task at hand. Technology doesn't have to transform learning for it to be beneficial, I have often found that if we let the kids have the freedom, they can transform learning all by themselves. They can take amplified practice and transform it due to their greater confidence, or more effective use of technology, more effective than was maybe conceived by the teacher...
  3. Focus on what it is about ICTs that make them unique—called 'unique affordances' or 'features'. Avril Loveless* listed these back in 2002 as

    "provisionality, interactivity, capacity, range, speed and automatic functions which enable users to do things that could not be done as effectively, or at all, using other tools." (Loveless, 2005)

    I found that list to be a little ... long, ie hard to recall/use, and a little out of date, in terms of the development of social media, and the internet in the past 10 years; so I took the liberty of coming up with my own. Actually I came up with this before I came across the 'Loveless List' as I call it. Mine is a framework for amplifying/transforming ICT use, called SAMMS: Situated learning that makes the most of access to plethora of online resources, to work in ways that are multimodal, mutable and socially networked. Here's a link:

    http://doverdlc.blogspot.sg/2013/10/a-framework-for-transformational.html


And more here on this blog if you want it:

http://pr0tean.blogspot.sg/search/label/SAMMS


*Unless it's just less, in which case less is just ... less.


Fullan M & Donnelly K (2013). Alive in the swamp, assessing digital innovations in education. London: Nesta. Available online: www. nesta. org. uk/library/documents/Alive_in_the_Swamp.pdf.

*Hughes J, Thomas R & Scharber C (2006). Assessing Technology Integration:
The RAT – Replacement, Amplification, and Transformation - Framework.

Loveless A, & Ellis V (2005). ICT, pedagogy, and the curriculum: Subject to change. London: Routledge/Falmer.

Pea R D (1985). Beyond amplification: using the computer to reorganise mental functioning. Educational psychologist, 20 (4)167 – 182.

Reinking D (1997). Me and my hypertext :). A multiple digression analysis of technology and literacy (sic). The reading teacher, 50 (8), 626 – 643.