Friday, July 01, 2011

Reading :: The Science of Qualitative Research

The Science of Qualitative Research
By Martin Packer


This is a significant book that digs into the history and development of qualitative research, providing a sustained critique of current research approaches informed by philosophy. It appears to be solidly researched, solidly argued, and based on a remarkably broad base of knowledge in qualitative research methodology and history as well as philosophy.

On the other hand, I didn't love it. Part of the reason had to do with the fact that Packer is dealing with such broad trends in qualitative research that it's hard to characterize them well, so he ends up characterizing localized implementations as universal ones. For instance, in Chapter 3, he critiques grounded theory's approach to coding as a process of decontextualizing statements and thus denying the interpretive context that make those statements meaningful. His extended example is Auerbach & Silverstein's introduction to GT coding, Qualitative Data: An Introduction to Coding and Analysis. But I looked up this book and it's hardly an exemplar - Auerbach & Silverstein had just discovered qualitative research, having come from a quantitative tradition, and this book decribes a coding approach that is frankly underthought and quite undercontextualized. When Packer uses this book rather than one by experienced qualitative researchers, I lose some faith in the argument he's making.

But then again, in rhetoric and writing studies, we made the interpretive turn in the mid 1990s. The interpretive approach to which Packer turns in the later chapters characterized qualitative research as it was introduced to me in my graduate classes. I wonder if the book might be a greater revelation to those who have not yet made the interpretive turn.

In any case, I think the key contribution of the book is how Packer traces qualitative traditions' roots to basic movements in philosophy. If that's your interest, this book is certainly for you.

Reading :: Argonauts of the Western Pacific

Argonauts of the Western Pacific: An Account of Native Enterprise and Adventure in the Archipelagoes of Melanesian New Guinea
By Bronislaw Malinowski


I've been taking some time this summer for pleasure reading, getting to some of the classic ethnographies and case studies that have influenced contemporary qualitative research. This book is one of the great classics, written by one of the giants of anthropology. It covers Malinowski's 1914-1918 work on the islands off the coast of New Guinea, particularly the Trobriand Islands. And although it's a bit thick in places - his writing style reminds me of Jules Verne's in 20,000 Leagues Under the Sea - the account is fascinating.

Malinowski still uses terms such as "savages." But he also tends to be even-handed and sensitive about comparing the cultures (for the most part). For instance, he spends much time describing the Kula, a massive exchange of valuable necklaces and armbands that takes place across the islands of New Guinea in a giant, continuous circle. We Westerners might look at the valuables and think that they aren't impressive - "greasy" is the word he uses - but he says we need to get some perspective: when natives opened oysters and found pearls, they would either throw them away or give them to the children to play with. They viewed Westerners' obsession with pearls in exactly the same way that Malinowski's readers might view the islanders' obsession with necklaces. It's not the intrinsic value that makes these things so valuable, he reminds us, but the value that a society attributes to them.

Malinowski applies this even-handedness - mostly with success - to the islanders' religion, magic, rituals, and views on sex, all of which are very different from those of his readers. For instance, Malinowski notes that the islanders don't realize that men are involved in reproduction. Thus the society's organization is matrilinear and their views on marriage, fidelity, parenthood, and sex are quite different from those of his readers.

The principles of ethnography set out in this book have become foundational principles for ethnographic research. But we might get some perspective on these principles by reading some of the expedition's background on Malinowski's Wikipedia page:
On his most famous trip to the area, he became stranded owing to the outbreak of World War I. Malinowski was not allowed to return to Europe from the British-controlled region because he was a Pole from Austria-Hungary. Australian authorities gave him two options: to be exiled to the Trobriand islands, or to face internment for the duration of the war. Malinowski chose the Trobriand islands. It was during this period that he conducted his fieldwork on the Kula ring and advanced the practice of participant observation, which remains the hallmark of ethnographic research today.
If he had not been forced to stay in the islands for the duration of World War I, would Malinowski have developed participant observation in the same way, or conducted fieldwork to the degree that he did, or develop the insights that he did? I wonder. But Malinowski did what qualitative researchers must often do, making a virtue of the uncontrollable misfortunes in his circumstances, and that long irritation developed this remarkable pearl of a book. Read it when you get a chance.

Reading :: Action Research for Management

Action Research for Management
By William Foote Whyte and Edith Lentz Hamilton


I've provided a link to UT's library because this book is apparently no longer in print and isn't listed on Amazon (except in a couple of miscellaneous used book listings). In fact, the library copy I read has a blank stamp sheet - it hasn't been checked out since they moved from the card system to the stamp system. (We're now on the barcode system.)

I stumbled onto the book while looking for Whyte's classic Street Corner Society: The Social Structure of an Italian Slum, which was checked out. But I greatly enjoyed this book anyway, even though it's certainly not a classic. The book, published in 1965, describes a participatory action research study that Whyte supervised and Lentz and Meredith Wiley conducted in 1945; Lentz wrote the core of the book as a monograph, then Whyte added chapters to the front and back to connect the project to PAR developments. They delayed publication 20 years because the hotel they studied and the participants they quoted, though pseudonymous, were still identifiable to those in the hotel community. (I suspect they waited until some of the principals died, actually.)

The study was of a hotel (the "Tremont") with high turnover and poor labor relations. After hearing Whyte talk about his previous study of the restaurant industry, the Tremont's VP and General Manager asked Whyte to conduct a study of the troubled hotel and recommend changes. Soon, Wiley took over the Personnel Manager position and Lentz was attached to his office, and both conducted PAR. As we read their account, we get to move through different parts of the hotel, examining different sorts of dysfunctions (including some sexual harassment that would result in firing or worse today), and seeing how these dysfunctions resulted from systemic issues rather than simply individual behavior. As you can imagine, I very much enjoyed this account.

On the other hand, reading the book felt like reading a Hardy Boys mystery. It's not just the style, which made me think that we were soon to meet the boys' portly chum Chet, or the dialogue, which is full of interjections like "Why" and "My." It's also that the researchers are portrayed as protagonists who, sometimes through making suggestions and sometimes through confrontations, unravel the mysteries of the hotel and set things right. In this PAR study, the researchers always know best and learn how to nudge management and workers to repeat the researchers' solutions - and believe that those solutions originated with themselves instead of the researchers!

I'm not sure that I gained many methodological insights from the book, but I enjoyed it immensely. If you like PAR or the Hardy Boys, definitely pick it up.

Reading :: Action Research for Management

Action Research for Management
By William Foote Whyte and Edith Lentz Hamilton


I've provided a link to UT's library because this book is apparently no longer in print and isn't listed on Amazon (except in a couple of miscellaneous used book listings). In fact, the library copy I read has a blank stamp sheet - it hasn't been checked out since they moved from the card system to the stamp system. (We're now on the barcode system.)

I stumbled onto the book while looking for Whyte's classic Street Corner Society: The Social Structure of an Italian Slum, which was checked out. But I greatly enjoyed this book anyway, even though it's certainly not a classic. The book, published in 1965, describes a participatory action research study that Whyte supervised and Lentz and Meredith Wiley conducted in 1945; Lentz wrote the core of the book as a monograph, then Whyte added chapters to the front and back to connect the project to PAR developments. They delayed publication 20 years because the hotel they studied and the participants they quoted, though pseudonymous, were still identifiable to those in the hotel community. (I suspect they waited until some of the principals died, actually.)

The study was of a hotel (the "Tremont") with high turnover and poor labor relations. After hearing Whyte talk about his previous study of the restaurant industry, the Tremont's VP and General Manager asked Whyte to conduct a study of the troubled hotel and recommend changes. Soon, Wiley took over the Personnel Manager position and Lentz was attached to his office, and both conducted PAR. As we read their account, we get to move through different parts of the hotel, examining different sorts of dysfunctions (including some sexual harassment that would result in firing or worse today), and seeing how these dysfunctions resulted from systemic issues rather than simply individual behavior. As you can imagine, I very much enjoyed this account.

On the other hand, reading the book felt like reading a Hardy Boys mystery. It's not just the style, which made me think that we were soon to meet the boys' portly chum Chet, or the dialogue, which is full of interjections like "Why" and "My." It's also that the researchers are portrayed as protagonists who, sometimes through making suggestions and sometimes through confrontations, unravel the mysteries of the hotel and set things right. In this PAR study, the researchers always know best and learn how to nudge management and workers to repeat the researchers' solutions - and believe that those solutions originated with themselves instead of the researchers!

I'm not sure that I gained many methodological insights from the book, but I enjoyed it immensely. If you like PAR or the Hardy Boys, definitely pick it up.

Monday, June 27, 2011

Writing :: Losing by Expanding

Spinuzzi, C. (2011). Losing by Expanding: Corralling the Runaway Object. Journal of Business and Technical Communication, 25(4).

Okay, this is the first in my ongoing series on writing publications.  The cite and link above are to the OnlineFirst version of the article, both of which will likely change as the article gets closer to publication. But for now, there they are. If you or your institution have a subscription, please do click through and take a look at it.

Done? Okay, let's talk about how I put this thing together. This was a comparatively pain-free publication, but that's partially because I've figured out how to avoid the pain points.

The Gist
As the abstract says, this article critically examines the notion of the object in third-generation activity theory (3GAT), particularly how that notion - the linchpin of an activity theory analysis - has expanded theoretically and methodologically over the last 30 years. For those of you who are not terribly interested in activity theory, this may not seem too riveting. But for those of us who are, it's a critical question. If the object is not being used consistently, then we really don't have a consistent unit of analysis, and it becomes very difficult to perform strong analyses.

3GAT, by the way, refers to the work that follows Yrjo Engestrom's articulation of activity theory. "First-generation activity theory" is the work of Vygotsky and his followers, focusing on social cognition and mediation in individuals; "second-generation activity theory" is the next stage, in which Vygotsky's followers such as Leont'ev and Luria expanded activity theory to apply to larger social groups. Engestrom developed third-generation activity theory (in part) to account for systemic contradictions and to provide a more systematic understanding of how multiple activities operated. Engestrom is the one who articulated these generations; it's worth noting that some activity theorists don't buy the notion of generations at all. But 3GAT is the version that has really caught on in writing studies, so that's what I focused on in this paper.

The Genesis
I first started having concerns about the 3GAT articulation of the object when writing Network. In particular, I began to wonder how to identify a common object when people from different activities tended to see very different things. For instance, Annemarie Mol's excellent book The Body Multiple does a nice job of showing the phenomenon of multiplicity: different specialists look at the same phenomenon and see very different things, not even agreeing on the bounds of the phenomenon. As I got deeper into the activity theory literature, I began to realize that 3GAT had also tried to deal with this issue in terms of polycontextuality and boundary crossing in activity networks (points where two or more activities intersected). In such cases, the object tended to expand and become more abstract in order to encompass broader aspects of the phenomenon.

This tendency really became clear as Network was in press, because that's when Engestrom published From Teams to Knots. Here, Engestrom tried to deal with polycontextuality and border crossing by postulating mychorrhizae and by further expanding the object. Whereas in his earlier work, Engestrom focused on very concrete objects, here he named enormous objects such as global warming!

This point nagged at me. Also nagging at me was the fact that I sometimes had a lot of difficulty explaining the object to my undergraduate students. And my reading suggested that polycontextuality and boundary crossing were increasing due to the rise of knowledge work, in which teams of specialists from different backgrounds had to come together to work on the same object (whatever it was).

So the question of the object was in the back of my mind, but I planned to get to it sometime in the future. What put it on the front burner was a set of disappointing blind reviews for another article I had submitted for review. Late in that article, I had mentioned in a throwaway line that the object was facing a crisis. The editor suggested that at some point I write an article on the subject. So I did.

The Composition
I decided to set very specific boundaries for the paper. The activity theory literature is vast, so I decided to focus on 3GAT (which, as I said, is the version most used in writing studies). 3GAT originated with Engestrom, who still closely follows the literature and sometimes steps in to head off variations, so I made his work the backbone of the piece. Engestrom's work itself is vast - I swear he must publish something every week - so I focused on his books and other well-cited publications. All of this helped make the project manageable.

Although my reviews on this blog helped me to sort through the major movements of Engestrom's work, I also went back and closely reread large chunks of his work as well as related articles and commentaries. Much of this had to do with testing and refining my emerging hypothesis: that the object had expanded over time, causing a methodological issue.

I had to juggle an enormous number of sources, though, and I felt completely overwhelmed. So one day I sat at my kitchen table with a large roll of manila paper and some sharpies, and shortly I had drawn something that looked like the top half of Figure 4. I labeled each movement with some of the cites that demonstrated it. Then I looked at my other cites and realized that more was going on. A while later, I drew the bottom half of Figure 4.

At this point, I remember feeling incredible relief as well as a sense of disturbance. Could it be that easy? Once that figure had been drawn, I was able to outline and rough out the rest of the article in a hurry.
Side note: Like most of my academic work these days, the paper was drafted entirely in Google Docs, with tables in Google Spreadsheets, figures in Google Draw, and citations in Mendeley. That way, I didn't have to worry about what computer I was using or whether I had backed up recently. My Google Docs, Spreadsheet, and Draw account is backed up daily by SpanningSync, while copies of my citations reside on my Mendeley Desktop.
At this point, I sent the draft to someone whose judgement I trust. (Every academic should have a few trusted, friendly readers to whom they can send half-baked manuscripts.)

My reader liked the direction, but suggested that I work on framing the article more for writing studies. That's not what I wanted to hear, because I hate framing. But he was right.

The Framing and Implications
Honestly, I have a consistent problem with framing my studies for writing journals. For instance, the article I published in last year's Written Communication originally didn't focus on writing at all. Ridiculous, right? But I had reasoned that these workers communicated constantly, primarily through writing, so what else do you want? The reviewers were right, though, and once I put my mind to it, I was able to clarify the framing for that paper.

For "Losing by Expanding," I worried that things would be tougher. For me, the question of the object was intrinsically interesting, and the hook was that we use activity theory in writing studies. But my reader pointed out that that wasn't enough and suggested that I discuss some recent writing studies articles that used AT. Brilliant suggestion, and with the later guidance of the journal editor, I was able to use these studies to connect each transformation of the object back to writing studies.

Initially, I thought very seriously about undertaking a meta-analysis of all recent AT-based work in writing studies. But that would have taken much longer, and frankly, it didn't sound very interesting to me. (Although if you're looking for a dissertation topic...) In the end, I gambled that listing and briefly analyzing a handful of recent papers would give me enough traction, and fortunately, the gamble paid off.

The Implications was difficult too, but I had been thinking recently of a publication that Mark Zachry, Bill Hart-Davidson, and I had written a few years ago. Rather than reinventing the wheel, I took this previous concept and refined it to provide a set of countermovements that would produce a focused, qualified 3GAT object. If you look carefully at this section, you might also see the Toulmin influence.

The Style
Honestly, I had a lot of fun writing this paper, and part of the fun was in adding allusions and puns that a very small number of activity theorists would get, and even fewer would find funny. The most obvious one was the title, "Losing by Expanding," which is a reference to Engestrom's Learning by Expanding. (I picked this one out early.) Other references to titles of major AT works are scattered throughout the manuscript, and I had to rescue a few from mangling during the copyediting process.

I wrote the article in a breezy, bloggish style. Part of that style was ramped back in revision (the editor, whose judgment I trust absolutely, made some specific suggestions that restricted the style but improved the manuscript quality). More of the style had to fall due to the journal's style restrictions: for instance, the contractions disappeared, and some of the rhythm and emphasis in the sentences conflicted with the journal's preference for active voice and putting citations at the first mention.

The Revision Process
In the Acknowledgements, I thank "two anonymous reviewers for providing what is perhaps the most substantive feedback I have received on a manuscript." True. If you're reading this, I meant it. The reviewers were excellent: both read the article critically and offered suggestions that strengthened the piece, but both also managed to be encouraging and to discuss how the piece might impact the field.
A side note: reviewers really are gatekeepers, and they are generally invested in having you do your best work. Sometimes they say harsh things - I've gotten quite a few of these sorts of reviews. Never take it personally. Think of the reviews as a set of restrictions that guide you as you refine the piece for publication. Remember that these reviewers represent the actual readers, and if they don't buy your argument, it's likely that the broader set of readers won't either. 
Anyway, the reviewers generously provided further texts for me to read and incorporate, which I did in a timely manner. The editor also made several expert suggestions that improved the argument considerably. Relatively speaking, the revision process was pain-free - a rarity.

The Results
You may have gotten the sense that I become improbably excited about scholarship. That sense is correct. In this case, I am really very excited about this particular argument - partly because I think it could have an impact, but partly because I just like the structure and symmetry of the piece. I'm glad it's out there, and not just because of the puns.

But that's my perspective. See what you think, and feel free to tell me in the comments.