Showing posts with label Emily Glassberg Sands. Show all posts
Showing posts with label Emily Glassberg Sands. Show all posts

Tuesday, September 1, 2009

Raising the Curtain on Emily Glassberg Sands, Part IV: Questions for Julia Jordan

Playwright Adam Szymkowicz has an interesting interview with playwright Julia Jordan (at left), the true begetter of the Emily Glassberg Sands study, up at his blog. The "interview" is all softballs - and essentially an impromptu soapbox - so I couldn't resist leaving the following comment:

This isn't so much an interview as it is an advertisement. Here are some follow-up's you might have asked Julia, Adam:

Q: Given that the Sands study found no evidence for your claims of male sexism in theatre, one might expect you to revise or adjust your opinions on the subject. Yet you seem to be digging in your heels. Indeed, you insist that not finding evidence for your assertions "means little or nothing." So I'm curious - what sort of evidence could dissuade you from your current beliefs? Would anything less than exact parity between men and women in terms of theatrical production (which is nearly what Sands found anyway, outside of Broadway) do the trick?

Q: And as a follow-up, I'm wondering if you're concerned about the widespread perception that your advocacy of women playwrights is also an indirect form of self-promotion. If more female playwrights reached Broadway, but you weren't one of them, would there be a new socio-economic explanation for that gap?

Q: Do you worry that your "sponsorship" of Sands might have compromised the objectivity she should have had as a researcher? In particular, I find it odd that she called you in the middle of the night (according to NPR) when the results of her survey didn't work out as planned, and I even wonder if pressure from you might have influenced her decision to fudge her data in her final chapter. Many people feel that Sands wouldn't have made the erroneous statements she's on record as having made without some sort of pressure coming from someone. Can you assure us that you didn't pressure her in that way?

Q: And btw - did you understand the statistical issues in Sands's paper? And if so, did you ignore them on purpose? And if so, why?

Q) I'm also confused by the strange contradiction between two of your contentions. On the one hand, you say that female artistic directors believe "that audiences wouldn't buy tickets [to plays by women] . . . and that the theater would suffer financially if they produced scripts by women." Yet at the same time you declare that it's a "simple fact that though less that 20% of the productions are by women, around 40% of the most successful plays in the past ten years were by women." Why are female artistic directors unaware of this "simple fact" (because it would allay any fears about the financial success of plays by women)? Also, could you cite a source for that statistic?

Q: I also wonder about your implied contention that the quality of a play can be judged by its box office. For example, you state that the statistic above could be evidence that women are "vastly better playwrights than men." But this kind of thinking should be problematic, it seems to me, for anyone fighting prejudice of any kind. If, for example, plays by women were indeed not selling as well as those by men (but were of equal quality), wouldn't your seeming position be an argument for keeping that bigotry in place, as long as it sold tickets?

Q: Finally, I'm wondering how you parse the interesting issue of artistic quality vs. political equity. Do political values trump artistic values for you, at least as far as your own gender is concerned? For instance, if a male and a female playwright were both in contention for a single production spot, and the man's script happened to be of higher quality, would you advocate producing the lesser play anyway, for political reasons? And just to push this hypothetical a bit further, if the male playwright were African-American, would you still feel the same way? Just wondering.

Thursday, August 20, 2009

Opening the Curtain on Emily Glassberg Sands, Part III

Once again we interrupt our regularly-scheduled programming to return to the ongoing saga of Emily Glassberg Sands and her struggle to find evidence of sexism on the stage! This week we'll ponder the really interesting part of Sands's study, the one that has generated the most "controversy" - and the one section which could prove a genuine contribution to our understanding of this fraught topic.

No doubt you've heard this by now, but as part of her widely-discussed (though rarely-read) undergraduate thesis, Sands conducted a clever experiment with regional-theatre artistic directors and literary managers as its unknowing subjects. Sands was trying to tease out data regarding sexist reactions to scripts by female playwrights - but how to do it? How to control for everything in the complicated world of play development except for that single variable?

Drawing on the recent tradition of "audit studies," Sands hit on an ingenious solution to her problem. Posing as a researcher into the process of play development, she sent out (to some 252 theatres) unpublished passages from scripts contributed by leading female playwrights - Lynn Nottage, Julia Jordan, Tanya Barfield, and Deb Laufer (Nottage top left, Jordan middle right, Barfield lower left, Laufer bottom right). Only Sands changed the names on half the sample to "male" pseudonyms (she thoughtfully controlled for potential reactions to the synthetic names themselves by choosing bland, but not too bland, sobriquets like "Michael Walker"). In the end, half of her (randomized, as far as possible) sample got the original script with the female name attached; the other half got the same script with a male name attached. Hence Sands effectively controlled for every variable except the gender of the playwright. To entice busy artistic directors to participate in her survey, she even promised that if they read the scripts in question and answered her questions, their theatre would be entered into a lottery with a cash prize (this struck me as the most astutely deceptive ploy in her entire paper; trust me, Emily will go far).

But the results of this experiment, as is well known, elicited gasps from feminists everywhere: while men rated the plays in question exactly the same regardless of gender, women judged the samples more harshly when they believed a woman had written them. And by a rather significant margin.

Since then, argument has raged over the cause of this counter-intuitive result. Yet I've seen little discussion regarding the content of the texts in question, which to my mind could have some bearing on these findings. For there could be a subtle behavioral problem buried in Sands's method that no mathematical analysis could address. To understand what this might be, you first have to appreciate that the negative ratings which Sands found were derived not from any "global" assessment of script quality, but from two axes of response - the likability of the play's characters (particularly its female characters), and the perceived probability of the play's success.

As it seems probable, given the genesis of this study, Sands's occasional fudging of her data to fit her own views, and the general response to her results, that there is a widespread female faith in the existence of sexism in the theatre, the low "probability of success" rating for a female-written play is hardly surprising. (Nor, to be fair, is male indifference to this possibility; the self-flattering denial of possible sexism by men is a well-known phenomenon.)

But when it comes to that "likability" rating, I think we have to dig a little deeper, and consider the texts in question. After all, Sands sent out only four scripts, and a character described simply as a "female" data point might actually range in profile from Lady Macbeth to Anne of Green Gables. And would it be such a shock if women reacted differently to a controversial female character written by a woman rather than a man? It's no secret, after all, that minority audiences unconsciously view characters as social emblems - and thus a negatively-drawn female character written by a woman could stir up greater feelings of unconscious betrayal in women than in men. Perhaps that's unfortunate, or even wrong - but is it the same thing as sexism? If a Jew reacted more acutely to an unlikable Jewish character written by another Jew, would we accuse him or her of internalized anti-Semitism? I don't think so. (Indeed, we might take it as evidence of pro-Semitism!)

And it's worth noting that this is a key difference between Sands's study and earlier studies such as Cecilia Rouse's famous paper on sexism in the classical music world. Rouse found indisputable evidence of sexism in orchestral auditions - a bigotry which has been (slowly) corrected by "blind auditions," in which the performer plays behind a screen. (After this practice took hold, the number of women in America's orchestras exploded.)

But while classical music reflects on its audience, composer, and performers, of course, we still "identify" with its content and style in a less specific way than we identify with stage characters. In other words, if a member of a minority plays a specific musical passage, it's unlikely that his or her listeners would consider its musical content a critical portrait of their own minority. But that's what theatre audiences tend to do, almost automatically. Characters serve as direct avatars in a way that musical statements do not. And thus feelings about characters are inevitably bound up with who wrote them.

So the response of female readers to female characters in female-written scripts could be scrambled if the characters were perceived as "negative" in some way. But again, almost no one in the press or blogosphere seems to have read the material at hand. Sands included the four excerpts distributed to her literary managers and artistic directors as an appendix to her study, and so after I had finished her paper, I went on to read them as well.

And I have to confess I was slightly disappointed in their quality. Two were tight and punchy, and I imagine good actors could make something of all four. But none were particularly original, indeed most echoed the works of other (male) writers. And none were better than the best entrants I saw in the recent Boston Theatre Marathon, or other original scripts I've seen recently. It was hard to feel, therefore, that these particular texts would stand out in the commercial marketplace, given the stiff competition - likewise, it was easy to see why artistic directors might not get too excited about them.

And yet these authors had been heaped with awards - between them, they boasted a Pulitzer Prize, a Guggenheim Fellowship, a MacArthur "Genius" grant, the Helen Merrill Emerging Playwrights Award, The American Theatre Critics Association Steinberg Citation, the Kleban Award, and the Francesca Primus Prize; they have been Lucille Lortel Fellows and Juilliard Fellows and Resident Playwrights, and have received grants from Lincoln Center. And yet these seemingly awesome talents aren't any better, minute by minute, than the women and men writing for free for the Boston Theatre Marathon! I inevitably found myself pondering a possible gap between the soft politics of the awards scene and the quality demands of the marketplace. (If you think I'm being harsh, you can read the texts yourself here.)

I also think it's worth noting that most of the scripts were at least implicitly political - not always an easily sell - and most had women as lead characters, and none of these women was particularly, well, likable. Neither were the men, it's true; indeed, there was an at best sardonic attitude toward all the characters (of course this tone may have modulated or disappeared over the course of the entire play; Sands only distributed a roughly 10-page scene from each - still, that's what her participants read). The men of the plays were either corrupt, weak, or dopily immature - one unseen male was described as "nasty, bitter, nihilistic, misogynist, but likable" - but they were still portrayed as more powerful and self-directed than the women, who were usually seen as dependent, selfish, or, as the same playwright described one of her female characters, "increasingly bitter and angry." Meanwhile another woman was deemed "the ultimate five-armed mother; controls every situation and everyone around her." (Hmmmm. Sexist cliché, anyone?) The one exception to this loose, general rule was a woman dallying sexually with her best friend's college-age son - a controversial form of empowerment, to be sure, and one I can well imagine raising hackles in mature female readers with horny sons of their own.

What was obvious to me was that none of these female characters was drawn particularly positively - at best, they had their points to make, but I felt neither sympathy nor identification with any of them, and certainly none of them were "heroines." And to be blunt, in a sexist (or perhaps more accurately, a perceived sexist) environment, this could cause trouble for a playwright. I could also hear a certain axe grinding away behind much of the dialogue - the expected edge of disgruntled feminism was obvious throughout at least three of the scripts, with its unhappy whine aimed at women as well as men. So the "quality" of the texts was inevitably entangled not only with how female readers might feel about women portrayed by other women, but also how they felt about feminism portrayed by other women, another fraught topic if ever there was one.

So perhaps the results of Sands's audit study shouldn't surprise us at all. Indeed, perhaps these ironic artifacts of the assumption of sexism are what's important about her study. For it's worth remembering that Sands has utterly failed to find any hard data proving sexism in the theatre - which, of course, does not mean it doesn't exist; yet when you also consider that the one piece of hard data she's got actually only proves a belief in sexism on the part of women, one does have to wonder what portrait, exactly, of the theatrical scene her study paints. Indeed, I have to say I find something deeply funny about this whole affair - Sands's female correspondents seem to be in knots about issues that her male correspondents don't even see. Meanwhile, if none of these female-written scripts ever saw production, it's hard to say that we'd have missed anything special! Funnier still, Sands's study could be seen as indicating that the best way to fight sexism would be to have only men read new plays. More on that, and other ironic fallout from the Sands affair, in future posts.

Tuesday, July 14, 2009

Up the Sands box

The fall-out from my ongoing fisking of Emily Glassberg Sands has begun. Over at Parabasis, Isaac Butler (looking surprisingly calm and even-tempered, at left) gets his panties in a bunch here. Meanwhile Matthew Freeman offers an appreciation here.

Opening the Curtain on Emily Glassberg Sands, Part II

Last week I took apart the final chapter of Emily Glassberg Sands's (at left) much-discussed study on sexism in the theatre, and her (illusory) conclusion that Broadway producers had closed female-written shows "early." Indeed, I demonstrated that her entire argument there was a charade of averages, dummy variables, and proxies for data she actually lacked. Next, I mean to look more closely at her "script experiment," in which a survey of regional theatre artistic directors and literary managers revealed that women rated female-written scripts lower than men did.

But before I do, let's take a time out to consider the press response to Sands's work for a moment. I find it striking that no one else in the mainstream media or the blogosphere has questioned Sands's final chapter, even though only a moderately educated person like myself could quickly see the huge holes in her argument. And several heavy hitters have reported on the study - the New York Times did, twice - once even in its "Economix" blog! New York magazine also wrote about Sands's work, the Guardian posted the thoughts of two different writers on her conclusions, NPR interviewed Sands on the air, and the LA Times published a hilariously uninformed piece on its "Culture Monster" blog. Yet none of these writers questioned the study seriously; Sands's somewhat-sophisticated statistical snow job sailed right over all their heads.

Why did that happen? Part of the reason is the technical illiteracy of most journalists, and, of course, most writers on theatre. But another reason is the backing Sands had from three heavy hitters - Steven Levitt, the co-writer of Freakonomics (who seemingly suggested the study to Sands, at the behest of playwright Julia Jordan), Christina H. Paxson, the chairwoman of Princeton’s economics department and the newly named dean of Princeton’s Woodrow Wilson School of Public and International Affairs, and Cecilia Rouse, a member of the White House Council of Economic Advisors, and co-writer of a famous paper that inspired Sands. All these people "vouched" for Sands (according to the Times), and all have been somewhat derelict in their academic duty in this case, I'd say - not because of any intellectual dishonesty within Sands's study itself (she's upfront about the gaps in her data in print, although less so in public), but rather in giving her work their imprimatur as unassailable in its methodology, and allowing it to be floated as a kind of cultural touchstone. It's obvious that either they hadn't actually read the study carefully, or were simply sure that sexism must exist on Broadway, so the gaps in methodology didn't matter. And undoubtedly they have their defenses for their behavior already formulated; they've all toed their "professional" lines (the wordings in their statements have been careful); they've merely allowed uneducated journalists to draw their own conclusions. But nevertheless, a false impression has been created, and they've been behind it.

But why are the gaps in Sands's last chapter so important, anyway?

In a word, because her final, flawed conclusions are the only time she "finds" evidence of sexism in the theatre.

But how is that possible, you may ask, when there are so few plays by women being produced?

Hints regarding the answer to that question are easily found within the study itself. But first, I want to say upfront that yes, very few plays by women have reached Broadway - less than 8% of Broadway productions are by females, in fact. And it's undeniable that in the not-so-recent past, the theatrical world, like the world in general, was just as sexist as it was racist. I'd even argue that sexism remains a more powerful force than racism in the country at large; or at the very least it seems true that sexist statements and actions can more easily be culturally cloaked than racial bigotry can.

But is that true of the theatre? I'm not so sure. The stage is its own political world, with a decidedly left-liberal tilt, and is chock-a-block with aging radicals and former hippies. In several cities (such as mine, Boston), it's entwined with the academic left. Looking around my local burg further, I can't help but note that all the major print critics are female - and all of them are middlebrow feminists. (In New York, it's true, almost all the important print critics are gay men - which leads to a certain catfight atmosphere, but little, I think, overt sexism.) And when you add into the mix the fact that the majority of theatre tickets are bought by women, you realize you're looking at an industry where, at least in my hometown, women are the critics, and the customers - and increasingly the artistic directors, too (we've got two new women A.D.'s in Boston).

Thus, unsurprisingly, in Boston (at least) one often hears that "we need more plays by women." (While I've never heard anyone ever say, "We need more plays by men!" much less "We need more plays by white men!") And for what it's worth, this is almost always a blatantly political, not aesthetic, statement; it's always made by, yes, a woman, yet without reference to any particular text, or theory, or even author. It's just an un-self-conscious political assertion: we need more plays by people like me! I suppose there's nothing wrong with that - perhaps it's how everyone feels inside - but I do want to point out that it indicates the political currents in the theatre actually run counter to the assumptions of Emily Glassberg Sands. (Indeed, it's no surprise to read in her study that there are some thirty women-only theatre companies, such as New York's New George Theatre, in existence.)

So why the gap in play production? Well, first of all, outside of Broadway, Sands's study indicates that there isn't much of a gap. This conclusion must, of course, be taken with a grain of salt, because the source of her data is www.doollee.com, a site with a gigantic, but largely self-reporting, playwright database. Still, that grain of salt is much smaller than the one we had to swallow regarding her conclusions about Broadway, because this time she at least has the type of data she needs, and she deploys it in straightforward multiple regressions, or in even simpler cross-tabulations.

And Sands admits flat-out at the top of her analysis that "I find that scripts on Doollee written by women are equally likely as those written by men to be produced" (p. 41). The gap in play production, it seems, is largely tied to the fact that there are more than twice as many male playwrights as female playwrights, and what's more, those male playwrights write more plays. Indeed, in the more restricted sample Sands must use for her multiple regressions, she even discovers that "female-written are slightly more likely to reach production." (Emphasis added, p. 44.)

Hmmm. Undeterred, however, Sands keeps digging - and we quickly realize that once again we're on a freakin' Freakonomics fishing expedition. Sands tells us that "it has been hypothesized that, in order to get their works produced, female playwrights feel compelled to write plays with fewer total parts." But this oppression scenario doesn't get her very far - it turns out that on average, female-written plays have 6.8 parts, while male-written plays have 7.7 parts - a difference which she's forced to admit "reduces the likelihood of production by about 0.7 percentage points" (p. 44). And indeed, later she discovers that women are "1 percentage point less likely to have one work produced." That's right: one percentage point (the difference is slightly higher - 4 percentage points - within a restricted American sample).

You get the picture: Sands has got nothing, or at least not much. But she keeps scrambling: she notes that female playwrights are somewhat less likely to have an agent (but this doesn't seem to matter much in gaining actual production). They also write scripts with predominantly female roles - and such scripts are six percentage points less likely to achieve production (again, not that much, but intriguing given the results of her "script experiment;" more on that later). To be fair, she all but admits defeat in the conclusion of her chapter about Doollee: "I find ample occupational differences between men and women, but no evidence of employment differences between male and female playwrights," she sighs.

But when Sands doesn't like what comes out of her equations, she is quick to doubt her data: "These results, however, must be considered with an eye to the incomprehensive nature and likely sample selection problems of the data" (p. 53). It's ironic, therefore, that she wraps her study with a "conclusion" based on faultier, or even non-existent, data, don't you think? Still, her search for sexism does inspire Sands to implement what's by far the most interesting, and certainly the most statistically valid, part of her study - her by-now-notorious "script experiment," in which she sent play excerpts by female playwrights - but attributed to males - to a large sample of theatres. More on that intriguing gambit in the third part of this ongoing series.

Wednesday, July 1, 2009

My last e-mail to Emily

I thought before I posted my thoughts on Emily Glassberg Sands's study on sexism in the theatre, I would first post the e-mail I sent to her on Sunday (to which she has not yet responded):

Hi Emily -

Thanks for talking with me yesterday, however "contentious" the conversation might have been!

To follow up on our discussion, I wanted to offer you (as promised) the chance to respond to a few questions I have about your study via e-mail.

Let me say upfront, however, if I never got a chance to during our conversation, that I greatly admire the amount of work you put into the study, and I think the "audit survey" portion of the paper is brilliant.

But as I mentioned in our talk, I'm having some trouble with your final arguments regarding Broadway productions.

My questions about that portion of the study are the following:

First, I wanted to return to my concerns about your "female writer" sample, because I admit I got a little confused during our discussion and didn't quite ascertain the following: did you code musicals with a female book writer as "entirely" written by a woman? That's my interpretation of the text of your study, but I just wanted to check to make sure, because I think most theatre people would consider the composer the salient "writer" of most high-profile musicals. And if you are considering a musical with a female book writer as a "female-written show," could that possibly be a driver of the "higher weekly revenue" numbers you discovered?


A slide from Emily Glassberg Sands's presentation in New York.

Second, I remain concerned about the fact that your study relies on a proxy (show type) to approximate profitability of Broadway shows, rather than actual hard data on that profitability. This bothers me particularly because in your NY presentation, despite the use of the show-type proxy in your tables, you nevertheless titled a key slide, "Female-written shows on Broadway are 18% more profitable than male-written shows," [slide reproduced above] while another slide title referenced "higher weekly profits for female-written shows," statements which could reasonably lead the casual reader to assume that you actually have hard data on those profits (when you don't). Will you be changing those titles in any future presentations?

A further question about those proxies. I can see them as indicators in Eq. 6.3 on page 97 (PDF) of your study, and you note below the equation that these should "control partially for production costs" (a key component of profitability). My question is, can you more accurately define "partially"? Did you have average production costs figures for your show type categories, and if so, were these applied to the analysis?

Finally, you mentioned repeatedly during our talk that you weren't going to discuss the "implications" of the study, but would limit your comments to the study itself. My question is, then, whether it concerns you that many descriptions of the study seem to be omitting the problems with the "proxy" you used for profitability in your final chapter? The NY Times "Economix" blog, for instance, said that you "found that shows written by women earned more money than shows written by men," without mentioning that those shows still might not have been more profitable. The New York magazine article about you didn't make this distinction either. I understand your reluctance to comment on the "implications" of your study, but do you worry that the discussion may be being driven by an inaccurate comprehension of your conclusions? And do you think there is a way in which you could address that seeming recurrent mistake?

Again, thanks for your thoughts, and I look forward to hearing from you -

Tom Garvey

Monday, June 29, 2009

Misreading Emily

A friend has pointed me to yet another misreading of Emily Glassberg Sands's paper, here in the Guardian. Again - as in the New York magazine article and the "Economix" blog at the New York Times - the writer repeats the inaccuracy that Ms. Sands measured the profitability of female-written shows on Broadway. And again, she did not measure this. More to follow.

Fisking Emily Glassberg Sands

I finished reading the much-discussed Emily Glassberg Sands study on sexism in the theatre this weekend (and even had a phone conversation with Sands afterward). I must report, however, that the conversation grew "contentious" (as Sands herself put it) as I pressed her on issues regarding the final section of her paper - the part devoted to Broadway productions.

In a nutshell, as I read her paper, I began to have doubts about her data - both her sample of "female-written shows" (which seemed to include musicals which had a female book writer, but a male composer and lyricist), and her "proxy" for the profitability of the shows she was considering. It hadn't really come clear to me when I viewed the PowerPoint presentation that Sands gave in New York that she didn't actually have any hard data about the profitability of these shows (although on a second look, you could probably construe this from the fine print of her tables, and she may have mentioned it during the actual proceedings).

But this issue struck me as key to her argument that producers had ended the runs of female-written shows "earlier" than those of male-written shows. After all, a simple explanation for this might be that producers ended the female-written shows because they weren't as profitable as the male-written shows - perhaps they had higher production costs, for example, which cut into their weekly revenues (or a major star left the production, etc.).

But Sands didn't have this data (which in the text of her study she admits openly - it's hard to come by). Instead, she estimated the variable of production cost by a "proxy" of show type (musical, straight play, one-person show, and "exception"). I couldn't make out from her study, however, how accurate these proxies might be - and I wondered, frankly, if the method she was using was truly valid given that she lacked this hard data.

I therefore felt I was looking at a study in which the final section relied on a possibly questionable sample and a problematic proxy for a central variable. My conversation with Sands, however, yielded little real insight into these issues - perhaps, as she often reminded me, because I'm not as trained in statistical analysis as she is (my "training" goes no further than the standard introductory college course, taken some twenty years ago).

So I'm throwing open an invitation to any reader with a sophisticated statistics background - would you care to more thoroughly fisk Ms. Sands's thesis? I can email you her study, which I've downloaded (contact me at hubreview@hotmail.com), or you can find it here. If my doubts about her methodology turn out to be ill-founded, of course, I'll happily publish those findings. (It's entirely possible, too, that if hard data on profitability were available, it would back up Ms. Sands.) In the meantime, I've emailed Ms. Sands my questions in the hopes that the explanation which eluded us in conversation can be found via printed text.

I'll be following up later this week, so stay tuned . . .