[Note: This post was a DHNow Editor’s Choice on May 1, 2012.]
The research I am doing presently uses visualizations to show latent patterns that may be detected in a set of poems using computational tools, such as topic modeling.Â In particular, Iâ€™m looking at poetry that takes visual art as its subject, a genre called ekphrasis, in an attempt to distinguish the types of language poets tend to invoke when creating a verbal art that responds to a visual one.Â Studying wordsâ€™ relationships to images and then creating more images to represent those patterns calls to mind a longstanding contest between modes of representationâ€”which one represents information â€œbetterâ€?Â Since my research is dedicated to revealing the potential for collaborative and kindred relationships between modes of representationÂ historicallyÂ seen in competition with one another, using images to further demonstrate patterns of language might be seen as counter-productive.Â Why use images to make literary arguments? Do images tell us something â€œnewâ€ that words cannot?
Without answering that question, Iâ€™d like instead to present an instance of when using images (visualizations of data) to â€œseeâ€ language led to an improved understanding of the kinds of questions we might ask and the types of answers we might want to look for that wouldnâ€™t have been possible had we not seen them differentlyâ€”through graphical array.
Currently, Iâ€™m using a tool called MALLET to create a model of the possible â€œtopicsâ€ found in a set of 276 ekphrastic poems.Â There are already several excellent explanations of what topic modeling is and how it works (many thanks to Matt Jockers, Ted Underwood, and Scott WeingartÂ who posted these explanations with humanists in mind), so Iâ€™m not going to spend time explaining what the tool does here; however, I will say that working with a set of 276 poems is atypical.Â Topic modeling was designed to work on millions of words, and 276 poems doesnâ€™t even come close; however, part of the project has been to determine a threshold at which we can get meaningful results from a small dataset.Â So, this particular experiment is playing with the lower thresholds of the toolâ€™s usefulness.
When you run a topic model (train-topics) in MALLET, you tell the program how many topics to create, and when the model runs, it can output a variety of results. Â As part of the tinkering process, Iâ€™ve been working with the number of topics to have MALLET use in order to generate the model, and was just about to despair that the real tests I wanted to run wouldnâ€™t be possible at 276 poems. Â Perhaps it was just too few poems to find recognizable patterns. Â For each topic assignment, MALLET assigns an ID number to the topic and “topic keys” as keywords for that topic. Â Usually, when the topic model is working, the results are â€œreadableâ€ because they represent similar language. Â MALLET would not call a topic “Sea,” for example, but might instead provide the following keywords:
blue, water, waves, sea, surface, turn, green, ship, sail, sailor, drown
The researcher would look at those terms and think, â€œOh, clearly thatâ€™s a nautical/sea/sailingâ€ topic, and dub it as such.Â My results, however, on 15 topics over 276 poems were not readable in the same way.Â For example, topic 3 included the following topic keys:
3Â Â Â Â Â Â Â Â Â 0.04026Â Â Â Â Â Â Â Â Â Â with self portrait him god how made shape give thing centuries image more world dread he lands down back protest shaped dream upon will rulers lords slave gazes hoe future
I donâ€™t blame you if you donâ€™t see the pattern there.Â I didnâ€™t.Â Except, well, knowing some of the poems in the set pretty well, I know that it put together â€œLandscape with the Fall of Icarusâ€ by W.C. Williams with â€œThe Poem of Jacobus Sadoletus on the Statue of Laocoonâ€ with â€œThe New Colossusâ€ with â€œThe Man with the Hoe Written after Seeing the Painting by Millet.â€Â I could see that we had lots of kinds of gods represented, farming, and statues, but thatâ€™s only because I knew the poems. Â Without topic modeling, I might put this category together as a â€œmastersâ€ grouping, but itâ€™s not likely. Â Rather than look for connections, I was focused on the fact that the topic keys didnâ€™t make a strong case for their being placed together, and other categories seemed similarly opaque.Â However, just to be sure that I could, in fact, visualize results of future tests, I went ahead and imported the topic associations by file.Â In other words, MALLET can also produce a file that lists each topic (0-14 in this case) with each file name in the dataset and a percentage.Â The percentage represents the degree to which the topic is represented inside each file.Â I imported the MALLET output of topics and files associated with them into Google Fusion Tables and created a dynamic bar graph that collects file-ids along the vertical axis and along the horizontal axis can be found the degree that the given topic (in this case topic 3) is present in the file.Â Â As I clicked through each topicâ€™s graph, I figured I was seeing results that demonstrated MALLETâ€™s confusion, since the dataset was so small.Â But then I saw this: [Below should be a Google Visualization. Â You may need to “refresh” your browser page to see it. Â If you still cannot see it, a static version of the file is visible here.]
If the graphâ€™s visualization is working, when you pass your mouse over the lines in the bar graph, the ones that are higher than 0.4, then the file-id number (a random number assigned during the course of preparing the data) appears. Â Each of these files begin with the same prefix: GS. Â In my dataset, that means that the files with the highest representation of topic 3 in them can all be found in John Hollanderâ€™s collection The Gazerâ€™s Spirit.Â This anthology is considered to be one of the most authoritative and diverseâ€”beginning with classical ekphrasis all the way up to and including poems from the 1980s and 1990s.Â I had expected, given the disparity in time periods, that the poems from this collection would be the most difficult to group together because the diction of the poems changes dramatically from the beginning of the volume to the end.Â In other words, I would have expected the poems to blend with the other ekphrastic poems throughout the dataset more in terms of their similar diction than by anything else.Â MALLET has no way of knowing that these files are included in the same anthology.Â All of the bibliographical information about the poems has been stripped from the text being tested.Â There has to be something else.Â What something else might be requires another layer of interpretation.Â I will need to return to the topic model to see if a similar pattern is present when I use Â other numbers of topicsâ€”or if I include some non-ekphrastic poems to the set being testedâ€”but seeing the affinity in language between the poems included in The Gazerâ€™s Spirit in contrast to other ekphrastic poems proved useful. Â Now, Iâ€™m not inclined to throw the whole test away, but instead to perform more tests to see if this pattern emerges again in other circumstances.Â Iâ€™m not at square one. Iâ€™m at a square 2 that I didnâ€™t expect.
The visualization in the end didnâ€™t produce â€œnew knowledge.â€Â It isnâ€™t hard to imagine that an editor would choose poems that construct a particular argument about what â€œbestâ€ represents a particular genre of poetry; however, if these poems did truly represent the diversity of ekphrastic verse, wouldnâ€™t we see other poems also highly associated with a â€œGazerâ€™s Spirit topicâ€?Â What makes these poems stand out so clearly from others of their kind?Â Might their similarity mark a reason for why critics of the 90s and 2000s define the tropes, canons, and traditions of ekphrasis in a particular vein?Â Iâ€™m now returning to the test and to the texts to see what answers might exist there that I and others have missed as close readers.Â Could we, for instance, run an analysis that determines how closely other kinds of ekphrasis are associated with Gazerâ€™s Spiritâ€™s definition of ekphrasis?Â Is it possible that poetry by male poets is more frequently associated with that strain of ekphrastic discourse than poetry by female poets?
This particular visualization doesnâ€™t make an “argument” in the way humanists are accustomed to making them.Â It doesnâ€™t necessarily produce anything wholly â€œnewâ€ that couldnâ€™t have been discovered some other way; however, it did help this researcher get past a particular kind of blindness and helped me to see alternativesâ€”to consider what has been missed along the wayâ€”and there is, and will be, something new in that.