The Programming Historian

Depending on your vantage point, we have a looming opportunity – or a looming problem. Historical digital sources have reached a scale where they defy conventional analysis and now call out for computational analysis. The Internet Archive alone has 2.9 million texts, there are 2.6 million pages of historical newspapers archived at the Chronicling America site of the US Library of Congress, the McCord Museum at McGill University has over 80,000 historical photographs, and Google Books has now digitized fifteen million books out of their total goal of 130 million. Archives are increasingly committed to preserving cultural heritage materials in digital, rather than more traditional analog, forms. This is perhaps best exemplified in Canada by digitization priorities at Library and Archives Canada. The amount of accessible digital information continues to grow daily, making digital humanities projects increasingly feasible, and for that matter, necessary.

In this post, I will do two things. Firstly, I will give a sense of how much information is out there, and make the case for why Canadian historians need to start thinking about it. Secondly, I will introduce readers to the Programming Historian, a wonderful resources that at least puts you on the right track to a programming frame of mind. Read the full post »

Surveying all of cosmic history using ChronoZoom: you can't even see human history up there in the upper right corner.

Historians aren’t always the best at crossing the hall to the sociologists across the way, let alone the astronomers, physicians, or geologists across campus. Scientists who study the Big Bang, however, are engaged in history – just a (very) different kind. Similarly, those who study the very long-term geographical forces that have shaped Earth, those who study evolutionary processes across flora and fauna, even those who study broader, galactic or universal phenomena, are often seen as very distinct from historians.

Big History, a new and emerging field, seeks to bridge these very real but also occasionally artificial disciplinary boundaries. It can be hard, however, to really establish how we can go forward and what a Big History approach might look like in real, deliverable terms (Bill Gates and David Christian have a great project also looking at how to teach these concepts to classrooms). Look no further: ChronoZoom, from the University of California-Berkeley’s Department of Earth and Planetary Science, has a working model that gives us a sense of what this might look like. Read the full post »

What do you want to “calculate or know about,” asks Wolfram Alpha. Voted the best computer innovation of 2009 in Popular Science‘s “Best of What’s New,” Wolfram Alpha lets users interact with over 10 trillion pieces of information curated by a large research team. You just type in what you want to know, the engine tries to figure out what you’re asking it, and you’re presented with a remarkable array of information (as well as ways to refine your subsequent searches). This has tremendous historical applications, both for teaching and for historical research. I’ll show off some of these possibilities in this post, and hope that you take a moment to try it out yourself. If you find anything of particular interest, please let us know in the comments below. Read the full post »

Google Books even has the full text of LIFE magazine!

Organizations, activists, and laypeople are trying to put the sum of all printed knowledge on the internet. They’re facing copyright issues, ethical and moral debates, but it’s marching on nonetheless. Why should we have to travel to archival repositories, especially if they’re in an already convenient form like microfilm? Shouldn’t everybody have access to information, not just the select few who happen to have institutional affiliations? When it comes to access to information, we should be on an even playing field. Lay people interested in history, undergraduates, cash-strapped professional researchers, and all can benefit from several internet resources that put an incredible amount of information at your finger tips.

In this post, I’ll introduce people to the Internet Archive, the Haithi Trust, and Google Books. I hope to show you that there are incredible numbers of primary sources, digitized books, internet snapshots, among other things, out there. From an 1888 report on the Knights of Labor by a Canadian Legislative Committee, to the music video for the “first rap single ever released in Canada,” to American prohibition speeches, they’re all out there – free, accessible, and often downloadable.

Read the full post »

Unigram comparisons for 'nationalize' and 'privatize'

Tracking the rise and fall of ideas throughout fifteen million books would have been impossible. Until now, thanks to the Google Books Ngram Viewer. Much like my previous post on Wordle tried to illustrate, we need to make sense of large quantities of information in order to do ‘big history’ and provide a context into which we can write our smaller studies. They’re also awesome for teaching or just playing around with and having (shock) fun with history.

On the chart at above right, we see a Google Ngram for two phrases: ‘nationalize’ in blue, ‘privatize’ in red. Does it surprise you? The idea of “privatize”ing is almost unheard of until the 1970s, and really picks up stream by the late 1980s and peaks in the 1990s. Conversely, nationalize slowly trends upwards until the 1970s, and then declines. This might not be surprising, but it’s an example. In this post, I’ll tell you what an ngram is, show some cool pictures, and hopefully drive you to have some fun with this. Read the full post »

The 1933 CCF Regina Manifesto (all images produced by Wordle.net)

With politicians out on the hustings, what better time than to go through the old political speeches, manifestos, and platforms. Using Wordle, we can throw them up and look at word clouds. They’re not just pretty, but they can let us see the evolution of political thought and what words were capturing Canadians. They also let us see what things remain the same: most Throne Speeches over the last 15 years are nearly identical, stressing ‘government,’ ‘Canada,’ ‘Canadians, ‘etc. But we can see discontinuities: the 1933 Regina Manifesto, for example, contrasted with contemporary NDP promises and platforms (‘family’ and ‘home’). Reading all the documents might be preferable, but this is quick (it takes a minute to produce the picture at left) and has great possibilities for dealing with large quantities of information. Read the full post »