Easy tools for processing and exploring data

This content is not yet complete. In the meantime, see this presentation: Easy tools for processing and exploring data (pdf, gd)

Data processing

Assignment: data processing tools

Further resources

Data exploration

Visualisation

Visualisation is the act of taking data and transforming it into visual shapes and forms. The reasoning behind this is that humans are very good at processing visual information, with a lot of the necessary shape and anomaly detection and comparison processes even happening subconsciously.

Most visualisation is explanatory. https://pudding.cool/2017/05/song-repetition/

Assignment

Read Perception deception & Common visualization mistakes. The articles are primarily oriented around explanatory data visualisation, but most computational humanities data analysis is exploratory. How do the problems transfer into that domain, when the only one you can deceive is yourself?

Assignment: data exploration tools

Experiment with at least one of the following tools:

  • tabular data → chart visualisations: RAW

  • tabular data → chart visualisations: Voyager

  • tabular data → chart visualisations: ​Tableau

  • tabular data → ​interactive map/network/timeline/list/facet visualisations: Palladio

    • Palladio has help pages. There are also multiple tutorials on using Palladio, for example this one, or this one which is particularly on network analysis.

  • tabular data → map(+timeline) visualisations: ​Carto

  • ​text →​ interactive explorative interface for linguistic study: Voyant tools

  • ​big, preselected collections of text → interface for linguistic study: Korp / corpus.byu.edu

  • If you're feeling explorative, feel free to also dig for more tools in TAPoR.

If you're short on inspiration, feel free to go through this hands-on tutorial covering OpenRefine, RAW and Palladio.

Afterwards, post a message on #tools on Slack detailing:

  1. What is the tool good for?

  2. What kind of data do you need for the tool to be useful?

    1. What information does the data need to contain?

    2. What format does it have to be in?

  3. Your experience with the tool.

If someone has already posted on the tool you tested, don't repeat them. Instead, add to what they've said in a thread.

Assignment: visualisation tool development

Read the following two research articles on developing visualisation tools for particular text-based humanities research questions:

Now, think of a visualisation that would help you in your field. What information would it visualise? Post a message on #tools on Slack

Resources