Quantcast
Channel: R Psychologist RSS feed (last 10 posts)
Viewing all articles
Browse latest Browse all 108

Simple data mining and plotting data on a map with ggplot2

$
0
0

Introduction

A Facebook group for psychologists in Sweden created a document where each member could type in were they live and what they work with. At the moment 192 psychologists have added their information to the document. This made me think about how to plot this information using R, and especially how to read data in this format. I was also interested in how to plot this information geographically on a map of Sweden and represent the number of individuals by the size of a circle over the corresponding city.

The data

The document with the data was ordered like this:

1
2
3
4
5
6
7
8
9
CityJaneDoe,title,workplaceetc.JohnDoe,title,workplaceetc.City2JohnDoe,title,workplaceetc.JaneDoe,title,workplaceetc.etc.

Methods

Parsing the data

To get the data into R I copied the Facebook document to a txt-file and used scan() to read it. This saves the text into a vector with each line representing one row. I wrote a function to parse the text and to create a data.frame with the number of people of each city.

Creating the map

To get a map of Sweden I used the OpenStreetMap-package. But since I wanted to plot data on this map I had to grab the coordinates for each city. This was accomplished by using data from the “world.cities”-set which is included in R. However, 5 cities weren’t included in this set so I looked up their coordinates on Google Maps and added them manually. Lastly I converted latitude and longitude into Mercator coordinates since this is the format used when plotting from the OpenStreetMaps-package.

Creating the plot

I used autoplot() to plot the map with ggplot2(). The city data was added as geom_point()-layer with size = number of psychologists in the city.

The resulting plot

where do we liveFigure 1. Plot of where people live, with data taken from a Facebook document.

The R Code

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
Sys.setenv(NOAWT=1)#call this before loading OpenStreetMap
library(OpenStreetMap)
library(rgdal)
library(stringr)
library(ggplot2)

setwd("~/Dropbox/R-projekt/Var bor psykologerna")# Get data for sweden from 'world.cities' dataset
data(world.cities)
sweden.cities <- world.cities[world.cities$country.etc =="Sweden",]################### importing data #################### 'world.cities' didn't have data for all my cities# so I added long and lat for them in excel and saved# the new data as city.txt
sweden.cities <- read.delim("city.txt")# load text file with info about where people live
data.txt <- scan("var.txt", character(0), sep ="\n")# replace swedish å,ä,ö, since the regular expression# wouldn't catch them.
data.txt <- gsub('(å|ä)','a', data.txt, ignore.case =TRUE)
data.txt <- gsub('ö','o', data.txt, ignore.case =TRUE)#################### Extracting data ##################### Use regular expression to extract rows with only # one word, i.e. city headings. Save as boolean. 
txt.pattern <- str_detect(data.txt,"^[[:alpha:]]*$")# Create a list of city names
cities.txt <- grep("^[[:alpha:]]*$", data.txt, value=T)# Create empty variables for each cityfor(i in1:length(cities.txt)){
  assign(cities.txt[i],0)}# Count number of rows after each city heading# and assign that number to the corresponding city-variable
x <-0# row count
y <-0# index for cities.txtfor(i in1:length(data.txt)){if(txt.pattern[i]==TRUE){if(y !=0) assign(cities.txt[y], x)
    x <-0
    y <- y +1}else x <- x +1}# Combine individual city variables into one data.framefor(i in1:length(cities.txt)){
  cities <- cities.txt[i]
  people <- eval(parse(text = cities))if(i ==1){
    df <- data.frame("cities"= cities,"people"= people)}else df <- rbind(data.frame("cities"= cities,"people"= people), df)}# remove dummy row 'end'
df <- df[-1,]# add capital letter for 'gsub'ed words.
df$cities <- as.character(df$cities)
df$cities[1]<-"Ostersund"
df$cities[2]<-"Ornskoldsvik"
df$cities[3]<-"Orebro"# Get city long/lat data
match <- match(df$cities, sweden.cities$name)
df.coords <- sweden.cities[match,]# add number of psychologists per city
df.coords <- cbind(df.coords,"people"= df$people)# convert long/lat to Mercator coordinates
df.coords <- cbind(df.coords,projectMercator(df.coords$lat,df.coords$long))# clean up workspace
list <- ls()
list <- list[-grep("df.coords", list)]
rm(list=list)
rm(list)# get openmap for sweden
mp <- openmap(c(69.2,9.303711), c(54,24.433594), zoom=6, type="osm")######### Plot #########
autoplot(mp)+
       geom_point(aes(x,y, size=people, color=people),
                  alpha = I(8/10), data=df.coords)+
       opts(axis.line=theme_blank(),axis.text.x=theme_blank(),
       axis.text.y=theme_blank(),axis.ticks=theme_blank(),
       axis.title.x=theme_blank(),
       axis.title.y=theme_blank())+
      scale_size_continuous(range= c(1,25))+
       scale_colour_gradient(low="blue", high="red")+
       opts(title="Where do we live?")# save plot
ggsave("plot.png", dpi=600)

Viewing all articles
Browse latest Browse all 108

Trending Articles