Prezi

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in the manual

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Public Sector Data

No description
by Helen Ensikat on 7 January 2014

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Public Sector Data

Public Sector Data
Searching beyond the Surface Web.
The groundwork.
Getting the most out of Google.
site:
site:dogecoin.com

site:au

site:gov.au

site:wa.gov.au
An introduction to finding the resources you need.
Making friends with your library.
Using existing research to find leads.
Other humans.
Data quality.
Messy data.
Copyright and referencing.
Useful resources.
What am I looking for?
Why am I looking for it?
time series?
format?
financial?
spatial?
jurisdiction?
subject area?
historical?
live data?
what am I trying to produce?
is the data for me or for someone else?
am I looking for a broad overview?
do I need something very specific?
Where shall I start looking for it?
what agencies might have oversight?
who else might use the same data?
is it something a statistical agency might hold?
do I know that it exists?
is it old enough to have been stored in historical archives?
who might know more about researching the topic?
basic stuff:
-notthisword

-"not this phrase"

"this phrase"

"onlythisword"
trickier stuff:
thisword|andorthisword

"this is * a word"

"this is * * words"

thisword 100..200
Combine!
(intitle:resume OR inurl:resume) (Java AND Agile) (developer OR programmer OR engineer) (Missouri OR MO) -jobs -job
narrow it down:
intitle:searchterm

inurl:searchterm

allintitle:thisterm thatterm

allinurl:thisterm thatterm

filetype:xls
go broader:
link:data.gov.au

related:data.gov.au
Learn more about how Google works:

http://www.google.com/insidesearch/howsearchworks/thestory/
Advanced Search:
http://www.google.com/advanced_search

'Search Tools' button


Google products
Scholar
Books
Image Search
Public Data Explorer
Finance
Maps
http://en.wikipedia.org/wiki/List_of_Google_products
Other specialist search websites and metasearch websites
gopubmed.com
(Bioscience)
infomine.ucr.edu
(Academia)
govpond.com
(Australian Government)
Resource lists
Databases
Ever searched for 'site:gov.au database' ?
Let other people do the work!
The National Library of Australia
online sign up
trove.nla.gov.au
metasearch of Australian State libraries
books and ebooks
photographs and video
maps
journals
newspapers (OCR)
archived websites
diaries and letters
Your State Library
Why sign up?
Depth and breadth of resources
Information you won't find anywhere else
Free ebooks and journal articles
Historical public sector and consultant reports
Friendly librarians!
Beyond the bookshelves.
Researcher registration
Items in the stacks
Microfiche and microfilm records not yet digitised
Maps not yet digitised

In praise of browsing, online and offline:
research by proximity.
Bibliographies in (vaguely) related journal articles and books

Sources mentioned in newspaper articles

Citations on Wikipedia

References in PhDs and Masters theses in university libraries
Choosing the right approach.
what do I think I need?
what is the clearest way to describe what I need?
explain your objective rather than making a data request
if they can't help, can they introduce me to someone who can?
meeting in person yields better results
treat people like expert sources of advice, not gatekeepers (even when they are)
Finding the right person.
authority to provide data
willingness to provide data
access to data
+
+
an understanding of what you're asking for
+
do your homework
Getting in contact with the people in charge.
cold calling and cold emailing
arranging meetings
using intermediaries
asking for introductions
social media
More generally, maintain your networks.
forums
social and professional events
training courses
have coffee with interesting people
social media
ask for introductions
volunteer
have projects
offer help with other people's projects
practical mailing lists
ask for help
Is it good enough to use?
Can I improve or recalculate it?
Do I need to advise my audience about any limitations?
Try online tools.
OpenRefine (formerly Google Refine)
DataWrangler
GoogleDocs (or Adobe) OCR
Data format converters
Try Excel.
Online tutorials and advice
Excel's own functions
Plug-ins and macros available online
No need to code to use the macro recorder to automate repetitive tasks
Code!
Even if you're totally new to programming, you can learn online, and languages like R and Python are great for getting your datasets into shape. (Or, make a coder friend - events like GovHack are great places to make coder friends.)
Give up and do it by hand. (Really.)
Try Google's free courses:

http://www.powersearchingwithgoogle.com/
and their presenter's blog, SearchReSearch:

http://searchresearch1.blogspot.com.au/
might an international organisation have collected it?
Australian Government websites.
data.gov.au
[state].data.gov.au
abs.gov.au
Federal and State lists of department and agency websites
For example: http://australia.gov.au/directories/australian-government-directories/list-of-departments-and-agencies
International resources.
Blogs worth reading.
Learn and network.
Some books.
Finding more tools.
A few of the best.
Other Australian resources.
Welcome!
This workshop provides an introduction to finding public sector data (and data useful to Australian public servants). I'm Helen Ensikat.
ensikat@iinet.net.au @helenensikat
Any questions, or tips and tricks to share?
You can find this slide deck here:
All the links in the presentation are also in a bundle here:
http://bit.ly/
publicsectordataslides
http://bit.ly/
publicsectordatalinks
World Bank
IMF
United Nations
CIA World Factbook
WHO
NASA
NOAA
UNICEF
Information is Beautiful
http://www.informationisbeautiful.net
The Guardian Datablog
http://www.theguardian.com/news/datablog
The Governance Lab @ NYU
http://thegovlab.org
Flowing Data
http://flowingdata.com
Open Knowledge Foundation Blog
http://blog.okfn.org/latest/
Hacks and workshops, like GovHack and HealthHack:
http://www.govhack.org/ http://healthhackmelb.com
Organisations like Open Knowledge Foundation Australia
http://au.okfn.org/working-group/
Interest groups on networks like http://meetup.com
Open Data Handbook:
http://opendatahandbook.org/en/
Data Journalism Handbook:
http://datajournalismhandbook.org/
Beyond Transparency:
http://beyondtransparency.org/
Open Metadata Handbook:
http://en.wikibooks.org/wiki/Open_Metadata_Handbook
search: data visualisation tools beginners
search: free online data conversion
search: [topic] 101 tutorial
search: getting started with [topic]
search: free [topic] lessons videos
Tools and resources come and go, but there are always plenty out there to find.
GovPond: http://www.govpond.org/


AusGOAL: http://www.ausgoal.gov.au/
(Australian Governments Open Access and Licensing Framework)
Training courses (such as those offered across Australia by the ABS).
Australian Institute of Health and Welfare:
https://www.aihw.gov.au/

Australian Bureau of Agricultural and Resource Economics and Sciences:
http://www.daff.gov.au/abares

Bureau of Infrastructure, Transport and Regional Economics:
http://www.bitre.gov.au/

Geoscience Australia:
http://www.ga.gov.au/

CSIRO:
https://data.csiro.au/

Australian Ocean Data Network:
http://portal.aodn.org.au/aodn/

Data and Open Government on Social Media
Sites like Quandl (numerical data), datacatalogs.org, and datahub.io - metasearches, databases of databases, and lists of lists.
Specialised software (like Beautiful Soup), that can help you extract data or do another particular job.
Untangling the Web: A Guide to Internet Research:
http://www.nsa.gov/public_info/_files/Untangling_the_Web.pdf
http://bit.ly/
publicsectordataslides
http://bit.ly/
publicsectordatalinks
See the full transcript