U.S. Federal Government Handling of Data for Open Government Data in Japan

jumentousmanlyInternet and Web Development

Oct 21, 2013 (3 years and 7 months ago)

73 views


1


U.S. Federal Government Handling of Data for Open
Government Data in Japan

Dr. Brand Niemann

Director and Senior Data Scientist

Semantic Community

http://semanticommunity.info


http://gov.aol.com/bloggers/brand
-
niemann/


703
-
268
-
9314


Slides

Report

Abstract

Semantic Community has a NIEM and Open Government Data Strategy that consists of the following:



Open Source
Platform for Creating Knowledge Bases:

o

HTML 5

o

Well
-
defined URLs

o

APIs



Machine
-
readable Semantic Web


Linked Data Formats:

o

Subject

o

Object

o

Predicate



Data Science Analytics:

o

Federation

o

Visualizations and Statistics

o

Network Graphs

This Supports Building a Digi
tal Government by Example like Federal CTO Todd Park suggested

"by
people with technical expertise, an accomplished history, and a passion for disruption."

The

NIEM and Open Government Data Strategy has been applied to the Japanese Open Government
Data and

presented in

A Japan METI Open Data Dashboard.

Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and
Communications have an excellent Open Government Data Strategy and Implementation Plan starting
at the top wit
h the Prime Minister and striving to benefit from the experience in the US with Data.gov
and NIEM.

The Data Science/Data Journalism stories I have written about the following topics: Data Act of 2013,
Big Data, Data Apps, Shared Services, Information Shari
ng Environment (ISE), Dashboards, Semantic
Web, Semantic Interoperability, National Information Exchange Model (NIEM), Data.gov and

2


Alpha.Data.gov Audits, Presidential Innovation Fellows, Federal Statistics, Open Government
Data,

DoD Enterprise Information

Web, Data.gov.uk, Digital Agenda for Europe, and Federal Digital
Government Strategy, are helpful to dist
i
ll the US Federal government experience and lessons learned
that benefit other governments.

A recent story: What Has Todd Park Been Doing with Open G
overnment Data and How Can He Help
the Japanese Government? audits the new Alpha.Data.gov whose theme is: "A collection of open data
from government, the private sector, and non
-
profits that are fueling a new economy", and found that
most of the new collec
tion were services and not data downloads, but uploads of your data!

Introduction

This final report is in response to the

Request for Research on U.S. Federal Government Handling
of
Data and Messages (NIEM)

by the Japanese Ministry of Economy, Trade, and Industry (
METI
).

This report shows how METI and MIC can benefit from the experience of the US Data.gov and other
Open Government Data initiatives by starting with the right data first and using it to guide the
categorization/classification and use of other data sou
rces.

The interim report was organized as follows:

2. Open Data in Japan

3. Background Research

4. Results

5. Conclusions and Recommendations

Appendice
s

The final report is organized as follows:

Open Data in Japan

My Stories

Recent Research

Results

Conclusions and Recommendations

Appendices

Please note that this entire report can be searched using the Google Chro
m
e Browser function "Find",
and illustrates the use of advanced Web

technologies for delivering content and data according to the
recent

US Digital Government Strategy

on both standard desktop and m
ob
i
le devices. Also please note
that this page can be saved as a PDF and printed by using the "More" function in the menu above.




3


Open Data in Japan

Previously, Prime Minister Noda said about Open Data:


“e
-
Gov

Open Data Strategy is very important in terms of enhancing transparency and trust
of government, and economic revitalization by creating new market. Based on the strategy,
I hope agencies disclose public data

proactively, and explore practical means to pr
omote its
reuse.”

See complete

slides

and reference

2



Recently, the slides for

Open Government Data In Japan January 2013

have been updated and shared
for this final report and selected slides have
been used here for highlights.



OPEN GOVERNMENT DATA STRATEGY



4


OPEN DATA HISTORY






5


DATA METI PLAN



6




7








8


BEST PRACTICES






9


CHALLENGES






10


Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and
Communications have an excellent Open Government Data Strategy and Implementation Plan starting
at the top with the Prime Minister and striving to benefit from the experience in the US with Data.gov
and NIEM.

The Interim Report addressed the

Research Needs

(The scope and specifics of the data to be
disclosed, History, Survey Questions, and Goals) and provided the Background Resea
r
ch Results
below:

The relevant information about Data.gov was extracted in an

Appendix



The complete US Open Government Directive is also in an

Appendix



The complete

EU’s PSI Directive on Re
-
use of Public Sector Information 2003 and

UK Open
Government Licen
s
e are

also in an

Appendix

and

Appendix
, respectively.



The SEMIC.EU Framework dev
eloped by the

author

is shown in the table below. This inclu
des the
names of key people that I have interviewed for my data journalist stories and that we could interview
again.




11


Table Framework for The Evolution of Working w
ith Open Government Data



Focus

Examples

Key Persons

Reference

Results

Messages

Person

Donna Roy and
Anthony Hoang,
U.S. Department. of
Homeland Security
(DHS), National
Information
Exchange Model
(NIEM)

NIEM

NIEM 2011
National
Training Event
August 23

㈵2
㈰ㄱ
;

Build
the
义EM fE偄P
Cle慲anghou獥s
in the Cloud
;


偬慮 fo爠p捡cing
义EM to Big
䑡aa
;

A獳敳獭
ent 剥oo牴

pe浡mti挠
A獳整s

so捡扵l慲aes

s慳ailio猠
健物獴e牡猬

Eu牯pe慮
Co浭m獳sonI
fnte牯pe牡扩lity
polution猠fo爠P
ubli挠
Ad浩ni獴牡rion猠
⡉pA) 啮itI
pe浩挮eu A䑍a

ptudies

2011
Keynote

and

D
ata as a first
Class Citizen

Data Catalogs

Data.gov

Jeanne Holm,
Data.gov, U.S.
General Services
Administration,
Evangelist for
Data.Gov

Data.gov

2012
International
Open
Government
Data
Conference

Semantic
Enhancements

SEMIC.
EU

Brand Niemann,
Semantic
Community

Semantic Community

Build
SEMIC.EU

in
the Cloud

Data Tables

US Annual
Statistical
Abstract
and EU
EuroStat

Robert Groves,
former director, US
Census Bureau

FedStats.net

and

EuroState

Yearbook

Using Data
Science as
Evidence in
Public Policy
With Big Data
and

Elections

Big Data

Semantic
Medline

Tom Rindflesh, NLM

Semantic Medline

Federal SOA
Bi
g Data Pilots

Business
Systems

Government

Frank Buytendijk

Chief Marketing
Officer

Be Informed

Be Informed

Newsletter

METI and MIC officials will be meeting with senior US government DHS NIEM and ISE, DoJ, HHS, and
GSA OGD offic
i
als in upcoming meetings:

February 12
-
14 2013 Meetings

and have their key questions
answered:

Upcoming Meeting Questions for NIE
M and ODG Leaders
. They will also meet with
representatives of OMG and Industry (Oracle, Model
-
Driven Solutions, and Semantic Community).


12


My Stories

I have written about the following topics: Data Act of 2013, Big Data, Data Apps, Shared Services,
Information Sharing Environment (ISE), Dashboards, Semantic Web, Semantic Interoperability,
National Information Exchange Model (NIEM), Data.gov and Alpha.Data.gov Audits, Presidential
Innovation Fellows, Federal Statistics, Open Government Data,

DoD Enter
prise Information Web,
Data.gov.uk, Digital Agenda for Europe, and Federal Digital Government Strategy.

My Stories

I selected to summarize here tha
t relate specific
all
y to the ISE/NIEM and Open
Government Data are:



The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for
the 113th Congress



From the Year of Big Data to the Year of the Data Scientist Working
With Big Data



My EPA Green Apps Data App



Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event



Federal Government Going in Different Directions on Data and Information Sharing



What's on My Dashboard Today?: The Dis
trict of Columbia Data Catalog and 311 Message Service



A Semantic Web Strategy for Big Data Discussion Meeting



What's on My Dashboard Today? Great East Japan Earthquake Statistics



The EuroStat Regional Yearbook for Semantic Interoperability



Semantic Intero
perability Conference 2012: Get Back to the Future!



EnergyData.gov: Fact Checking Comes Up Short



Open Data Exchange Will Help NIEM and the ISE
-
PM With Its Problems



BIG DATA at the Hill: Demystified and Actionable



SafetyData.gov Review: Long On Text, Short
On Data Tables



Open Government Data and Statistical Data: Haven't We Been Here Before?



Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was
Made



ISE is in a State of Confusion



Imagine if the ISE Did Not Even
Know How to Use the Web Effectively



FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere



FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to
citizens everywhere



Is
There a Business Case for Open Government Data?



Digital Agenda For Europe: Data as first
-
class citizen



A Plan for Scaling NIEM to Big Data



Data.gov Developers Community Space Launched
-

Is Dr. Merkin In the House?



DoD Enterprise Information Web Market Resea
rch for Innovation



Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)



METI Adopts Desktop
-
As
-
A
-
Service Cloud Computing



Data.gov Goes To India
-

But It Still Needs More Work



U.S.
-
India Joint Commission on Science and Technology Cooperation Annou
nces Accomplishments



Data.gov.uk
-

What's Not to Like



DoD Seeks IT Interoperability With Enterprise Information Web



Build The NIEM Information Exchange Clearinghouse In The Cloud


13


The Data Science/Data Journalism stories I have written are helpful to dist
i
l
l the US Federal
government experience and lessons learned that benefit

other governments.

Recent Research

What Has Todd Park Been Doing with Open Government Data and How Can He Help the
Japanese Government?

Federal CTO Todd Park had invited me to learn mo
re about his work with Open Government Data
(OGD) last fall:

Hi Brand, hope all is terrific with you! Was writing to see if you might be interested in coming to visit
with us to have a wide
-
ranging, off
-
the
-
record, for
-
background discussion about Safety
and Energy
data.


We’ve read your audits with great interest
--

we have additional information that you may find
useful, and are also working on a broad array of items in the spirit of constant improvement of
everything we’re doing; would love your input a
nd thoughts to help inform these efforts! All the best,
Todd

As a data journalist, I kindly deferred Todd's invitation because my work for AOL government is on the
record. But I have been following Todd Park's Tweets and activities with interest, especiall
y since the
Japanese Government has asked me to help them start their OGD Program.

Interestingly Todd's

Tweets this month

mentioned the Presidential Ina
u
guration Event
on


Technological Innovation and Job Creation
", but not his report to the

President’s Council of
Advisors on Science and Technology (PCAST) which is available in

video

and has received at least
one

comment

that says:

"It is good to hear OMB will be issuing a policy to make op
en, machine
-
readable data the default for
U.S. federal agencies.

The requirement to provide data in machine
-
readable format is already
referenced in the

U.S. Code

in about 40 places."

So I

auditied

the new

alpha.data.gov

site and found that I had previously worked with the data
at

Energy
,

Health
,

Education
, and

Finance

links given, but links to the 37 examples of data sets in
action were not given so I researched them using Google Search and found that most were services
and not data downloads, but uploads of your d
ata!

The new theme of Alpha.Data.gov is: A collection of

open data

from government, the private sector,
and non
-
profits that are fueling a

new economy
.

My audit of

alpha.data.gov

for Todd Park and others is contained in a machine
-
readable Semantic
Web


Linked Data format

spreadsheet
.




14


Results

The author was asked to help arrange a series of meetings and presentations for

February 12
-
14
2013

for the following:

Mr. Kenji Hiramoto, Executive Advisor for CIO at METI

Mr. Shuichi Tashiro, Head of International Standardization Promotion Center at IPA (IT Promotion
Agency),


METI's IT agency

Mr. Hajime Horiuchi, Former Professor at TIU, and

Mr. Seiichi Nobuhara, CEO &
President at IBT

METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and
C
ommunications

The author hopes to add the H
i
ghlights of these meetings to the report afterwards:

Tuesday, February 12, 2013

Highlights

Wednesday, February 13, 2013

Highlights

Thursday, February 14, 2013

Highlights

NIEM Town Hall February 14th!

Highlights

and complete the

Upcoming Meeting Questions for NIEM and ODG Leaders
.

The authors results are
summarized in the slide presentat
ion below.

Conclusions and Recommendations

This report shows how METI and MIC can benefit from the experience of the US Data.gov and other
Open Government Data initiatives by starting with the right data first and using it to guide the
categorization/class
ification and use of other data sources.

Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and
Communications have an excellent Open Government Data Strategy and Implementation Plan starting
at the top with the Pr
ime Minister and striving to benefit from the experience in the US with Data.gov
and NIEM.

The Data Science/Data Journalism stories I have written about the following topics: Data Act of 2013,
Big Data, Data Apps, Shared Services, Information Sharing Envir
onment (ISE), Dashboards, Semantic
Web, Semantic Interoperability, National Information Exchange Model (NIEM), Data.gov and
Alpha.Data.gov Audits, Presidential Innovation Fellows, Federal Statistics, Open Government
Data,

DoD Enterprise Information Web, Da
ta.gov.uk, Digital Agenda for Europe, and Federal Digital
Government Strategy, are helpful to dist
i
ll the US Federal government experience and lessons learned
that benefit other governments.

A recent story: What Has Todd Park Been Doing with Open Governmen
t Data and How Can He Help
the Japanese Government? audits the new Alpha.Data.gov whose theme is: "A collection of open data
from government, the private sector, and non
-
profits that are fueling a new economy", and found that
most of the new collection wer
e services and not data downloads, but uploads of your data!