オープンデータ流通推進コンソーシアム オープンデータ化のための技術...

Click here to load reader

Upload: lara-morse

Post on 02-Jan-2016

24 views

Category:

Documents


0 download

DESCRIPTION

資料 2-5. 平成 25 年度 技術委員会. オープンデータ流通推進コンソーシアム オープンデータ化のための技術 ガイド骨子案. 2014.02.14 オープンデータ流通推進コンソーシアム 事務局. 「オープンデータ化のための技術ガイド」の作成目的・作成方針. 作成目的 これからオープンデータ化に 取り組もうと する公的機関や民間組織の職員が、保管しているデータをオープンデータ化する ため に必要な技術的事項の解説を行う。 オープンデータ化を始めるための手引き 保管しているデータをオープンデータとして整備するための手引き 作成方針 - PowerPoint PPT Presentation

TRANSCRIPT

2014.02.14

252-5 2014 Open Data Promotion Consortium. All Rights Reserved.(*1)(*1)(*2)FAQ

2(*1) http://www.kantei.go.jp/jp/singi/it2/densi/(*2) 3-3, 3-4 2014 Open Data Promotion Consortium. All Rights Reserved.3 4 6Getting Started: 122553 2014 Open Data Promotion Consortium. All Rights Reserved.1. 4 2014 Open Data Promotion Consortium. All Rights Reserved.: 2012.07 ITG82013.062013.06 2013.06 2013.10 CIOOpen Data METI2: :: FAQ5 2014 Open Data Promotion Consortium. All Rights Reserved.Getting Start:

6 2014 Open Data Promotion Consortium. All Rights Reserved.2.7 2014 Open Data Promotion Consortium. All Rights Reserved.OpenDefinition.org Open data is data that can be freely used, reused and redistributed by anyone.5Open DataPDFExcelWordCSVURILinked Open Data(*)20136 IT8(*) 20136 IT http://www.kantei.go.jp/jp/singi/it2/densi/ 2014 Open Data Promotion Consortium. All Rights Reserved.G8201320142013.10 CIO(*5)25272013.06(*4)API(*10)2013.06 92012.07IT (*1)Open Data METI(*6)2013.01 XML(*8)(*9)2013.05 (*7)2013.04 2013.06 (*3)DATA.GO.JP(*11)2013.12 (*1) http://www.kantei.go.jp/jp/singi/it2/denshigyousei.html(*2) http://www.kantei.go.jp/jp/singi/it2/kettei/pdf/20130614/siryou1.pdf(*3) http://www.kantei.go.jp/jp/singi/keizaisaisei/pdf/saikou_jpn.pdf(*4) http://www.kantei.go.jp/jp/singi/it2/kettei/pdf/20130614/siryou3.pdf(*5) http://www.kantei.go.jp/jp/singi/it2/cio/dai53/plan_jp.pdf(*6) http://datameti.go.jp/(*7) http://www.soumu.go.jp/menu_news/s-news/01tsushin02_02000053.html(*8) http://xml.kishou.go.jp/(*9) http://www.data.jma.go.jp/gmd/risk/obsdl/(*10) http://statdb.nstac.go.jp/system-info/api/(*11) http://data.go.jp/2013.06IT (*2) 2014 Open Data Promotion Consortium. All Rights Reserved.G8 summit(2013.06.18)5Open Data by DefaultQuality and QuantityUsable by AllReleasing Data for Improved GovernanceReleasing Data for InnovationCreative Commons

10 2014 Open Data Promotion Consortium. All Rights Reserved.11 http://www.kantei.go.jp/jp/singi/it2/pdf/120704_siryou2.pdf 2014 Open Data Promotion Consortium. All Rights Reserved.3. Getting Started:12 2014 Open Data Promotion Consortium. All Rights Reserved.: DATA.GO.JPURL: WebURLAPI: ( :FAQ

13 2014 Open Data Promotion Consortium. All Rights Reserved. 14Ahttp://Bhttp://Chttp://X.

[][km2]X1,234,0003,456.00Y 789,0001,357.00Z555,0002,345.00AB 2014 Open Data Promotion Consortium. All Rights Reserved.Level 0Level 1Level 2Level 3PDFWebWebCSV, XLS, DOC4RDFXMLCSVRDFSPARQLWebWebWebCKANWebCKANLevel 1Level 2Level 3 15 2014 Open Data Promotion Consortium. All Rights Reserved.IDIDIDucodeDoIDigital Object IdentifiersISO 6523ii.URIUniform Resource IdentifierWebURLUniform Resource LocatorURI

16 2014 Open Data Promotion Consortium. All Rights Reserved.ucodeDoI

URL

1712345urn:ucode:_00001C0000000000000100000001234512345http://dx.doi.org/10.1021/xxx12345ucodeDoIucodeIDIDDoIID12345http://exapmle.org/xxx/12345URLIDIDID 2014 Open Data Promotion Consortium. All Rights Reserved.182. 1. 3. 4. 5. 6. 2014 Open Data Promotion Consortium. All Rights Reserved.1.

19 2014 Open Data Promotion Consortium. All Rights Reserved.2. 11FAQ

20 2014 Open Data Promotion Consortium. All Rights Reserved.3. p.1521 2014 Open Data Promotion Consortium. All Rights Reserved.4. 22 2014 Open Data Promotion Consortium. All Rights Reserved.5.

23 2014 Open Data Promotion Consortium. All Rights Reserved.6.

3.

24 2014 Open Data Promotion Consortium. All Rights Reserved.4. 25 2014 Open Data Promotion Consortium. All Rights Reserved.26 2014 Open Data Promotion Consortium. All Rights Reserved.: 2112228303142454850

27 2014 Open Data Promotion Consortium. All Rights Reserved.i. 3: DATA.GO.JPURL:WebURLAPI: ( :FAQ

28 2014 Open Data Promotion Consortium. All Rights Reserved.i.

2pdf 29 2014 Open Data Promotion Consortium. All Rights Reserved.ii. 305 open data

234xls (Microsoft ExcelCSVxlsx (Office Open XML) ods (OpenDocument)JSONRDF/XMLRDF/JSON, JSON-LDNotation3TurtleRDFPDF (Acrobat )doc (Microsoft Word)HTMLXMLdocx (Office Open XML)odt (OpenDocument)RDFashapeKMLGML(TXT) 2014 Open Data Promotion Consortium. All Rights Reserved.iii. CSVRFC4180(*)field: 11record: 11header: 1file:

ABCD1-4.50.51.611.32-6.8-2.10.48.43-2.41.93.813.540.23.46.517.331(*) Common Format and MIME Type for Comma-Separated Values (CSV) Files. RFC4180.http://www.ietf.org/rfc/rfc4180.txt 2014 Open Data Promotion Consortium. All Rights Reserved.iii. 111121,000,000XMLRDF

32RFC4180 2014 Open Data Promotion Consortium. All Rights Reserved.iii. 111RFC4180There maybe an optional header line appearing as the first line of the file with the same format as normal record lines. This header will contain names corresponding to the fields in the file and should contain the same number of fields as the records in the rest of the file.1Within the header and each record, there may be one or more fields, separated by commas. Each line should contain the same number of fields throughout the file. 12RFC418031411133 2014 Open Data Promotion Consortium. All Rights Reserved.iii.

34ABCD20131-4.50.51.6(*1)11.32-6.8-2.10.48.43-2.41.93.813.540.23.46.517.3(3) 1.6(*1)(*1)(*1)1.6(4) (5) 1420132013(6) 2014 Open Data Promotion Consortium. All Rights Reserved.iii.

35ABCD20131-4.50.51.611.320132-6.8-2.10.48.420133-2.41.93.813.5201340.23.46.517.336 2014 Open Data Promotion Consortium. All Rights Reserved.iii. 1,000,000723 simple data format78JISISO-2022-JPShift-JISEUCUTF-8UTF-8Microsoft ExcelShift-JISCSVUTF-8CSVUTF-8Openoffice.orgCSVUTF-8nkf36 2014 Open Data Promotion Consortium. All Rights Reserved.iii. XMLRDF9simple data format910XMLRDF37 2014 Open Data Promotion Consortium. All Rights Reserved.Simple Data FormatSimple Data Format(*1)Data Packages(*2)JSON Table Schema(*3)CSVCSVJSONnamelicensesdatapackages_versionresourcesCSVurlURLpathschemaurlpathCSVfieldsCSVnametypestring, number, integer, date, time, datetime, boolean, binary, object, geopoint, geojson, array, anydescriptionRDFSimple Data FormatSimple Data FormatUTF-8Simple Data FormatCSVUTF-8Simple Data Format7CSV23W3CCSV on the Web Working Group Charter(*4)RFC 4180Simple Data FormatSimple Data Format38(*1) http://dataprotocols.org/simple-data-format/(*2) http://dataprotocols.org/data-packages/(*3) http://dataprotocols.org/json-table-schema/(*4) http://www.w3.org/2013/05/lcsv-charter/ 2014 Open Data Promotion Consortium. All Rights Reserved.Simple Data FormatSimple Data Formatp.3139{ name: ", "resources": [ { "path": "data.csv", "schema": { "fields": [ { name: ", "type": integer" }, { name: ", "type": "integer" }, { name: A", "type": "number, "unit": deg_c" }, , ] } } ]} my-dataset data.csv1: 2: 3: A

2014 Open Data Promotion Consortium. All Rights Reserved.40(2) 1. 1 1 12. 33. 64. 35. 46. 57. 1 18. 7 2014 Open Data Promotion Consortium. All Rights Reserved.411. 11 12. 33. 64. 35. 46. 57. 1 18. 79. Simple Data Format10. 11. 912. XMLRDF 913. XMLRDF 10 2014 Open Data Promotion Consortium. All Rights Reserved.iv. 1211HTML2314342 1.1 OpenDefinition.org1

http://data.gov/http://data.go.uk/http://data.go.jp/1: http://example.org//.csv 2014 Open Data Promotion Consortium. All Rights Reserved.43(2) 1. 12. 2(3) 1. 2. 33. 2014 Open Data Promotion Consortium. All Rights Reserved.441. 12. 23. 4. 1 35. 36. 4 2014 Open Data Promotion Consortium. All Rights Reserved.v. 121ITRF400mGIS245 2014 Open Data Promotion Consortium. All Rights Reserved.46(2) 1. 1(3) 1. ISO JIS JPGISJMP 2014 Open Data Promotion Consortium. All Rights Reserved.471. 12. 3.XMLRDF 2 2014 Open Data Promotion Consortium. All Rights Reserved.vi. 1121,213Streams APIRDF48 2014 Open Data Promotion Consortium. All Rights Reserved.491.2 22. 33. 3 2014 Open Data Promotion Consortium. All Rights Reserved.vii. Microsoft OfficeOpenOfficeAcrobatApache Tika(*)

50(*) http://tika.apache.org/ 2014 Open Data Promotion Consortium. All Rights Reserved.51

Open Office 4 WriterApache Tika{ "dc:creator":"", "dc:title":"", "dcterms:created":"2014-01-27Txx:xx:xx", "dcterms:modified":"2014-01-27Txx:xx:xx", }

Microsoft Word 2010Apache Tika 2014 Open Data Promotion Consortium. All Rights Reserved.() DATA.GO.JPCKANCKANhttp://www.soumu.go.jp/main_content/000224888.pdfPDF

52http://www.data.go.jp/data/dataset/soumu_05_ds_131126_00000001dcat:distributiondcat:accessURLURL_25dcat:title()rdf:value(dcat:title()rdf:type(dcat:Datasetrdf:type(dct:keyword()dcat:Distribution()rdf:type(dct:creator()foaf:name()http://www.soumu.go.jp/main_content/000224888.pdfPDFdct:IMT() 2014 Open Data Promotion Consortium. All Rights Reserved.53 2014 Open Data Promotion Consortium. All Rights Reserved.55API63URI6754 2014 Open Data Promotion Consortium. All Rights Reserved.i. 55 2014 Open Data Promotion Consortium. All Rights Reserved.2Microsoft Office Binary (.xls)MicrosoftMicrosoft Excel 200320086 Microsoft Open Specification Promise Microsoft ExcelOpenoffice 3Office Open XML (.xlsx)MicrosoftISO/IEC 29500XML1Microsoft Excel 2007Microsoft ExcelOpenoffice(*) OpenDocument (.ods)OASISISO/IEC 26300XML1Microsoft ExcelOpenoffice CSV (Commna-Separated Values) (.csv)Internet Engineering Task Force (IETF)RFC 4180,200510RFC 4180Microsoft ExcelOpenoffice 56(*) 2014 Open Data Promotion Consortium. All Rights Reserved.2Microsoft Office Binary (.doc)MicrosoftMicrosoft Excel 200320086 Microsoft Open Specification Promise Microsoft WordOpenoffice Rich Text Format (.rtf)MicrosoftMicrosoft WordOpenoffice Portable Document Format (.pdf)Adobe SystemsISO 32000-1Acrobat 57 2014 Open Data Promotion Consortium. All Rights Reserved.3Office Open XML (.docx)MicrosoftISO/IEC 29500XML1Microsoft Excel 2007Microsoft WordOpenoffice(*) OpenDocument (.odt)OASISISO/IEC 26300XML1Microsoft WordOpenoffice HTML (HyperText Markup Language)World Wide Web Consortium (W3C)ISO/IEC 154451Microsoft WordOpenoffice XML (Extensible Markup Language)World Wide Web Consortium (W3C)XHMTL (Extensible HyperText Markup Language)World Wide Web Consortium (W3C)HTMLXML58 2014 Open Data Promotion Consortium. All Rights Reserved.4RDFa (Resource Description Framework in Attributes)World Wide Web Consortium (W3C)XHTML59 2014 Open Data Promotion Consortium. All Rights Reserved.2shapefileESRI(GIS)3GML (Geography Markup Language)Open Geospatial Consortium (OGC)ISO 19136 XML204KMLOpen Geospatial Consortium (OGC)XMLp.6560 2014 Open Data Promotion Consortium. All Rights Reserved.FTP (File Transfer Protocol)Internet Engineering Task Force (IETF)RFC 959HTTP (HyperText Transfer Protocol)Internet Engineering Task Force (IETF)RFC 2616WebWebHTMLRESTURLHTTP4GET, POST, PUT, DELETEwebSOAPWorld Wide Web Consortium (W3C)XMLSPARQLWorld Wide Web Consortium (W3C)RDFJSON (JavaScript Object Notation)Internet Engineering Task Force (IETF)RFC 4627JavaScript61 2014 Open Data Promotion Consortium. All Rights Reserved.Streams API(*)HTTPWorld Wide Web Consortium (W3C) Twitter GTFSGeneral Transit Feed SpecRealtimeGTFSGTFS Realtime GoogleStreams API62(*) Feras Moussa. Streams API. 2013. http://www.w3.org/TR/streams-api/ 2014 Open Data Promotion Consortium. All Rights Reserved.ii. 63 2014 Open Data Promotion Consortium. All Rights Reserved.URIRFIDucode [ITU-T H.642.1]urn:ucode:_0123456789ABCDEF0123456789ABCDEFIDIDID128bitEPC SGTIN (Serialized Global Trade Item Number

urn:epc:id:sgtin:4512345.167890.2urn:epc:tag:sgtin-96:2.4512345.167890.2GS196SGTIN-968332040244384496bitDoI (Digital Object Idnetifiers) [ISO 26234]http://dx.doi.org/10.1021/jo0349227DOI (The International DOI Foundation)DOICD1UUID (Universally Unique IDentifier) [ISO/IEC 11578]urn:uuid:f81d4fae-7dec-11d0-a765-00a0c91e6bf6version 4ID128bit64 2014 Open Data Promotion Consortium. All Rights Reserved.URIRFID [ISO 6523]urn:oid:1.3.170.201233049ISOICD (International Code Designator)()ISOISO/IEC JTC1 SC324ICDICD150ICDurn:oid:1.3.170.201233049ICD1ID175109urn:oid:1.3.147.123456(JIPDEC)EDIAIDC25,0000-9A-Z12http://statdb.nstac.go.jp/lod/sac/1310145419704105(*)65(*) 2014 Open Data Promotion Consortium. All Rights Reserved.URIRFIDISBN [ISO 2108]urn:isbn:4-13-060800-2 ISBN International ISBN Agancy)X-AAAA-BBBB-C10ISBN-1097813ISBN-13XABCX, A, BISBN-13JAN/EANJAN101013ISSN [ISO 3279]urn:issn:1560-1560ISSN84-443111108OpenIDhttp://.openid.ne.jp/OpenID (OpenID Foundation) ID66 2014 Open Data Promotion Consortium. All Rights Reserved.iii. 67 2014 Open Data Promotion Consortium. All Rights Reserved.WebPCHTTP

Web

68Apache HTTP ServerApache Foundationhttp://www.apache.org/Microsoft Internet Information Services (IIS)Microsoft Corporationhttp://www.microsoft.com/ja-jp/server-cloud/windows-server/ 2014 Open Data Promotion Consortium. All Rights Reserved.CKANCKANThe Open Knowledge Foundationhttp://www.ckan.org/69 2014 Open Data Promotion Consortium. All Rights Reserved.GISQGISQGIS Development Teamhttp://qgis.org/Google EarthGooglehttp://www.google.co.jp/earth/GRASS GISGRASAS Development Teamhttp://grass.osgeo.org/ArcGISESRIhttp://www.esrij.com/products/arcgis/70 2014 Open Data Promotion Consortium. All Rights Reserved.http://www.opendata.gr.jp/cfc/

71 2014 Open Data Promotion Consortium. All Rights Reserved.RDFRDFSPARQLAllegroGraphFranz http://www.franz.com/agraph/allegrograph/Apache JenaApache Foundationhttp://jena.apache.org/Neo4jNeo Technologyhttp://www.neo4j.org/SesameAdunahttp://www.openrdf.org/Virtuoso RDFOpenLink Softwarehttp://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VOSRDF72 2014 Open Data Promotion Consortium. All Rights Reserved.[] CKAN (Comprehensive Knowledge Archive Network)webOpen Knowledge Foundationdata.gov () / data.go.uk () / publicdata.eu (EU) / data.gov.au ()data.go.jp () / datameti.go.jp (Open DATA METI) http://ckan.org/http://docs.ckan.org/en/latest/https://github.com/okfn/ckan/wiki/How-to-Install-CKAN73CKAN 2.0 2014 Open Data Promotion Consortium. All Rights Reserved.

74 2014 Open Data Promotion Consortium. All Rights Reserved.CKANCKAN

75 2014 Open Data Promotion Consortium. All Rights Reserved.CKAN2FAQCKANCKANCKAN 2.0data.govdata.go.ukdata.go.jpwebweb76 2014 Open Data Promotion Consortium. All Rights Reserved.CKANCKANweb4

77 2014 Open Data Promotion Consortium. All Rights Reserved.CKANCKAN

78 2014 Open Data Promotion Consortium. All Rights Reserved.Step 1.

79

1.2.3. 2014 Open Data Promotion Consortium. All Rights Reserved.Step 2. 80

1.

2. 2014 Open Data Promotion Consortium. All Rights Reserved.

Step 2. URL3.URLNext:

813.4.5. 2014 Open Data Promotion Consortium. All Rights Reserved.

Step 3. APIdatastoreNext: 6email

826.8.9.7. 2014 Open Data Promotion Consortium. All Rights Reserved.83

2014 Open Data Promotion Consortium. All Rights Reserved.

84

1.2. 2014 Open Data Promotion Consortium. All Rights Reserved.

URLURLURL3.URL

853.4.5. 2014 Open Data Promotion Consortium. All Rights Reserved.Step 2Step 386

2014 Open Data Promotion Consortium. All Rights Reserved.87

2.1.3. 2014 Open Data Promotion Consortium. All Rights Reserved.

3884.5.6. 2014 Open Data Promotion Consortium. All Rights Reserved.

CKAN89

2014 Open Data Promotion Consortium. All Rights Reserved.CKANwebLook & Feel

90

2014 Open Data Promotion Consortium. All Rights Reserved.

2014 Open Data Promotion Consortium. All Rights Reserved.