SlideShare une entreprise Scribd logo
1  sur  11
OPEN REFINE:
E N H A N C E Y O U R S I E R R A A D M I N C O R N E R U X
B Y : W H I T N I
W A T K I N S
INTRO
+ =
INSTALL OPEN REFINE
Download & Install OpenRefine
Go to & Download: http://openrefine.org/download.html
**If on Mac change system security settings to: Allow Apps to DL from Anywhere
How to Launch OpenRefine WorkSpace if it doesn’t launch
automatically
Open Browser > Go to http://127.0.0.1:3333/
CREATE PROJECT - PASTE CODE FROM III
• Need access to Sierra Admin Corner & User Permission 30
(password & authorizations)
• Search for <span id=“If_40”> in permission source code
• Select/Copy all code from <span id=“If_40”> to <span
id=“For_527>
1. Click “create
project”
2. Select “Clipboard”
3. Paste code copied
from above.
SELECT CODE PORTION FOR PROJECT DATA
Selecting XML element for parsing <option…>[code]</option>
APPLY A,B,C AND 1,2,3 FOR CLEAN-UP
• Split Permission name & Number
• Select column > edit columns > split into several columns >
• Separator == (
• Split into 2 columns
• Transform cells (GREL replace)
• Edit Cells > Transform > GREL string { value.replace(“)”,” “) }
• Remove unnecessary columns
• Mass edit cells with Text Facet
• Facet > Text Facet
• Selected > edit > Assigned > apply
• Blank > edit > Apply
• Blank > All > Edit Rows > Remove all matching rows
EXPORT PROJECT TO COMP
• Close all open facets and filters
• Select Export > Select Format > apply internal formatting
• Open local file listing only assigned permissions
EXTRACT JSON CODE
• Click Undo/Redo tab on current project
• Click extract
• Highlight & copy JSON code
• Save in Text Editor
• Paste into New Project
• Create New Project
• Select Undo/Redo tab
• Click apply and paste extracted JSON
• Select Perform Operations
APPLY JSON CODE
OpenRefine Wiki :
https://github.com/OpenRefine/OpenRefine/wiki
GitHub Repos
OpenRefine : https://github.com/OpenRefine/OpenRefine
LODRefine (OpenRefine with Linked Data extension installed):
https://github.com/sparkica/LODRefine
JSON Code used in this Presentation:
https://github.com/whitni/IUG2015
RESOURCES
END/CONTACT INFO
Whitni Watkins
wwatkins@stlawu.edu
Twitter: @_whitni

Contenu connexe

En vedette

Reality tv powerpoint the osborurnes
Reality tv powerpoint  the osborurnesReality tv powerpoint  the osborurnes
Reality tv powerpoint the osborurnes
Michelle Soriano
 

En vedette (7)

Beautiful Research Data (Structured Data and Open Refine)
Beautiful Research Data (Structured Data and Open Refine)Beautiful Research Data (Structured Data and Open Refine)
Beautiful Research Data (Structured Data and Open Refine)
 
Open refine reconciliation service api (dc python 2013_03_05)
Open refine reconciliation service api (dc python 2013_03_05)Open refine reconciliation service api (dc python 2013_03_05)
Open refine reconciliation service api (dc python 2013_03_05)
 
Reality tv powerpoint the osborurnes
Reality tv powerpoint  the osborurnesReality tv powerpoint  the osborurnes
Reality tv powerpoint the osborurnes
 
Intro to open refine
Intro to open refineIntro to open refine
Intro to open refine
 
20130206 open refine
20130206  open refine20130206  open refine
20130206 open refine
 
Data Wrangling with Open Refine
Data Wrangling with Open RefineData Wrangling with Open Refine
Data Wrangling with Open Refine
 
Open refine to update and clean up your messy data
Open refine to update and clean up your messy dataOpen refine to update and clean up your messy data
Open refine to update and clean up your messy data
 

Similaire à Iug2015 watkins

Similaire à Iug2015 watkins (20)

IoTSuite User Manual
IoTSuite User ManualIoTSuite User Manual
IoTSuite User Manual
 
Oracle_Retail_Xstore_Suite_Install.pdf
Oracle_Retail_Xstore_Suite_Install.pdfOracle_Retail_Xstore_Suite_Install.pdf
Oracle_Retail_Xstore_Suite_Install.pdf
 
Comment utiliser Visual Studio Code pour travailler avec une scratch Org
Comment utiliser Visual Studio Code pour travailler avec une scratch OrgComment utiliser Visual Studio Code pour travailler avec une scratch Org
Comment utiliser Visual Studio Code pour travailler avec une scratch Org
 
Zend Studio Tips and Tricks #zendcon 10
Zend Studio Tips and Tricks #zendcon 10Zend Studio Tips and Tricks #zendcon 10
Zend Studio Tips and Tricks #zendcon 10
 
C++ Constructs.pptx
C++ Constructs.pptxC++ Constructs.pptx
C++ Constructs.pptx
 
JS Fest 2018. Никита Галкин. Микросервисная архитектура с переиспользуемыми к...
JS Fest 2018. Никита Галкин. Микросервисная архитектура с переиспользуемыми к...JS Fest 2018. Никита Галкин. Микросервисная архитектура с переиспользуемыми к...
JS Fest 2018. Никита Галкин. Микросервисная архитектура с переиспользуемыми к...
 
CodeShip
CodeShipCodeShip
CodeShip
 
Building Your First App with Shawn Mcarthy
Building Your First App with Shawn Mcarthy Building Your First App with Shawn Mcarthy
Building Your First App with Shawn Mcarthy
 
Jenkins CI
Jenkins CIJenkins CI
Jenkins CI
 
XPages Blast - Lotusphere 2011
XPages Blast - Lotusphere 2011XPages Blast - Lotusphere 2011
XPages Blast - Lotusphere 2011
 
XPages -Beyond the Basics
XPages -Beyond the BasicsXPages -Beyond the Basics
XPages -Beyond the Basics
 
Dev Jumpstart: Building Your First App
Dev Jumpstart: Building Your First AppDev Jumpstart: Building Your First App
Dev Jumpstart: Building Your First App
 
Bitbucket git-bamboo-jira
Bitbucket git-bamboo-jiraBitbucket git-bamboo-jira
Bitbucket git-bamboo-jira
 
Créer et gérer une scratch org avec Visual Studio Code
Créer et gérer une scratch org avec Visual Studio CodeCréer et gérer une scratch org avec Visual Studio Code
Créer et gérer une scratch org avec Visual Studio Code
 
Automatic deployment on .NET web stack (Minsk .NET meetup 12.02.14)
Automatic deployment on .NET web stack (Minsk .NET meetup 12.02.14)Automatic deployment on .NET web stack (Minsk .NET meetup 12.02.14)
Automatic deployment on .NET web stack (Minsk .NET meetup 12.02.14)
 
Eclipse IDE, 2019.09, Java Development
Eclipse IDE, 2019.09, Java Development Eclipse IDE, 2019.09, Java Development
Eclipse IDE, 2019.09, Java Development
 
GIB2021 - Dan Probert - BizTalk Migrator Deep Dive
GIB2021 - Dan Probert - BizTalk Migrator Deep DiveGIB2021 - Dan Probert - BizTalk Migrator Deep Dive
GIB2021 - Dan Probert - BizTalk Migrator Deep Dive
 
Advanced Coded UI Testing
Advanced Coded UI TestingAdvanced Coded UI Testing
Advanced Coded UI Testing
 
Effizientere WordPress-Plugin-Entwicklung mit Softwaretests
Effizientere WordPress-Plugin-Entwicklung mit SoftwaretestsEffizientere WordPress-Plugin-Entwicklung mit Softwaretests
Effizientere WordPress-Plugin-Entwicklung mit Softwaretests
 
IDAPRO
IDAPROIDAPRO
IDAPRO
 

Plus de Whitni Watkins

The future of the integrated library system
The future of the integrated library systemThe future of the integrated library system
The future of the integrated library system
Whitni Watkins
 

Plus de Whitni Watkins (10)

#Womenintech and beyond
#Womenintech and beyond#Womenintech and beyond
#Womenintech and beyond
 
Code4Lib Increasing Diversity in our Community
Code4Lib Increasing Diversity in our CommunityCode4Lib Increasing Diversity in our Community
Code4Lib Increasing Diversity in our Community
 
Library I.T.: Information Technologists or Information Thought-leaders
Library I.T.: Information Technologists or Information Thought-leadersLibrary I.T.: Information Technologists or Information Thought-leaders
Library I.T.: Information Technologists or Information Thought-leaders
 
Teaching coding workshops
Teaching coding workshopsTeaching coding workshops
Teaching coding workshops
 
Teaching coding workshops
Teaching coding workshops Teaching coding workshops
Teaching coding workshops
 
Current & Future Challenges for Library Systems
Current & Future Challenges for Library SystemsCurrent & Future Challenges for Library Systems
Current & Future Challenges for Library Systems
 
The future of the integrated library system
The future of the integrated library systemThe future of the integrated library system
The future of the integrated library system
 
Popular Education Mobile Apps
Popular Education Mobile Apps Popular Education Mobile Apps
Popular Education Mobile Apps
 
Leadership
LeadershipLeadership
Leadership
 
WCUI Orientation PPT
WCUI Orientation PPTWCUI Orientation PPT
WCUI Orientation PPT
 

Dernier

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 

Dernier (20)

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 

Iug2015 watkins

  • 1. OPEN REFINE: E N H A N C E Y O U R S I E R R A A D M I N C O R N E R U X B Y : W H I T N I W A T K I N S
  • 3. INSTALL OPEN REFINE Download & Install OpenRefine Go to & Download: http://openrefine.org/download.html **If on Mac change system security settings to: Allow Apps to DL from Anywhere How to Launch OpenRefine WorkSpace if it doesn’t launch automatically Open Browser > Go to http://127.0.0.1:3333/
  • 4. CREATE PROJECT - PASTE CODE FROM III • Need access to Sierra Admin Corner & User Permission 30 (password & authorizations) • Search for <span id=“If_40”> in permission source code • Select/Copy all code from <span id=“If_40”> to <span id=“For_527> 1. Click “create project” 2. Select “Clipboard” 3. Paste code copied from above.
  • 5. SELECT CODE PORTION FOR PROJECT DATA Selecting XML element for parsing <option…>[code]</option>
  • 6. APPLY A,B,C AND 1,2,3 FOR CLEAN-UP • Split Permission name & Number • Select column > edit columns > split into several columns > • Separator == ( • Split into 2 columns • Transform cells (GREL replace) • Edit Cells > Transform > GREL string { value.replace(“)”,” “) } • Remove unnecessary columns • Mass edit cells with Text Facet • Facet > Text Facet • Selected > edit > Assigned > apply • Blank > edit > Apply • Blank > All > Edit Rows > Remove all matching rows
  • 7. EXPORT PROJECT TO COMP • Close all open facets and filters • Select Export > Select Format > apply internal formatting • Open local file listing only assigned permissions
  • 8. EXTRACT JSON CODE • Click Undo/Redo tab on current project • Click extract • Highlight & copy JSON code • Save in Text Editor • Paste into New Project
  • 9. • Create New Project • Select Undo/Redo tab • Click apply and paste extracted JSON • Select Perform Operations APPLY JSON CODE
  • 10. OpenRefine Wiki : https://github.com/OpenRefine/OpenRefine/wiki GitHub Repos OpenRefine : https://github.com/OpenRefine/OpenRefine LODRefine (OpenRefine with Linked Data extension installed): https://github.com/sparkica/LODRefine JSON Code used in this Presentation: https://github.com/whitni/IUG2015 RESOURCES

Notes de l'éditeur

  1. Hi, I’m Whitni Watkins the Systems and Technical Services librarian at St. Lawrence University. I will be showing you a way to make the viewing/printing of user permissions in Sierra much more user friendly, through the use of OpenRefine.
  2. Prior to working with Sierra, I was the System Administrator for Millennium where I spent a large amount of my time in Telnet. One of the things I loved was the accessibility to print system information like user permissions. They were easily viewed on one screen, easy to share with dept heads, easy to compare to other users, easier to work with all around. This functionality is non-existent in Sierra, there is lots of click and drag and scrolling to see exactly what a user has AND you can’t print them (WHAT?!) and it is highly frustrating so that was my problem and here is my solution. Yes, there is an ability to do this with a SQL query but what if you don’t have significant enough knowledge in SQL then what?
  3. To create our project, we first select Create Project in OpenRefine and then we select the option to paste text/code. We need to pull the code from our Sierra Admin Corner permissions page. To do this, you need to have access to the Admin Corner and the ability to view authorizations and authentications (Sierra permission 30). Log into your admin corner, for security and time reasons I am using screen shots instead of live login. Right click on the page, select to view Page Source and once you have the page source hit cmd+f or ctrl+f (depending on device) and search for this string: <span id=“If_40”> Copy from the top of that code to the last line of permissions, doing this is much easier to parse through in OpenRefine than pasting the entire source code, believe me I tried. Paste this into the Project you are creating in OpenRefine.
  4. Once we have the code in we are now going to select the string of information that will more or less be our individual pieces of data. Doing this will allow OpenRefine to automate the selection by finding similar strings and separating them on to different lines. Each section of code will be the <option value…> [code]</option>, this will make sure as little unnecessary data is retained in the project file. It is important to highlight only this section of the XML otherwise your parsed data will not be friendly to work with once you create the project. I recommend that you title your project with the Username for whom the permissions belong; this will help you identify the user when you export the project.
  5. Now that we have the code separated, we need to apply different parameters to clean it up and retain only the information we care about. In this case the permission number, permissions group and the brief explanation of the permission. I will quickly walk through these steps First we want to remove any of the unnecessary data Then we want to data split the Permission name and Permission number, this currently is optional, however I am working on a linking database that will match on permission number and link to the corresponding page in the reference guide, so I split them. Now we want to use the transform feature and GREL string value.replace, which is essentially a find and replace; this is saying to find the ) and replace them with nothing. Now we have the mass editing with the Text Facet. DEMO: /Users/wwatkins/Dropbox/Work/SLU 2014 -/Conference Proposals/IUG_demo.swf
  6. I exported the records as Excel and then formatted them to a Word Doc I had created so that is the shot on the left.
  7. Using the JSON code from the project you can extract it and apply it to any future project that you want to have the same steps. I recommend copying the JSON into your text editor and saving it locally/to the cloud/whatever place outside of LODRefine.
  8. Using the JSON code from the project you can extract it and apply it to any future project that you want to have the same steps. I recommend copying the JSON into your text editor and saving it locally/to the cloud/whatever place outside of LODRefine.
  9. Using the JSON code from the project you can extract it and apply it to any future project that you want to have the same steps. I recommend copying the JSON into your text editor and saving it locally/to the cloud/whatever place outside of LODRefine.
  10. I have shared the JSON code and the <database code> on X (decide whether you are going to share it on the website, on google drive, dropbox, IUG clearinghouse) Feel free to contact me via email and add me on Twitter  Questions?