SlideShare une entreprise Scribd logo
1  sur  16
Télécharger pour lire hors ligne
Visualizing the
Bureau of Labor Statistics
Employment Dataset
by
Siva Mohan and Curran Kelleher
Outline
●Understanding the Dataset
●Data Preparation
●Visualizations
●Issues
Understanding the Dataset
as dimensions and measures
●Raw data at ftp://ftp.bls.gov/pub/special.requests/cew/
●Covers Time from 1990 to 2007
● Data for years, quarters, and months
●Covers Space for all US States
● Data for States and Counties
●Covers the NAICS Industry hierarchy
●Covers Ownership
● Government (Federal, State, Local) and
Private
●Contains measures employment, annual pay,
total wages, and number of establishments
(among others)
NAICS
North American Industry Classification System
●11 Agriculture, Forestry, Fishing and Hunting
●111 Crop Production
●1111 Oilseed and Grain Farming
●11111 Soybean Farming
●111110 Soybean Farming
●11112 Oilseed (except Soybean)
Farming
●111120 Oilseed (except Soybean)
Farming
●11113 Dry Pea and Bean Farming
●111130 Dry Pea and Bean Farming
●11114 Wheat Farming
●111140 Wheat Farming
Data Preprocessing
●We wrote shell scripts to
● Download all raw data files via FTP
● Parse the raw data files (BLS fixed width format)
● Import the raw data files into a MySQL database
●We manually imported tables mapping
● BLS “Area Code” → state name
● BLS “Area Code” → state abbreviation
● Necessary for using Tableau's map feature
● NAICS code → industry name
● BLS Ownership code → ownership name
Visualizations
Issues
●No support for hierarchical data cubes
● With this we could have seen the whole dataset
●County data too large for Tableau (1 min per vis)
●Hierarchical time was (seemingly) impossible
● Years in different tables, months in different columns
● Tableau expects each dimension as a single column
●We did not document as we went, had to backtrack
●“Cancel” query in Tableau didn't stop queries
●Overlapping labels occurred often
●(seemingly) impossible to probe with many
dimensions
the end.

Contenu connexe

En vedette

Cape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentCape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentfianacone
 
Lmi Orientation Pyc0311new
Lmi Orientation Pyc0311newLmi Orientation Pyc0311new
Lmi Orientation Pyc0311newGary Crossley
 
Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Kurt S. Altrichter
 
Understanding and Using Labor Market Information
Understanding and Using Labor Market InformationUnderstanding and Using Labor Market Information
Understanding and Using Labor Market InformationMichele Martin
 
Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...PAPartners
 
Cass County Labor Market Data
Cass County Labor Market DataCass County Labor Market Data
Cass County Labor Market DataKinexus
 
Contextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataContextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataEMSI
 
African Americans: College Majors and Earnings
African Americans: College Majors and Earnings African Americans: College Majors and Earnings
African Americans: College Majors and Earnings CEW Georgetown
 
The Online College Labor Market
The Online College Labor MarketThe Online College Labor Market
The Online College Labor MarketCEW Georgetown
 

En vedette (12)

Cape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employmentCape may-county-data-demographics-labor-employment
Cape may-county-data-demographics-labor-employment
 
2016 Labor Report FINAL
2016 Labor Report FINAL2016 Labor Report FINAL
2016 Labor Report FINAL
 
Lmi Orientation Pyc0311new
Lmi Orientation Pyc0311newLmi Orientation Pyc0311new
Lmi Orientation Pyc0311new
 
Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015Economic Snapshot- -August 3, 2015
Economic Snapshot- -August 3, 2015
 
Carlos a
Carlos aCarlos a
Carlos a
 
Understanding and Using Labor Market Information
Understanding and Using Labor Market InformationUnderstanding and Using Labor Market Information
Understanding and Using Labor Market Information
 
Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...Session, Tools for Labor Market Information - Center for Workforce Informatio...
Session, Tools for Labor Market Information - Center for Workforce Informatio...
 
County Profile Template Booklet
County Profile Template BookletCounty Profile Template Booklet
County Profile Template Booklet
 
Cass County Labor Market Data
Cass County Labor Market DataCass County Labor Market Data
Cass County Labor Market Data
 
Contextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market DataContextualizing Real-Time and Traditional Labor Market Data
Contextualizing Real-Time and Traditional Labor Market Data
 
African Americans: College Majors and Earnings
African Americans: College Majors and Earnings African Americans: College Majors and Earnings
African Americans: College Majors and Earnings
 
The Online College Labor Market
The Online College Labor MarketThe Online College Labor Market
The Online College Labor Market
 

Plus de Curran Kelleher

Plus de Curran Kelleher (9)

Resume
ResumeResume
Resume
 
Introduction to D3
Introduction to D3Introduction to D3
Introduction to D3
 
The Chiasm Visualization Platform
The Chiasm Visualization PlatformThe Chiasm Visualization Platform
The Chiasm Visualization Platform
 
Chiasm
ChiasmChiasm
Chiasm
 
Introduction to D3.js
Introduction to D3.jsIntroduction to D3.js
Introduction to D3.js
 
2011 07 14_fractalperspective
2011 07 14_fractalperspective2011 07 14_fractalperspective
2011 07 14_fractalperspective
 
Code-Hub
Code-HubCode-Hub
Code-Hub
 
Multiscale Visualization Using Data Cubes
Multiscale Visualization Using Data CubesMultiscale Visualization Using Data Cubes
Multiscale Visualization Using Data Cubes
 
CSGSO Welcome Reception Fall 2012
CSGSO Welcome Reception Fall 2012CSGSO Welcome Reception Fall 2012
CSGSO Welcome Reception Fall 2012
 

Dernier

APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxShobhayan Kirtania
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 

Dernier (20)

INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 

Visualizing the Bureau of Labor Statistics Employment Dataset

  • 1. Visualizing the Bureau of Labor Statistics Employment Dataset by Siva Mohan and Curran Kelleher
  • 2. Outline ●Understanding the Dataset ●Data Preparation ●Visualizations ●Issues
  • 3. Understanding the Dataset as dimensions and measures ●Raw data at ftp://ftp.bls.gov/pub/special.requests/cew/ ●Covers Time from 1990 to 2007 ● Data for years, quarters, and months ●Covers Space for all US States ● Data for States and Counties ●Covers the NAICS Industry hierarchy ●Covers Ownership ● Government (Federal, State, Local) and Private ●Contains measures employment, annual pay, total wages, and number of establishments (among others)
  • 4. NAICS North American Industry Classification System ●11 Agriculture, Forestry, Fishing and Hunting ●111 Crop Production ●1111 Oilseed and Grain Farming ●11111 Soybean Farming ●111110 Soybean Farming ●11112 Oilseed (except Soybean) Farming ●111120 Oilseed (except Soybean) Farming ●11113 Dry Pea and Bean Farming ●111130 Dry Pea and Bean Farming ●11114 Wheat Farming ●111140 Wheat Farming
  • 5. Data Preprocessing ●We wrote shell scripts to ● Download all raw data files via FTP ● Parse the raw data files (BLS fixed width format) ● Import the raw data files into a MySQL database ●We manually imported tables mapping ● BLS “Area Code” → state name ● BLS “Area Code” → state abbreviation ● Necessary for using Tableau's map feature ● NAICS code → industry name ● BLS Ownership code → ownership name
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Issues ●No support for hierarchical data cubes ● With this we could have seen the whole dataset ●County data too large for Tableau (1 min per vis) ●Hierarchical time was (seemingly) impossible ● Years in different tables, months in different columns ● Tableau expects each dimension as a single column ●We did not document as we went, had to backtrack ●“Cancel” query in Tableau didn't stop queries ●Overlapping labels occurred often ●(seemingly) impossible to probe with many dimensions