SlideShare a Scribd company logo
1 of 6
Data Management System
of the FAO Statistics Divison
Monday, February 20, 2017FAO Statistics Division
Overview and main concepts
Monday, February 20, 2017FAO Statistics Division
Main ESS Systems
FAOSTAT CountrySTAT
Statistical Working System (SWS)
National Statistical Offices (NSOs)
Ministries of Agriculture (MAs)
Monday, February 20, 2017FAO Statistics Division
FAOSTAT data collection overview
Information is collected through questionnaires regularly dispatched to the countries via
electronic or regular mail.
The questionnaires have a standard formats, although they are not always uniform
across the FAOSTAT domains
Questionnaires are checked and validated by statistical clerks using different procedures
(including Excel working sheets).
Cleaned and validated data is then converted to a format compatible with the FAOSTAT
Working System.
Once in the FAOSTAT Working System, data is checked and validated a second time
before it is transferred to the FAOSTAT production database for publication.
Monday, February 20, 2017FAO Statistics Division
Structure of the FAOSTAT questionnaire
The questionnaire consists of an Excel Workbook with various sheets. There are:
A Cover Page: containing information such as:
• Contact info: Reporter name, title, administration and office, address, tel., fax, e-mail
• Brief description of the questionnaire: content and key information for its compilation
• Contacts in FAO
Domain-specific worksheets inclusive of the following elements:
• Codes: HS, FAO (FCL), others (depending on the domains)
• Code descriptions: e.g. Commodities, Land Categories, others
• Yearly time series: these can consist of one or more values per year. Fertilizer Production
expressed in metric tons of nutrient content, for example, includes three values for different types of
fertilizer (N, P2O5, K2O). The number of years is constant in each worksheet but varies across the
questionnaires (e.g. Machinery: 7 years; Fertilizer: 4 years; Land use: 5 years)
• Formulas or other ad-hoc columns: whenever needed, other columns are included in the
questionnaire (e.g. Fertilized Production includes columns for Plant Nutrient Content in %; the Land
use and Irrigation includes a column to describe formulas)
• Notes and remarks
Metadata: a set of metadata elements standardized for all questionnaires. It includes:
• Focal point for contact,
• Availability of data
• Sources of basic data
• Frequency of data collection
• Dissemination method
• Timeliness of dissemination
• General observations on the Questionnaire
Additional note
Instructions on how to use the questionnaire
Monday, February 20, 2017FAO Statistics Division
FAOSTAT data validation
This operation requires thorough revision of the questionnaires and the verification of the consistency and completeness of the
data; the compliancy with the standards used by FAO is also verified.
The consistency and reliability of the data is thoroughly check by the ESS officers and statistical clerks. The main elements that
needs validation are listed below
Measurement units:
At times, conversion from local measurement units to the international systems is needed. The questionnaires may report values
expressed in sacks, bags, or other local measurement units. In these cases the statistical clerks use different procedures to check
and validate data
Standardization:
Local commodities or varieties might not be classified using the standard coding system. Those commodities are registered by the
statistical clerks as remarks, but are not included in the database (these are normally minor commodities)
In some cases, alternative classification systems are used to describe the commodities (e.g. Eurostat classification); conversion is
needed to include the data in the database
Metadata and country contacts:
Metadata information is also provided with the questionnaire and this data is converted to a proper metadata format.
Key tools:
• Cross-validation with external datasets
• Verification of incongruence of totals or calculated fields
• Interpolation of missing data
• Data checking and validation tools for generating the Food Balance Sheet
• Creation of working tables and charts
All methods applied by the statistical clerks to check and validate the data are quite solid and well tested and despite the large
number of questionnaires received every year they carry out the job in relatively short time.
Monday, February 20, 2017FAO Statistics Division
CountrySTAT data management
Aims at building country ownership of the system
NSOs are entirely responsible for the data updates
No request for data is made by FAO to NSO to feed CountrySTAT, as in
FAOSTAT
TWGs are the tools to build capacity on methods, standards and indicators that
are most relevant and convenient to monitor the status of agriculture and food
security
CountrySTAT data is accessed by FAOSTAT Statistical Working System via
web services or direct queries
FAOSTAT data and CountrySTAT data are harmonized through software
programs that convert national classifications to FAOSTAT international
classifications (HS, CPC, etc.) and vice versa

More Related Content

What's hot

Delivering access to chemistry and bioassay data from the National Center for...
Delivering access to chemistry and bioassay data from the National Center for...Delivering access to chemistry and bioassay data from the National Center for...
Delivering access to chemistry and bioassay data from the National Center for...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
4.1 CSMT PI Reporting Business Process
4.1 CSMT PI Reporting Business Process4.1 CSMT PI Reporting Business Process
4.1 CSMT PI Reporting Business Process
Max Akister
 
200-ORCID Understanding Innovation better through an identifier infrastructure
200-ORCID Understanding Innovation better through an identifier infrastructure200-ORCID Understanding Innovation better through an identifier infrastructure
200-ORCID Understanding Innovation better through an identifier infrastructure
innovationoecd
 

What's hot (11)

Delivering access to chemistry and bioassay data from the National Center for...
Delivering access to chemistry and bioassay data from the National Center for...Delivering access to chemistry and bioassay data from the National Center for...
Delivering access to chemistry and bioassay data from the National Center for...
 
Monitoring and evaluation of Africa RISING: Results and achievements from Pha...
Monitoring and evaluation of Africa RISING: Results and achievements from Pha...Monitoring and evaluation of Africa RISING: Results and achievements from Pha...
Monitoring and evaluation of Africa RISING: Results and achievements from Pha...
 
Quality challenges in modernising business statistics
Quality challenges in modernising business statisticsQuality challenges in modernising business statistics
Quality challenges in modernising business statistics
 
Collaborative evaluation opportunities in Africa RISING Phase II
Collaborative evaluation opportunities in Africa RISING Phase IICollaborative evaluation opportunities in Africa RISING Phase II
Collaborative evaluation opportunities in Africa RISING Phase II
 
4.1 CSMT PI Reporting Business Process
4.1 CSMT PI Reporting Business Process4.1 CSMT PI Reporting Business Process
4.1 CSMT PI Reporting Business Process
 
Livestock and Fish theory of change approach
Livestock and Fish theory of change approachLivestock and Fish theory of change approach
Livestock and Fish theory of change approach
 
HLEG thematic workshop on Measurement of Well Being and Development in Africa...
HLEG thematic workshop on Measurement of Well Being and Development in Africa...HLEG thematic workshop on Measurement of Well Being and Development in Africa...
HLEG thematic workshop on Measurement of Well Being and Development in Africa...
 
International Monetary Fund
International Monetary FundInternational Monetary Fund
International Monetary Fund
 
Communicating Agricultural Science and Technology Indicators: Lessons learned
Communicating Agricultural Science and Technology Indicators: Lessons learnedCommunicating Agricultural Science and Technology Indicators: Lessons learned
Communicating Agricultural Science and Technology Indicators: Lessons learned
 
Communicating Agricultural Science and Technology Indicators: Lessons Learned
Communicating Agricultural Science and Technology Indicators: Lessons LearnedCommunicating Agricultural Science and Technology Indicators: Lessons Learned
Communicating Agricultural Science and Technology Indicators: Lessons Learned
 
200-ORCID Understanding Innovation better through an identifier infrastructure
200-ORCID Understanding Innovation better through an identifier infrastructure200-ORCID Understanding Innovation better through an identifier infrastructure
200-ORCID Understanding Innovation better through an identifier infrastructure
 

Viewers also liked

Four dimensions of multimedia
Four dimensions of multimediaFour dimensions of multimedia
Four dimensions of multimedia
Chris Clark
 

Viewers also liked (10)

Tomate Platense. Ing. José María Garat, UNLP. (spanish)
Tomate Platense. Ing. José María Garat, UNLP. (spanish)Tomate Platense. Ing. José María Garat, UNLP. (spanish)
Tomate Platense. Ing. José María Garat, UNLP. (spanish)
 
"Seminaire sur Les produits alimentaires de qualité spécifique liée à l’origi...
"Seminaire sur Les produits alimentaires de qualité spécifique liée à l’origi..."Seminaire sur Les produits alimentaires de qualité spécifique liée à l’origi...
"Seminaire sur Les produits alimentaires de qualité spécifique liée à l’origi...
 
Presentación de las solicitudes de reconocimiento de una IG/DO. Diagnóstico. ...
Presentación de las solicitudes de reconocimiento de una IG/DO. Diagnóstico. ...Presentación de las solicitudes de reconocimiento de una IG/DO. Diagnóstico. ...
Presentación de las solicitudes de reconocimiento de una IG/DO. Diagnóstico. ...
 
K11038 Mayur control ppt
K11038 Mayur control pptK11038 Mayur control ppt
K11038 Mayur control ppt
 
Four dimensions of multimedia
Four dimensions of multimediaFour dimensions of multimedia
Four dimensions of multimedia
 
The need for GI policy in South-eastern European countries
The need for GI policy in South-eastern European countriesThe need for GI policy in South-eastern European countries
The need for GI policy in South-eastern European countries
 
Maroc-Guide du demandeur, 2010
Maroc-Guide du demandeur, 2010Maroc-Guide du demandeur, 2010
Maroc-Guide du demandeur, 2010
 
como herramientas para competir en el mercado”
como herramientas para competir en el mercado”como herramientas para competir en el mercado”
como herramientas para competir en el mercado”
 
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ..."Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
 
Squeezing Deep Learning Into Mobile Phones
Squeezing Deep Learning Into Mobile PhonesSqueezing Deep Learning Into Mobile Phones
Squeezing Deep Learning Into Mobile Phones
 

Similar to Data Management System of the FAO Statistics Divison

Assessing M&E Systems For Data Quality
Assessing M&E Systems For Data QualityAssessing M&E Systems For Data Quality
Assessing M&E Systems For Data Quality
MEASURE Evaluation
 
Components Of M E Systems La 4
Components Of M E Systems La 4Components Of M E Systems La 4
Components Of M E Systems La 4
lmwagwabi
 
Trade, industry and cooperatives ssps presentation
Trade, industry and cooperatives ssps presentationTrade, industry and cooperatives ssps presentation
Trade, industry and cooperatives ssps presentation
Tonny Bbale
 

Similar to Data Management System of the FAO Statistics Divison (20)

"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES/ Cou...
"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES/ Cou..."CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES/ Cou...
"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES/ Cou...
 
"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES Coun...
"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES Coun..."CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES Coun...
"CountrySTAT REGIONAL BASIC ADMINISTRATOR TRAINING for GCC MEMBER STATES Coun...
 
Uganda CountrySTAT Presentation Harmonized data Lusaka, 12-16 November 2012
Uganda CountrySTAT Presentation Harmonized data Lusaka, 12-16 November 2012Uganda CountrySTAT Presentation Harmonized data Lusaka, 12-16 November 2012
Uganda CountrySTAT Presentation Harmonized data Lusaka, 12-16 November 2012
 
Flint for global club directors
Flint  for  global club directorsFlint  for  global club directors
Flint for global club directors
 
Mo hsw national dqa tool_18aug2016_facil
Mo hsw national  dqa tool_18aug2016_facilMo hsw national  dqa tool_18aug2016_facil
Mo hsw national dqa tool_18aug2016_facil
 
challanges of MIS system
challanges of MIS systemchallanges of MIS system
challanges of MIS system
 
Health Information System Performance Monitoring Tool
Health Information System Performance Monitoring ToolHealth Information System Performance Monitoring Tool
Health Information System Performance Monitoring Tool
 
Data Warehousing and Business Intelligence Project on Smart Agriculture and M...
Data Warehousing and Business Intelligence Project on Smart Agriculture and M...Data Warehousing and Business Intelligence Project on Smart Agriculture and M...
Data Warehousing and Business Intelligence Project on Smart Agriculture and M...
 
Assessing M&E Systems For Data Quality
Assessing M&E Systems For Data QualityAssessing M&E Systems For Data Quality
Assessing M&E Systems For Data Quality
 
Components Of M E Systems La 4
Components Of M E Systems La 4Components Of M E Systems La 4
Components Of M E Systems La 4
 
Designing baseline surveys for impact analysis and evaluation of progress
Designing baseline surveys for impact analysis and evaluation of progressDesigning baseline surveys for impact analysis and evaluation of progress
Designing baseline surveys for impact analysis and evaluation of progress
 
FAO Approach to Data Exchange and Dissemination
FAO Approach to  Data Exchange and DisseminationFAO Approach to  Data Exchange and Dissemination
FAO Approach to Data Exchange and Dissemination
 
Eurostat Strategy for Agricultural Statistics 2020 and beyond for the future ...
Eurostat Strategy for Agricultural Statistics 2020 and beyond for the future ...Eurostat Strategy for Agricultural Statistics 2020 and beyond for the future ...
Eurostat Strategy for Agricultural Statistics 2020 and beyond for the future ...
 
ISPMS Background, Purpose and Approach
ISPMS Background, Purpose and ApproachISPMS Background, Purpose and Approach
ISPMS Background, Purpose and Approach
 
T4N - Session 2: Introduction to data curation and analysis processes
T4N - Session 2: Introduction to data curation and analysis processesT4N - Session 2: Introduction to data curation and analysis processes
T4N - Session 2: Introduction to data curation and analysis processes
 
Recent methodological developments (MSF): Technical Session 2
Recent methodological developments (MSF): Technical Session 2Recent methodological developments (MSF): Technical Session 2
Recent methodological developments (MSF): Technical Session 2
 
CountrySTAT / FENIX Follow-up actions 25 – 26 June 2015 FAO HQ, Rome
CountrySTAT / FENIX Follow-up actions 25 – 26 June 2015 FAO HQ, RomeCountrySTAT / FENIX Follow-up actions 25 – 26 June 2015 FAO HQ, Rome
CountrySTAT / FENIX Follow-up actions 25 – 26 June 2015 FAO HQ, Rome
 
Trade, industry and cooperatives ssps presentation
Trade, industry and cooperatives ssps presentationTrade, industry and cooperatives ssps presentation
Trade, industry and cooperatives ssps presentation
 
ONS presentation at RSS South Wales poverty & inequality stats event
ONS presentation at RSS South Wales poverty & inequality stats eventONS presentation at RSS South Wales poverty & inequality stats event
ONS presentation at RSS South Wales poverty & inequality stats event
 
Overview of the new CountrySTAT system and strategy
Overview of the new CountrySTAT system and strategyOverview of the new CountrySTAT system and strategy
Overview of the new CountrySTAT system and strategy
 

More from FAO

More from FAO (20)

Nigeria
NigeriaNigeria
Nigeria
 
Niger
NigerNiger
Niger
 
Namibia
NamibiaNamibia
Namibia
 
Mozambique
MozambiqueMozambique
Mozambique
 
Zimbabwe takesure
Zimbabwe takesureZimbabwe takesure
Zimbabwe takesure
 
Zimbabwe
ZimbabweZimbabwe
Zimbabwe
 
Zambia
ZambiaZambia
Zambia
 
Togo
TogoTogo
Togo
 
Tanzania
TanzaniaTanzania
Tanzania
 
Spal presentation
Spal presentationSpal presentation
Spal presentation
 
Rwanda
RwandaRwanda
Rwanda
 
Nigeria uponi
Nigeria uponiNigeria uponi
Nigeria uponi
 
The multi-faced role of soil in the NENA regions (part 2)
The multi-faced role of soil in the NENA regions (part 2)The multi-faced role of soil in the NENA regions (part 2)
The multi-faced role of soil in the NENA regions (part 2)
 
The multi-faced role of soil in the NENA regions (part 1)
The multi-faced role of soil in the NENA regions (part 1)The multi-faced role of soil in the NENA regions (part 1)
The multi-faced role of soil in the NENA regions (part 1)
 
Agenda of the launch of the soil policy brief at the Land&Water Days
Agenda of the launch of the soil policy brief at the Land&Water DaysAgenda of the launch of the soil policy brief at the Land&Water Days
Agenda of the launch of the soil policy brief at the Land&Water Days
 
Agenda of the 5th NENA Soil Partnership meeting
Agenda of the 5th NENA Soil Partnership meetingAgenda of the 5th NENA Soil Partnership meeting
Agenda of the 5th NENA Soil Partnership meeting
 
The Voluntary Guidelines for Sustainable Soil Management
The Voluntary Guidelines for Sustainable Soil ManagementThe Voluntary Guidelines for Sustainable Soil Management
The Voluntary Guidelines for Sustainable Soil Management
 
GLOSOLAN - Mission, status and way forward
GLOSOLAN - Mission, status and way forwardGLOSOLAN - Mission, status and way forward
GLOSOLAN - Mission, status and way forward
 
Towards a Global Soil Information System (GLOSIS)
Towards a Global Soil Information System (GLOSIS)Towards a Global Soil Information System (GLOSIS)
Towards a Global Soil Information System (GLOSIS)
 
GSP developments of regional interest in 2019
GSP developments of regional interest in 2019GSP developments of regional interest in 2019
GSP developments of regional interest in 2019
 

Recently uploaded

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Recently uploaded (20)

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 

Data Management System of the FAO Statistics Divison

  • 1. Data Management System of the FAO Statistics Divison Monday, February 20, 2017FAO Statistics Division Overview and main concepts
  • 2. Monday, February 20, 2017FAO Statistics Division Main ESS Systems FAOSTAT CountrySTAT Statistical Working System (SWS) National Statistical Offices (NSOs) Ministries of Agriculture (MAs)
  • 3. Monday, February 20, 2017FAO Statistics Division FAOSTAT data collection overview Information is collected through questionnaires regularly dispatched to the countries via electronic or regular mail. The questionnaires have a standard formats, although they are not always uniform across the FAOSTAT domains Questionnaires are checked and validated by statistical clerks using different procedures (including Excel working sheets). Cleaned and validated data is then converted to a format compatible with the FAOSTAT Working System. Once in the FAOSTAT Working System, data is checked and validated a second time before it is transferred to the FAOSTAT production database for publication.
  • 4. Monday, February 20, 2017FAO Statistics Division Structure of the FAOSTAT questionnaire The questionnaire consists of an Excel Workbook with various sheets. There are: A Cover Page: containing information such as: • Contact info: Reporter name, title, administration and office, address, tel., fax, e-mail • Brief description of the questionnaire: content and key information for its compilation • Contacts in FAO Domain-specific worksheets inclusive of the following elements: • Codes: HS, FAO (FCL), others (depending on the domains) • Code descriptions: e.g. Commodities, Land Categories, others • Yearly time series: these can consist of one or more values per year. Fertilizer Production expressed in metric tons of nutrient content, for example, includes three values for different types of fertilizer (N, P2O5, K2O). The number of years is constant in each worksheet but varies across the questionnaires (e.g. Machinery: 7 years; Fertilizer: 4 years; Land use: 5 years) • Formulas or other ad-hoc columns: whenever needed, other columns are included in the questionnaire (e.g. Fertilized Production includes columns for Plant Nutrient Content in %; the Land use and Irrigation includes a column to describe formulas) • Notes and remarks Metadata: a set of metadata elements standardized for all questionnaires. It includes: • Focal point for contact, • Availability of data • Sources of basic data • Frequency of data collection • Dissemination method • Timeliness of dissemination • General observations on the Questionnaire Additional note Instructions on how to use the questionnaire
  • 5. Monday, February 20, 2017FAO Statistics Division FAOSTAT data validation This operation requires thorough revision of the questionnaires and the verification of the consistency and completeness of the data; the compliancy with the standards used by FAO is also verified. The consistency and reliability of the data is thoroughly check by the ESS officers and statistical clerks. The main elements that needs validation are listed below Measurement units: At times, conversion from local measurement units to the international systems is needed. The questionnaires may report values expressed in sacks, bags, or other local measurement units. In these cases the statistical clerks use different procedures to check and validate data Standardization: Local commodities or varieties might not be classified using the standard coding system. Those commodities are registered by the statistical clerks as remarks, but are not included in the database (these are normally minor commodities) In some cases, alternative classification systems are used to describe the commodities (e.g. Eurostat classification); conversion is needed to include the data in the database Metadata and country contacts: Metadata information is also provided with the questionnaire and this data is converted to a proper metadata format. Key tools: • Cross-validation with external datasets • Verification of incongruence of totals or calculated fields • Interpolation of missing data • Data checking and validation tools for generating the Food Balance Sheet • Creation of working tables and charts All methods applied by the statistical clerks to check and validate the data are quite solid and well tested and despite the large number of questionnaires received every year they carry out the job in relatively short time.
  • 6. Monday, February 20, 2017FAO Statistics Division CountrySTAT data management Aims at building country ownership of the system NSOs are entirely responsible for the data updates No request for data is made by FAO to NSO to feed CountrySTAT, as in FAOSTAT TWGs are the tools to build capacity on methods, standards and indicators that are most relevant and convenient to monitor the status of agriculture and food security CountrySTAT data is accessed by FAOSTAT Statistical Working System via web services or direct queries FAOSTAT data and CountrySTAT data are harmonized through software programs that convert national classifications to FAOSTAT international classifications (HS, CPC, etc.) and vice versa